RNNs · Level 3 of 5
LSTM (LSTM)
A recurrent architecture with gates and a cell state designed to preserve useful information.
Gates regulate writing, retaining, and exposing state.
Example
A sequence model learns to keep a signal across many time steps.
Listen to the definition and example
Audio transcript
LSTM. A recurrent architecture with gates and a cell state designed to preserve useful information. Gates regulate writing, retaining, and exposing state. For example: A sequence model learns to keep a signal across many time steps.
Explore this concept
A useful analogy
A notebook with separate controls for retaining, writing, and revealing information.
Why it matters
This helps you trace information and gradient flow through sequence models.
Technical detail
Gated elementwise operations update a cell state, typically c_t = f_t⊙c_(t−1)+i_t⊙g_t, and h_t = o_t⊙tanh(c_t).
Common misconception
Gates help preserve information but do not guarantee unlimited long-term memory.
Start with
Related concepts
Quick recall question
Try answering before looking back at the definition.