RNNs · Level 3 of 5
Forget Gate
An LSTM gate controlling retention of previous cell-state components.
Its values scale what persists and need not represent an interpretable memory decision.
Example
A memory component is reduced when it stops being useful.
Listen to the definition and example
Audio transcript
Forget Gate. An LSTM gate controlling retention of previous cell-state components. Its values scale what persists and need not represent an interpretable memory decision. For example: A memory component is reduced when it stops being useful.
Explore this concept
Why it matters
This helps you trace information and gradient flow through sequence models.
Start with
Related concepts
Quick recall question
Try answering before looking back at the definition.