RNNs · Level 3 of 5
Truncated Backpropagation
Limiting gradient propagation through a sequence to a shorter span.
It reduces memory and computation but restricts learned credit assignment across time.
Listen to the definition and example
Audio transcript
Truncated Backpropagation. Limiting gradient propagation through a sequence to a shorter span. It reduces memory and computation but restricts learned credit assignment across time. For example: Training detaches the recurrent state every fixed number of steps.
Explore this concept
Why it matters
This helps you trace information and gradient flow through sequence models.
Start with
Related concepts
Quick recall question
Try answering before looking back at the definition.