Models & Architectures · Level 2 of 5
Bottleneck
A constrained intermediate representation or computation limiting information or capacity.
A bottleneck can encourage compression but may lose useful details.
Listen to the definition and example
Audio transcript
Bottleneck. A constrained intermediate representation or computation limiting information or capacity. A bottleneck can encourage compression but may lose useful details. For example: A wide input is represented by a much smaller hidden vector.
Explore this concept
Why it matters
This helps you distinguish a model’s structural assumptions from its learned parameter values.
Start with
Related concepts
Quick recall question
Try answering before looking back at the definition.