Large Language Models · Level 2 of 5
Token Budget
A limit on tokens available for context, generation, or computation.
The exact accounting depends on the system and model.
Example
An application reserves room for a 500-token response.
Listen to the definition and example
Audio transcript
Token Budget. A limit on tokens available for context, generation, or computation. The exact accounting depends on the system and model. For example: An application reserves room for a 500-token response.
Explore this concept
Why it matters
This helps you interpret model behavior and control how text is processed or generated.
Start with
Related concepts
Quick recall question
Try answering before looking back at the definition.