Model Training · Level 2 of 5
Epoch
One pass through a defined training dataset.
Sampling, streaming, and distributed setups may define passes differently.
Example
A trainer has processed every example once.
Listen to the definition and example
Audio transcript
Epoch. One pass through a defined training dataset. Sampling, streaming, and distributed setups may define passes differently. For example: A trainer has processed every example once.
Explore this concept
A useful analogy
One circuit around a finite collection of training examples.
Technical detail
If N examples are visited once in batches of size B, an epoch has approximately ceil(N/B) steps when the last partial batch is kept.
Common misconception
An epoch is not one optimizer step unless the entire dataset fits into that step.
Related concepts
Quick recall question
Try answering before looking back at the definition.