Model Training · Level 2 of 5
Mini-batch
A subset of the training data used for one approximate gradient computation.
It trades gradient noise against computation and memory efficiency.
Example
A trainer estimates a gradient using 32 of its million examples.
Listen to the definition and example
Audio transcript
Mini-batch. A subset of the training data used for one approximate gradient computation. It trades gradient noise against computation and memory efficiency. For example: A trainer estimates a gradient using 32 of its million examples.
Explore this concept
Start with
Related concepts
Quick recall question
Try answering before looking back at the definition.