Model Training · Level 2 of 5
Mixed Precision Training
Training with multiple numerical precisions to balance speed, memory, and stability.
Some operations or stored values may remain in higher precision.
Listen to the definition and example
Audio transcript
Mixed Precision Training. Training with multiple numerical precisions to balance speed, memory, and stability. Some operations or stored values may remain in higher precision. For example: Matrix multiplications use lower precision while sensitive reductions use float32.
Explore this concept
Related concepts
Quick recall question
Try answering before looking back at the definition.