Hardware / GPUs / Apple Silicon · Level 2 of 5
Float16
A 16-bit floating-point format with less range and precision than float32.
Its limited range can require stability techniques during training.
Listen to the definition and example
Audio transcript
Float16. A 16-bit floating-point format with less range and precision than float32. Its limited range can require stability techniques during training. For example: A tensor occupies half the storage of its float32 counterpart.
Explore this concept
Why it matters
This helps you identify whether compute, memory, or runtime support limits execution.
Start with
Quick recall question
Try answering before looking back at the definition.