Model Evaluation · Level 2 of 5
Calibration
Agreement between predicted probabilities and observed outcome frequencies.
A well-calibrated score of 0.8 should correspond to about 80 percent positives in comparable cases.
Example
Among many 80-percent predictions, roughly four out of five are correct.
Listen to the definition and example
Audio transcript
Calibration. Agreement between predicted probabilities and observed outcome frequencies. A well-calibrated score of 0.8 should correspond to about 80 percent positives in comparable cases. For example: Among many 80-percent predictions, roughly four out of five are correct.
Explore this concept
Why it matters
This helps you ask what a reported score counts and which errors it can hide.
Start with
Related concepts
Quick recall question
Try answering before looking back at the definition.