Data & Datasets · Level 2 of 5
Validation Set
Held-out examples used for development decisions such as model selection.
Repeated tuning on validation data can overfit those decisions.
Example
Two model configurations are compared before choosing one.
Listen to the definition and example
Audio transcript
Validation Set. Held-out examples used for development decisions such as model selection. Repeated tuning on validation data can overfit those decisions. For example: Two model configurations are compared before choosing one.
Explore this concept
A useful analogy
A practice exam used to choose your study strategy.
Why it matters
This helps you prevent misleading experiments caused by data preparation and split mistakes.
Technical detail
Validation supports model selection and hyperparameter tuning. Extensive reuse can adapt development decisions to its peculiarities.
Common misconception
Validation data is not a substitute for a final untouched test set.
Start with
Related concepts
Quick recall question
Try answering before looking back at the definition.