Optimization · Level 2 of 5
L2 Regularization
Adding a penalty proportional to the sum of squared parameter values.
It favors smaller distributed coefficients rather than necessarily sparse ones.
Example
A regression objective penalizes large coefficients quadratically.
Listen to the definition and example
Audio transcript
L2 Regularization. Adding a penalty proportional to the sum of squared parameter values. It favors smaller distributed coefficients rather than necessarily sparse ones. For example: A regression objective penalizes large coefficients quadratically.
Explore this concept
Why it matters
This helps you understand what parameter updates are trying to improve and when they can fail.
Start with
Related concepts
Quick recall question
Try answering before looking back at the definition.