Neural Networks · Level 2 of 5
Bias
A learned offset added to a computation independently of its current input.
A neural bias parameter differs from statistical bias or societal bias.
Example
A unit adds a constant before applying its activation.
Listen to the definition and example
Audio transcript
Bias. A learned offset added to a computation independently of its current input. A neural bias parameter differs from statistical bias or societal bias. For example: A unit adds a constant before applying its activation.
Explore this concept
A useful analogy
An adjustable starting offset before any input contribution is added.
Why it matters
This is part of the vocabulary used to read network diagrams and understand parameter updates.
Technical detail
In z = Wx + b, b shifts the affine transformation. Without b the map is linear through the origin.
Common misconception
A neural bias parameter is different from societal bias or estimator bias.
Start with
Related concepts
Quick recall question
Try answering before looking back at the definition.