Neural Networks · Level 2 of 5
Activation
A value produced by a unit or layer after a transformation.
The word can refer to a signal, while activation function names the rule producing it.
Example
A hidden unit outputs 0.7 for one example.
Listen to the definition and example
Audio transcript
Activation. A value produced by a unit or layer after a transformation. The word can refer to a signal, while activation function names the rule producing it. For example: A hidden unit outputs 0.7 for one example.
Explore this concept
Why it matters
This is part of the vocabulary used to read network diagrams and understand parameter updates.
Start with
Related concepts
Quick recall question
Try answering before looking back at the definition.