One neuron, then manyLesson 3 of 8
Activation: the bend that makes depth pay
ReLU blocks negatives, sigmoid squashes to a probability. Without a bend, stacked layers collapse into one straight line.
Locked
Unlock the rest of Deep Learning: from one neuron to a transformer.
- Every lesson, every resource, unlocked instantly.
- Track progress and pick up where you left off.
- Free preview lessons stay readable from the outline.