Memory and attentionLesson 7 of 9
Tania’s quick-fire round: attention
Read a weight, softmax three scores, scale by √d, and say which row of the mask is closed. Keep the streak.
Locked
Unlock the rest of Deep Learning: from one neuron to a transformer.
- Every lesson, every resource, unlocked instantly.
- Track progress and pick up where you left off.
- Free preview lessons stay readable from the outline.