Memory and attentionLesson 6 of 9
Word order and no peeking ahead
Without a mask, "shingara" puts 52% of its attention on words not yet written. Positions tell “Rafi pays Shumi” from the reverse.
Locked
Unlock the rest of Deep Learning: from one neuron to a transformer.
- Every lesson, every resource, unlocked instantly.
- Track progress and pick up where you left off.
- Free preview lessons stay readable from the outline.