Memory and attentionLesson 3 of 9
Query, key and value
A soft lookup table: the question “Kokhon lagbe?” matches the time key, and 66% of the answer comes from “tomorrow 8 am”.
Locked
Unlock the rest of Deep Learning: from one neuron to a transformer.
- Every lesson, every resource, unlocked instantly.
- Track progress and pick up where you left off.
- Free preview lessons stay readable from the outline.