Building a GPTLesson 4 of 11

One transformer block

Widen, bend with GELU, narrow: that is the feed-forward layer. Then assemble Norm, attention, add, Norm, feed-forward, add.

Locked

Unlock the rest of Deep Learning: from one neuron to a transformer.

  • Every lesson, every resource, unlocked instantly.
  • Track progress and pick up where you left off.
  • Free preview lessons stay readable from the outline.

From

BDT 0

Enrol now