How a network learnsLesson 8 of 11

Dropout and weight decay

Switch off random neurons, or charge rent for big weights. On a 30-point curve, dropout 0.2 cuts the validation gap from 0.27 to 0.20.

Locked

Unlock the rest of Deep Learning: from one neuron to a transformer.

  • Every lesson, every resource, unlocked instantly.
  • Track progress and pick up where you left off.
  • Free preview lessons stay readable from the outline.

From

BDT 0

Enrol now