From raw model to assistantLesson 1 of 10Free preview

A base model is not an assistant

Pretraining teaches what text looks like. Fine-tune the name generator on town names and the same weights swing 0.24 nats toward them in 50 steps.