Back to section
Event · 2020-05

Learning from examples in context

GPT-3, 175B

In-context learning: a couple of examples is enough.

GPT-3 showed that one large pretrained model could switch between tasks from an instruction and a handful of examples in its input. The weights do not change: the adaptation happens inside context, turning a general language interface into a practical way to program model behaviour.

Sources
OpenAIOpen primary source