Event · 2020-05
Learning from examples in context
GPT-3, 175B
In-context learning: a couple of examples is enough.
GPT-3 showed that one large pretrained model could switch between tasks from an instruction and a handful of examples in its input. The weights do not change: the adaptation happens inside context, turning a general language interface into a practical way to program model behaviour.
Sources
OpenAIOpen primary source