Emergent Abilities
Capabilities that appear when a language model reaches a certain scale, but were not present (or were very weak) in smaller versions.
Capabilities that appear when a language model reaches a certain scale, but were not present (or were very weak) in smaller versions. For example, arithmetic, code generation, and multi-step reasoning are emergent abilities of GPT-3 that GPT-1 (much smaller) couldn't do reliably.