Transfer learning

The reuse of knowledge (model weights) learned on one task/dataset for a different but related task. GPT-1 demonstrates that language understanding transfers broadly across NLP tasks.