Input transformation

Appears in 1 paper

GPT-1's technique for reformatting any NLP task's input as a flat token sequence wrapped in special tokens, allowing the unmodified pre-trained model to handle diverse task formats.

As used in Paper 10 — Improving Language Understanding by Generative Pre-Training →

GPT-1's technique for reformatting any NLP task's input as a flat token sequence wrapped in special tokens, allowing the unmodified pre-trained model to handle diverse task formats.