Top-p (nucleus sampling)
An alternative to temperature: the model samples only from the most probable tokens whose combined probability reaches p.
An alternative to temperature: the model samples only from the most probable tokens whose combined probability reaches p.
Methods that restrict sampling to the most likely tokens (smallest set summing to probability p, or the top k).