Typical Sampling

Decoding that samples tokens near the expected entropy, balancing quality and diversity.

Related terms

Top‑p (Nucleus Sampling)Temperature (Sampling)Contrastive Decoding
View on glossary index