Results for "top-k"

Search algorithm for generation that keeps top-k partial sequences; can improve likelihood but reduce diversity.

Samples from the k highest-probability tokens to limit unlikely outputs.

Samples from the smallest set of tokens whose probabilities sum to p, adapting set size by context.