Top-K
A sampling setting that limits token choice to the K most likely options.
Top-K and Top-P are often tuned together with temperature.
A sampling setting that limits token choice to the K most likely options.
Top-K and Top-P are often tuned together with temperature.