Temperature

An inference parameter controlling randomness — higher values make output more varied.

Temperature near 0 makes the model pick the most likely token nearly every time.

Related terms