Temperature rescales the logits before softmax: low values (0 to 0.3) make output focused and near-deterministic (greedy at 0), high values (0.7 to 1.0) make it more varied and creative.
Top-k keeps only the k most likely tokens, then samples from them.
Top-p (nucleus) keeps the smallest set of tokens whose cumulative probability exceeds p, adapting to how confident the model is.
Use low temperature for extraction, code and factual answers, higher for brainstorming and creative writing; tune one control at a time.
Loading…