Top-p

Raw model outputs before converting to probabilities; manipulated during decoding and calibration.

Converts logits to probabilities by exponentiation and normalization; common in classification and LMs.

System for running consistent evaluations across tasks, versions, prompts, and model settings.

Inputs crafted to cause model errors or unsafe behavior, often imperceptible in vision or subtle in text.

Search algorithm for generation that keeps top-k partial sequences; can improve likelihood but reduce diversity.

Stochastic generation strategies that trade determinism for diversity; key knobs include temperature and nucleus samp...

Scales logits before sampling; higher increases randomness/diversity, lower increases determinism.

Samples from the k highest-probability tokens to limit unlikely outputs.