Back to glossary
AI GLOSSARY
Logit
Large Language Model (LLM) Terms
The raw, unnormalized score a language model produces for each possible next token before converting them into probabilities. Logits are transformed into probabilities using a softmax function, and can be scaled by temperature to control how peaked or spread out the resulting probability distribution is.