Back to glossary

AI GLOSSARY

Logit

Large Language Model (LLM) Terms

The raw, unnormalized score a language model produces for each possible next token before converting them into probabilities. Logits are transformed into probabilities using a softmax function, and can be scaled by temperature to control how peaked or spread out the resulting probability distribution is.