Back to glossary
AI GLOSSARY
Log Probability
Large Language Model (LLM) Terms
The logarithm of the probability a model assigns to a particular token or sequence. Log probabilities are more numerically stable than raw probabilities for very unlikely sequences, and provide a direct measure of how confidently a model predicts a given output. They are used internally during decoding and are a key tool in model evaluation.