Back to glossary
AI GLOSSARY
Sequence Length
AI & Machine Learning
The number of tokens in a given input or output sequence. Models have hard limits on how long a sequence they can process at once, and longer sequences demand proportionally more memory and compute. Managing sequence length is a routine practical constraint when working with language models, particularly for tasks involving long documents or extended conversations.
See also: context window.