Back to glossary

AI GLOSSARY

Sequence Length

AI & Machine Learning

The number of tokens in a given input or output sequence. Models have hard limits on how long a sequence they can process at once, and longer sequences demand proportionally more memory and compute. Managing sequence length is a routine practical constraint when working with language models, particularly for tasks involving long documents or extended conversations.
See also: context window.