Back to glossary
AI GLOSSARY
Context Rot
Large Language Model (LLM) Terms
The observed degradation in an LLM's response quality and instruction-following as its input context grows longer, even when the context window is technically large enough to hold all the content. A practical argument for Context Engineering and careful curation of what is included in a prompt, rather than simply relying on a larger context window.