AI Vocabulary · 07 When It Goes Wrong
What is Context Rot?
The gradual drop in answer quality as a conversation or context grows long and cluttered.
Context rot describes what many people notice in long AI sessions: the model starts strong, then gets sloppier. It forgets instructions given earlier, repeats corrected mistakes, mixes up details or drifts from the documents you provided. Nothing about the model changed; the context did.
Even well within the context window, a longer and messier context makes it harder for the model to give weight to what matters. Old attempts, irrelevant tool output and outdated instructions all compete with the current task.
Why it matters for you
If you push through a degraded session by repeating instructions, you usually make it worse. Recognising context rot saves time and avoids subtle errors in the final result.
Own it
Keep sessions focused: one task per conversation, start fresh when quality drops, and carry over only a short summary of decisions. Keep standing instructions in project instructions or your knowledge base rather than deep inside a chat history.
Where it comes from
The phrase spread among developers in 2025 as context windows grew huge but quality still dropped in long sessions. It became widely known through Chroma's July 2025 report Context Rot, which tested 18 models and found that performance grows less reliable as input gets longer, even on simple tasks. There is no single documented coiner.
Related
Your AI Learning Hub
Learn the whole AI Vocabulary, step by step, and build with it. Build it. Own it.