Terms  /  Memory & State  /  Context Rot
03 · Memory & State

Context Rot

Deterioration of an agent's understanding over time due to limited memory and compaction.

Context Rot is distinct from Context Debt. Context Debt is about the quality of what you send to the model; Context Rot is about the quality of what the system retains. As conversations grow and context windows fill, systems compress, summarize, or discard older information. Each compression loses nuance. Decisions that were carefully reasoned become bare assertions. The "why" disappears, leaving only the "what." Over time, the agent's understanding becomes a degraded copy of the original — close enough to seem right, but missing the context that made it right.

Example
An agent has been working on a codebase for 200 turns. Early in the conversation, the team explained why they chose eventual consistency over strong consistency for a specific service — it was a deliberate trade-off due to latency requirements. By turn 200, the context has been compacted several times. The agent now "knows" the system uses eventual consistency but has lost the rationale. When it encounters a new feature that would benefit from strong consistency, it follows the existing pattern without question — because the reasoning behind the original decision has rotted away.

More in Memory & State