Terms  /  Measurement  /  Context Utilization Rate
09 · Measurement

Context Utilization Rate

The percentage of input context that the model actually uses for its output. Low rate = waste.

Context Utilization Rate answers a question most teams never ask: of all the tokens we send to the model, how many actually influence the output? If you send 20,000 tokens of context and the model's output is based primarily on 3,000 of them, your Context Utilization Rate is 15%. The other 85% is dead weight — tokens you paid for that the model processed but didn't meaningfully use. Low utilization is a symptom of Prompt Bloat and poor Selective Recall.

Example
A team uses an observability tool to track which parts of their context the model actually attends to. They discover that their 15,000-token system prompt has sections that are never used: a style guide for a content type they discontinued, API documentation for an endpoint they removed, and three paragraphs of personality instructions that the model ignores because they contradict the task-specific instructions. They remove the unused sections, dropping the prompt to 8,000 tokens. Output quality is unchanged — proving the removed tokens had a 0% utilization rate.

More in Measurement