Principles / The Delegation Paradox
§ Principle 09 of 23
The Delegation Paradox
The more capable an agent becomes, the more the human delegates — and the less the human can verify.
The Delegation Paradox is a structural problem, not a behavioral one. As agents become more capable, they handle more complex tasks. Complex tasks produce complex outputs. Complex outputs are harder to verify. But at the same time, the agent's track record of success builds trust, reducing the human's inclination to verify. Capability, delegation, and verification-difficulty all increase together, while verification-frequency decreases. The result: the most capable agents receive the least oversight on the hardest tasks — precisely the combination most likely to produce undetected errors.
Why it matters
The Delegation Paradox means that agent capability improvements must be matched by verification improvements. A more capable agent without more capable verification tools is not actually safer — it's more dangerous, because the failures it produces are harder to detect and the humans around it are less inclined to look for them.
In practice
When an agent becomes capable of a new task type, simultaneously develop verification tools for that task type. Don't rely on humans to verify complex output manually — build automated verification that scales with agent capability.