The AI Taxonomy.
Terms  /  System Transparency  /  Black Box Agency
06 · System Transparency

Black Box Agency

An agent that acts on your behalf but won't show its work. You get results with no audit trail.

Black Box Agency takes System Opacity one step further: the agent isn't just reasoning opaquely — it's acting opaquely. It's making API calls, modifying files, sending requests, and making decisions, all behind a curtain. The user sees the end state but not the steps that produced it. This is the difference between opacity in a chatbot (annoying but low-stakes) and opacity in an agent (potentially dangerous). When an agent acts on your behalf without showing its work, you're trusting a process you cannot inspect.

Example
A user tells an agent to "set up the production environment." The agent reports success 10 minutes later. But what did it actually do? Did it configure the firewall correctly? Did it set appropriate access controls? Did it use the right encryption settings? Did it leave any default passwords in place? The user has no audit trail — they'd have to manually inspect every configuration to verify. Most users won't. They'll trust the agent's report and move on, which is exactly how Black Box Agency creates risk.

More in System Transparency

System Opacity

The inability to see what an AI system knows, why it made a decision, or what it did. The default state of most AI tools today.

Decision Fog

The user can see the output but not the reasoning, trade-offs, or alternatives the model considered.

Invisible State

The system has internal state that affects behavior but is not exposed to the user.

Accountability Gap

No one — human or system — can explain why a specific output was produced.

Reasoning Visibility

The user can inspect the model's chain of thought, assumptions, and decision points.

Decision Traceability

Every output can be traced back through the reasoning, context, and data that produced it.

Open State

The system's internal state is visible and inspectable at any time. The opposite of Invisible State.

Audit Trail

A complete, immutable record of what the system did, when, why, and with what inputs.