Law 18 · Scope & Design

Observability Precedes Autonomy

You can't grant autonomy you can't trace.

Diagram explaining Observability Precedes Autonomy

The principle

If you can't see what the agent did and why, every decision, tool call, and input, then you can't safely let it act on its own. You're not trusting it, you're hoping. Autonomy without a trace is an outage you haven't found yet, and when it breaks you'll have no way to learn why.

Why it happens

An agent run is a chain of prompts, model outputs, tool calls, and hidden state. If you do not capture that chain, you cannot explain why it acted or reproduce the failure. Structured tracing turns each model call and tool execution into a span with inputs, outputs, timing, token use, and stop reasons. OpenTelemetry now has GenAI conventions for this shape of work. The rule is practical: build the trace before you widen autonomy. Freedom you cannot inspect is freedom you cannot debug.

Watch for

In practice

You grant the agent permission to send emails and update records unattended, it does something baffling on Tuesday, and you have no trace of which tool calls or inputs led there, so you are left guessing and rolling back blind. You did not trust the agent, you hoped. Before widening autonomy, instrument every decision, tool call, input, and output with something like LangSmith or OpenTelemetry spans, so any run is reconstructable after the fact. Extend the leash only as far as your trace actually reaches.

Apply it

  1. Capture every decision, tool call, input, and output as a structured, replayable trace before granting autonomy.
  2. Record token usage, timing, and stop reasons per step so any run can be reconstructed after the fact.
  3. Expand the agent's autonomy only as far as your trace coverage actually reaches.

The takeaway

Build the trace before you grant the freedom. Make every step inspectable after the fact, then widen autonomy only as far as your visibility actually reaches.

Sources and further reading

Related laws

Get the audit kit Access the buyer edition Back to all 50 laws