Agent Observability Metrics That Matter

Robust agent observability spans reasoning trace capture, tool invocation spans, error taxonomy, and escalation pathways. Core metrics: task success rate, human intervention ratio, mean tool depth, hallucination exception frequency, cost per successful task, and latency percentile by reasoning depth.

We discourage vanity metrics (raw token count) and focus on decision quality + economic efficiency.