SOURCE-LINKED INTELLIGENCE

When Agent Metrics Measure Different Things: An Evidence-Grounded Audit of the Praxa AI Pipeline

arXiv · AI, language, vision and robotics · article · Sep 10, 2026 · UTC

Agent evaluations can be numerically correct while measuring a different construct from the one implied by their labels. We present a retrospective measurement audit of selected Praxa AI implementation files, historical evaluation artifacts, and operational records. A 139-case offline routing report contains 112 passes and 27 failures despite zero gating failures, because known gaps are explicitly exempted from the gate. An identifier-free export represents 8,843 tool-attempt rows: 8,395 recorded durations and 448 missing values. Of the durations, 121 equal the signed 32-bit maximum and carry

Read original source ↗ Open in workspace

recordType

paper

region

Global