SOURCE-LINKED INTELLIGENCE

Calibrating Interpretability Instruments Before Trusting Their Verdicts

arXiv · AI, language, vision and robotics · article · Sep 13, 2026 · UTC

Causal claims about large language model (LLM) internals rest on measurements. Those might include a projection, a cosine, an ablation delta, or an interchange patch among others. These measurements fail in specific, diagnosable ways that return a plausible number instead of an error, so a broken instrument can easily read as a finding. A covariance-matched null can saturate until every direction looks typical, a per-head attribution can overshoot the true residual write threefold on reordered-normalization architectures, an interchange patch can go sign-chaotic because its outcome is pinned a

Read original source ↗ Open in workspace

recordType

paper

region

Global