SOURCE-LINKED INTELLIGENCE

Legible Failures: Detecting and Repairing In-Context Binding Errors

arXiv · AI, language, vision and robotics · article · Sep 10, 2026 · UTC

A wrong answer does not show whether the model lacked the needed information or held it and failed to use it. On an entity-obligation binding task, a language model can emit an incorrect prompt-supplied binding while a linear probe can recover the correct one from its frozen hidden state. We measure how often this occurs across 16 public checkpoints, each evaluated with three seeds. We fit a probe on a training fold, select its layer on a validation fold, and report results on a disjoint test fold. On the trials each model gets wrong, probe accuracy exceeds the strict present-obligation baseli

Read original source ↗ Open in workspace

recordType

paper

region

Global