SOURCE-LINKED INTELLIGENCE

Lagged Coupling: Internal Representations Become Readable Before They Become Causal

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Across the full Pythia suite (160M-12B, eight checkpoints, four task families), a linear probe can read a target variable from the residual stream as early as step 1,000 at every scale -- yet steering along that same reading direction remains null-equivalent in 43 of 48 model-checkpoint cells. Internal readability systematically outruns causal efficacy, and the lag does not shrink with scale. We call this structure lagged coupling and decompose it into three dissociable tracks: (i) internal readability, saturated (AUROC >= 0.990) from the first checkpoint everywhere; (ii) behavioral readabilit

Read original source ↗ Open in workspace

recordType

paper

region

Global