SOURCE-LINKED INTELLIGENCE

The Token Before the Value Is the Key: How Hybrid Architectures Organize Induction Circuits

arXiv · AI, language, vision and robotics · article · Sep 14, 2026 · UTC

Hybrid language models can improve capability as well as efficiency, raising the question of how architectural complementarity becomes learned computation. We examine the established induction roles of Carrying predecessor information, Matching a source by content, and Copying its value. How are these position-sensitive and content-based computations allocated across heterogeneous layers? We introduce layer-type-agnostic paired probes that track Carrying and Matching through a common block-update interface. In recurrent--global and local--global hybrids, Carrying concentrates in efficient laye

Read original source ↗ Open in workspace

recordType

paper

region

Global