SOURCE-LINKED INTELLIGENCE

RACE: Scalable Statistical Estimation of Functional Consistency in LLM Neurons

arXiv · AI, language, vision and robotics · article · Aug 25, 2026 · UTC

Discovering stable neuron behavior across entire domains remains a challenge in mechanistic interpretability. Existing methods often rely on instance-level point estimates or computationally expensive procedures, which either obscure population-level variability or limit scalable domain-wide analysis. We present RACE (Residual Alignment for Consistency Estimation), a forward-pass statistical framework that evaluates the domain-wide functional consistency of Transformer neurons. Compared with gradient-based point estimates, RACE produces neuron rankings that yield more domain-specific effects u

Read original source ↗ Open in workspace

recordType

paper

region

Global