SOURCE-LINKED INTELLIGENCE

Locating and Steering Refusal Beyond Attention

arXiv · AI, language, vision and robotics · article · Sep 4, 2026 · UTC

Where inside a language model does refusal live, and does that place change when the architecture does? In a transformer, refusal is governed by a single direction in the residual stream, a finding that safety and interpretability tooling now depend on. State-space models (SSMs) route information through a recurrent update instead of attention, sharing no token-mixing mechanism with a transformer. Does the same safety representation survive this shift, or must it be rediscovered per architecture? It survives. A single rigid rotation, which can only reorient a space and not reshape it, aligns o

Read original source ↗ Open in workspace

recordType

paper

region

Global