SOURCE-LINKED INTELLIGENCE

The Attention Within: Consensus Dynamics in Selective State Space Models

arXiv · AI, language, vision and robotics · article · Sep 16, 2026 · UTC

Selective state space models (SSMs) have recently emerged as a compelling alternative to transformers, combining competitive performance with substantially improved inference efficiency. At each SSM layer, a sequence of hidden states are propagated by a recurrence, mixing information of different tokens. Despite using a different mechanism, this mixing plays a role analogous to attention in transformers. In fact, recent works have shown that the two architectures may be closer than they first appear, as this recurrence admits a formulation akin to linear attention. In transformers, attention i

Read original source ↗ Open in workspace

recordType

paper

region

Global