SOURCE-LINKED INTELLIGENCE

Support Topology and Gradient Mixing in Sinkhorn Layers

arXiv · AI, language, vision and robotics · article · Sep 7, 2026 · UTC

Sparse Sinkhorn layers use a fixed support graph to restrict transport between tokens. How does this graph control gradient propagation through the scaling iterations. We develop a fixed-support calculus showing that each row-column cycle induces a row-stochastic operator on column-potential perturbations modulo constants. Its transpose propagates zero-mass reverse-mode cotangents. The finite-cycle operator uses two distinct half-step transport plans; at a balanced fixed point it reduces to a two-step walk determined by a single plan. We derive the accompanying score and marginal source terms

Read original source ↗ Open in workspace

recordType

paper

region

Global