SOURCE-LINKED INTELLIGENCE

Video DeltaNet: A Video-Native Hybrid Attention for Livestream Video Generation

arXiv · AI, language, vision and robotics · article · Sep 17, 2026 · UTC

Video diffusion models repeatedly process long spatiotemporal token sequences during denoising, making attention a major computational bottleneck. Linear attention offers an appealing alternative and has been widely adopted in recent large language models, but directly applying it to video models often fails to preserve the fine-grained interactions required for high-quality generation. We present Video DeltaNet (VDN), which combines local Softmax attention with bidirectional linear memory for long-range video context. Its linear branch introduces Video Delta Attention (VDA), which updates mem

Read original source ↗ Open in workspace

recordType

paper

region

Global