SOURCE-LINKED INTELLIGENCE

Recency Forcing: Bridging the Long-Horizon Gap in Autoregressive Video Generation

arXiv · AI, language, vision and robotics · article · Sep 17, 2026 · UTC

Autoregressive (AR) video generation degrades over long horizons due to an overlooked train-inference discrepancy we term KV eviction mismatch: models train on short clips where all context frames reside in the KV cache, but at inference, memory constraints force distant frames to be evicted from the KV cache - removing context the model was conditioned on. Rather than simulating eviction via context truncation - which discards temporal information the model still needs and degrades motion coherence - we keep the context but while progressively reducing the influence of distant frames, making

Read original source ↗ Open in workspace

recordType

paper

region

Global