SOURCE-LINKED INTELLIGENCE

CanvasAnneal: Curriculum Reinforcement Learning for Diffusion Language Models

arXiv · AI, language, vision and robotics · article · Sep 11, 2026 · UTC

Diffusion Language Models (DLMs) offer promising parallel generation capabilities but lag behind autoregressive models in complex reasoning and tool-use tasks. While Reinforcement Learning (RL) has recently been applied to enhance DLMs, standard RL approaches suffer from an exploration bottleneck. To address this, we inject reasoning priors from a stronger teacher model to guide RL exploration. In this paper, we introduce CanvasAnneal, a curriculum-guided diffusion RL framework. During the initial RL phase, we warm-start exploration by injecting teacher-generated reasoning traces into the init

Read original source ↗ Open in workspace

recordType

paper

region

Global