SOURCE-LINKED INTELLIGENCE

Predict, Don't Iterate: Efficient Adaptive-Length Infilling for Diffusion Language Models

arXiv · AI, language, vision and robotics · article · Sep 2, 2026 · UTC

Diffusion language models (DLMs) have emerged as a promising alternative to the auto-regressive paradigm. With bidirectional attention and any-order generation, DLMs naturally fit infilling tasks, which require generating a middle span conditioned on both the prefix and the suffix. However, infilling is sensitive to the length of the span, while DLMs require the length to be fixed before generation. Although prior studies extend DLMs to dynamic lengths, they still suffer from two limitations. (i) Sensitivity to initial length. These methods require a preset length to initialize the search and

Read original source ↗ Open in workspace

recordType

paper

region

Global