AIIC AI Intelligence Centre

SOURCE-LINKED INTELLIGENCE

Representation-based Masked Diffusion Model

arXiv · AI, language, vision and robotics · article · Sep 11, 2026 · UTC

Masked Diffusion Models (MDMs) have emerged as a compelling paradigm for language modeling, offering the capability for efficient parallel text generation. However, existing parallel sampling methods typically update multiple masked tokens independently and ignore the complex mutual dependencies among the masked tokens. This independent updating mechanism lacks global coordination and might lead to incoherent outputs. To address this limitation, we propose Representation-based Masked Diffusion Model (RMDM), a framework that leverages the text representation to explicitly encode global semantic

Read original source ↗ Open in workspace

recordType
paper
region
Global

Evidence & attribution

First collected: 2026-09-20T18:42:18.733Z. This is not the publication date.