SOURCE-LINKED INTELLIGENCE

Masked Autoregressive Speech Enhancement with Continuous Neural Audio Codec Representations

arXiv · AI, language, vision and robotics · article · Sep 3, 2026 · UTC

Most previous work on speech enhancement (SE) based on masked generative modeling relied on discrete token representations of audio signals, obtained using neural audio codecs (NACs). However, a recent study has shown that continuous latent representations of NACs can be advantageous for SE in terms of speech quality and intelligibility. In this work, we propose masked autoregressive SE (MARSE), a method for SE based on iterative decoding of masked clean speech frames using continuous NAC representations of speech. In particular, we investigate a set of different decoding policies, ceteris par

Read original source ↗ Open in workspace

recordType

paper

region

Global