SOURCE-LINKED INTELLIGENCE

ZipCodec: Ultra-Low-Frame-Rate Streaming Speech Coding

arXiv · AI, language, vision and robotics · article · Sep 10, 2026 · UTC

Neural audio codecs are a fundamental component of modern speech generation systems. While recent codecs achieve increasingly low bitrates, reducing frame rate remains challenging, as each token must preserve more information while maintaining reconstruction quality. We present ZipCodec, a streaming neural speech codec operating at 6.25 Hz and 0.80 kbps with a theoretical latency of 160 ms. Our approach combines large-scale WavLM distillation with a redesigned transformer-based architecture, a scalar spherical quantizer, and a latency-aware streaming decoder. Experiments show that ZipCodec sub

Read original source ↗ Open in workspace

recordType

paper

region

Global