SOURCE-LINKED INTELLIGENCE

Mizar: A 159M-Parameter Audio-Language Model for Audio Understanding

arXiv · AI, language, vision and robotics · article · Sep 23, 2026 · UTC

Audio-language models (ALMs) integrate acoustic perception with the knowledge encoded in language models, enabling contextual understanding of auditory events. Making these capabilities practical on devices with limited memory and computation motivates our focus on small ALMs with fewer than 200M parameters. We introduce a recipe that brings together architecture, data, and three-stage training to build Mizar, a 159.3M-parameter ALM. Its architecture connects a compact CED-Small audio encoder to SmolLM2-135M through a frequency-merging mapper. With supervision drawn from ReasonAQA, AudioMCQ, a

Read original source ↗ Open in workspace

recordType

paper

region

Global