SOURCE-LINKED INTELLIGENCE

Align, Integrate, and Fire: Efficient Token-Level Alignment for Zero-Shot SpeechLLMs

arXiv · AI, language, vision and robotics · article · Sep 16, 2026 · UTC

While Large Language Models excel in natural language processing, efficiently extending their capabilities to spoken input remains a significant challenge. Existing methods for building SpeechLLMs often rely on computationally expensive full-model fine-tuning, or employ parameter-efficient projectors that suffer from inefficient token sequence lengths and costly full-model supervision. In this paper, we introduce Aligned Continuous Integrate-and-Fire, a highly efficient framework for zero-shot speech processing. Our method dynamically compresses continuous acoustic frames into the exact discre

Read original source ↗ Open in workspace

recordType

paper

region

Global