SOURCE-LINKED INTELLIGENCE

Design of the IBM Granite 5.0 TurboCTC ASR Model

arXiv · AI, language, vision and robotics · article · Sep 17, 2026 · UTC

We describe the architecture, training methodology and inference speedups of Granite 5.0 Turbo CTC, a 470 million parameter encoder-only model with an excellent speed-accuracy tradeoff. The architecture uses pyramidal temporal subsampling within Conformer blocks using strided depthwise convolutions, block-diagonal (chunk-wise) self-attention, and conditioning on intermediate predictions from the middle layer. Training highlights are the use of only publicly available data, the novel use of a Muon optimizer, and balanced data sampling. Inference speedups include replacing 1 x 1 convolutions wit

Read original source ↗ Open in workspace

recordType

paper

region

Global