SOURCE-LINKED INTELLIGENCE

From Visual Cues to Spoken Narration: Rethinking Audio Description

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Audio Description (AD) provides spoken narration of visual events during dialogue gaps, making movies accessible to visually impaired audiences. The problem requires determining both what (which visual event) and when (position for inserting the AD) to narrate, to achieve the best user experience. Prior work has largely reduced the problem to video captioning of pre-segmented video clips, i.e., what is largely predefined and when is ignored entirely. We propose Cue2Narrate, a two-stage pipeline that jointly predicts what and when to narrate in longer untrimmed movie clips. A dual-head audio-vi

Read original source ↗ Open in workspace

recordType

paper

region

Global