SOURCE-LINKED INTELLIGENCE

VIBE: Video Instruction-aligned Background music gEneration

arXiv · AI, language, vision and robotics · article · Aug 31, 2026 · UTC

Current video-to-music (V2M) models lack semantic control and fail to penalize instruction violations, largely due to their reliance on reconstruction objectives and the representational bottleneck of static cross-modal conditioning in Diffusion Autoregressive (DAR) architectures. To resolve this, we introduce VIBE, a novel text-and-video-to-music (T+V2M) generation model that leverages: (1) Conditioning Connection, a depth-wise cross-layer conditioning mechanism that dynamically bridges the planning and diffusion refinement heads and (2) a comprehensive reward modeling taxonomy, optimizing fo

Read original source ↗ Open in workspace

recordType

paper

region

Global