SOURCE-LINKED INTELLIGENCE

Multi-Modal Controlled Coherent Motion Generation

arXiv · AI, language, vision and robotics · article · Sep 10, 2026 · UTC

It is natural for humans to walk and talk simultaneously. This paper tackles the challenge of replicating such natural behaviors in 3D avatar motion generation driven by concurrent multimodal inputs, such as a text description of a man walking alongside speech audio. Existing methods, constrained by the scarcity of aligned multimodal data, typically combine motions from individual modalities sequentially or through weighted sums. However, they often result in mismatched or unrealistic movements. To overcome these limitations, we propose MOCO, a novel diffusion-based framework capable of proces

Read original source ↗ Open in workspace

recordType

paper

region

Global