SOURCE-LINKED INTELLIGENCE

Decoupled Self-Forcing Distillation for Streaming Talking Head Generation

arXiv · AI, language, vision and robotics · article · Sep 9, 2026 · UTC

Streaming talking-head generation produces each frame as its driving audio arrives, yet fidelity and efficiency have so far pulled in opposite directions: end-to-end methods condition a video diffusion model on audio directly and achieve high quality but only at large scale, while cheaper two-stage methods generate an intermediate motion representation and trail in fidelity. We argue the cost of the former lies in the target of fusion: the video latent is dominated by identity, appearance and background, none of which audio bears on, so coupling audio to every pixel blurs detail and wastes cap

Read original source ↗ Open in workspace

recordType

paper

region

Global