SOURCE-LINKED INTELLIGENCE

Principal-timestep Restricted Init via Sparse Matrix-decomposition in Flow-matching

arXiv · AI, language, vision and robotics · article · Sep 14, 2026 · UTC

Flow-matching diffusion models have recently emerged as a strong paradigm for high-fidelity visual generation. However, their prohibitively high fine-tuning cost limits scalability to downstream tasks. While Low-Rank Adaptation (LoRA) combined with spectral initialization has demonstrated accelerated convergence and improved performance in autoregressive language models by better aligning gradient directions, we find that it fails to deliver similar gains in diffusion fine-tuning, often yielding marginal or even negative improvements over vanilla LoRA.We attribute this discrepancy to a fundame

Read original source ↗ Open in workspace

recordType

paper

region

Global