SOURCE-LINKED INTELLIGENCE

Private Decentralized Optimization with Noise Reduction and Bias Correction

arXiv · AI, language, vision and robotics · article · Sep 23, 2026 · UTC

Private decentralized learning is affected by sampling noise, privacy noise, and decentralized bias under heterogeneous data. We propose Private Recursive Decentralized Optimization (PRDO). PRDO uses recursive estimation with same-batch gradient differences to reduce estimation errors caused by sampling and privacy noise, while its Exact Diffusion component corrects decentralized bias arising from data heterogeneity. Our analysis establishes a nonconvex convergence bound without assuming uniformly bounded data heterogeneity across nodes. It further gives a sufficient condition under which recu

Read original source ↗ Open in workspace

recordType

paper

region

Global