SOURCE-LINKED INTELLIGENCE

Tuning Collective Patterns to Alleviate Congestion in Shared AI Clusters

arXiv · AI, language, vision and robotics · article · Sep 3, 2026 · UTC

Distributed AI training involves recurring rounds of data exchange between multiple pairs of GPU nodes. Slowdown in even one flow due to congestion can cause the entire communication round to slowdown. Current approaches for evading congestion in AI clusters assume global control over the entire workload (e.g. coordinating the schedule of all jobs) or assume infrastructural support (e.g. adaptive routing in switches). They are thus ill-suited in a shared cloud setting where AI jobs belonging to one user can face external congestion from other users' jobs or background traffic beyond its own co

Read original source ↗ Open in workspace

recordType

paper

region

Global