SOURCE-LINKED INTELLIGENCE

mKernel: Fast Multi-GPU, Multi-Node Fused Kernels

arXiv · AI, language, vision and robotics · article · Sep 11, 2026 · UTC

Communication has become a bottleneck in distributed training and inference of large models. Overlapping communication with computation at the granularity of kernels, on separate streams, reduces only part of this communication cost. Fused kernels often have better performance by transmitting each output tile as soon as it is produced, but existing fused kernels are largely confined to a single NVLink domain. We present mKernel, a library of multi-GPU, multi-node fused kernels that overlap computation, intra-node NVLink communication, and inter-node RDMA at tile granularity. mKernel partitions

Read original source ↗ Open in workspace

recordType

paper

region

Global