SOURCE-LINKED INTELLIGENCE

CacheBridge: Efficient Cross-Model KV Cache Transfer

arXiv · AI, language, vision and robotics · article · Sep 1, 2026 · UTC

Sharing context between LLMs in a multi-model system requires the receiving model to prefill the shared prefix because KV caches are model-specific. Recent closed-form cross-model KV transfer, hereafter Full-Head Mapping, avoids this replay by fitting a training-free affine mapper from source to target caches. However, its full-head design maps each target KV head from every source KV head in the selected layers, making transfer quality sensitive to architectural differences and causing mapper storage and application cost to grow with layer support. To this end, we introduce CacheBridge, which

Read original source ↗ Open in workspace

recordType

paper

region

Global