SOURCE-LINKED INTELLIGENCE

Composable CXL Memory as a Kubernetes-Native Shared Memory for LLM Serving

arXiv · AI, language, vision and robotics · article · Sep 9, 2026 · UTC

We present a Kubernetes Dynamic Resource Allocation (DRA) driver that makes composable CXL memory a schedulable cluster resource, and evaluate the resulting shared-memory tier for cross-node KV-cache reuse in LLM serving. The driver composes CXL regions on demand, materializes them as DAX devices on each participating host, and injects them into pods under a single Container Device Interface (CDI) name so that pods on different nodes access the same physical region. A shared-memory connector for vLLM/llm-d uses that region as a KV-cache tier with a slot directory embedded inside the shared med

Read original source ↗ Open in workspace

recordType

paper

region

Global