SOURCE-LINKED INTELLIGENCE

Validating Hybrid-State Cache Recovery for GLM-5.3-Flash with vLLM and LMCache

arXiv · AI, language, vision and robotics · article · Sep 14, 2026 · UTC

External cache transfers can succeed while a hybrid language model resumes from an inconsistent state. We examine the full 45-layer GLM-5.3-Flash model, using the RedHatAI/ GLM-5.3-Flash-NVFP4 quantized checkpoint with vLLM and LMCache under four-way tensor parallelism. A complete-hit recovery mismatch restored state for the full prompt while the scheduler credited one fewer token. We aligned recovery through strict-prefix lookup and established a numerical comparison using shared computation corrections, matched checkpoint scheduling, and fixed per-rank kernel configurations. In a nine-length

Read original source ↗ Open in workspace

recordType

paper

region

Global