Dynamic Flow, Static Graph: KV Cache Reuse for Efficient LLM Serving on Mobile NPUs

arXiv:2609.34727 · cs.OS, cs.AI, cs.DB · Submitted 2026-09-28 · Read on arXiv

cs.OS, cs.AI, cs.DB

Submitted: 2026-09-28

Updated: 2026-09-28

Terminology

• KV cache — 1× in this paper · explained in 3 episodes
• KV cache reuse — 1× in this paper · explained in 2 episodes

Related papers

• MemSpec: Memory-Aware Runtime for Adaptive Draft Scheduling in Speculative Decoding on Edge Devices
• Vulcan: Instance-specialized, Verifiable Systems Heuristics Through LLM-driven Search
• Planarian: Managing Agent State with Statepoints
• VUDA: Enabling Controlled Spatial Sharing of Graphics and Compute on NVIDIA GPUs
• ActKV: Efficient LLM Agents through Action-Guided KV Cache Management
• GroupKV: Hierarchical KV Cache Management for Long-Context Diffusion LLM Inference