GrowPage: On-Demand KV Budgeting for Efficient LLM Reasoning Serving
cs.AI
Submitted: 2026-09-03
Updated: 2026-09-03
License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
Terminology
Sources
- PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling
- Training Verifiers to Solve Math Word Problems
- Dialogue Without Limits: Constant-Sized KV Caches for Extended Responses in LLMs
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- KARA: Efficient Reasoning LLM Serving via Sliding-Window KV Cache Compression
- Measuring Mathematical Problem Solving With the MATH Dataset
- MemServe: Context Caching for Disaggregated LLM Serving with Elastic Memory Pool
- Information-Aware KV Cache Compression for Long Reasoning
- GEAR: An Efficient KV Cache Compression Recipe for Near-Lossless Generative Inference of LLM
- G-KV: Decoding-Time KV Cache Eviction with Global Attention
- KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
- LongFlow: Efficient KV Cache Compression for Reasoning Models
- Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
- Qwen3 Technical Report
- No Token Left Behind: Reliable KV Cache Compression via Importance-Aware Mixed Precision Quantization
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
- VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection