Faithfulness Is Not Free: Auditing Offline KV-Cache Quantization in Retrieval-Augmented Generation

arXiv:2608.30996 · cs.CL · Submitted 2026-08-31 · Read on arXiv

cs.CL

Submitted: 2026-08-31

Updated: 2026-08-31

Terminology

Accuracy — 29× in this paper · explained in 1 episode
Quantization — 25× in this paper · explained in 12 episodes
RAG — 20× in this paper · explained in 3 episodes
Hallucination — 12× in this paper · explained in 3 episodes
KV cache — 12× in this paper · explained in 3 episodes
LLM judge — 9× in this paper · explained in 2 episodes
Benchmark — 4× in this paper · explained in 2 episodes
Grounding — 3× in this paper · explained in 3 episodes
Benchmarking — 2× in this paper · explained in 3 episodes
Degeneracy — 2× in this paper · explained in 3 episodes
Failure Modes — 2× in this paper · explained in 3 episodes
Ablation — 1× in this paper · explained in 1 episode
Ablation Studies — 1× in this paper · explained in 1 episode
Calibration — 1× in this paper · explained in 7 episodes
Core — 1× in this paper · explained in 2 episodes
Embeddings — 1× in this paper · explained in 2 episodes
Fidelity — 1× in this paper · explained in 2 episodes
Lahore University of Management Sciences — 1× in this paper
Multi-hop Reasoning — 1× in this paper · explained in 3 episodes
Perplexity — 1× in this paper · explained in 3 episodes
Retrieval-Augmented Generation (RAG) — 1× in this paper · explained in 16 episodes