The "Curse of Knowledge" in LLM Query Simulation: Concept Provenance for Tracing Answer-Side Intrusion

arXiv:2608.25245 · cs.IR, cs.CL · Submitted 2026-08-26 · Read on arXiv

cs.IR, cs.CL

Submitted: 2026-08-26

Updated: 2026-09-17

Code: https://github.com/ChenglongMa/kcqs

Terminology

• Provenance — 43× in this paper · explained in 4 episodes
• Robustness — 8× in this paper · explained in 5 episodes
• Alignment — 3× in this paper · explained in 1 episode
• Calibration — 3× in this paper · explained in 7 episodes
• Core — 3× in this paper · explained in 2 episodes
• Data Fusion — 2× in this paper · explained in 3 episodes
• Generalizability — 2× in this paper · explained in 6 episodes
• Pairwise Comparisons — 2× in this paper · explained in 2 episodes
• Prompt Engineering — 2× in this paper · explained in 4 episodes
• Alignment Problem — 1× in this paper · explained in 1 episode
• Annotator Agreement — 1× in this paper · explained in 1 episode
• Benchmark — 1× in this paper · explained in 2 episodes
• Distribution Shift — 1× in this paper · explained in 5 episodes
• Error Taxonomy — 1× in this paper · explained in 2 episodes
• Generative AI — 1× in this paper · explained in 2 episodes
• Hidden Concept Intrusion Rate — 1× in this paper
• Human-Central Rate — 1× in this paper
• LLM-as-a-Judge — 1× in this paper · explained in 3 episodes
• Pointwise Mutual Information (PMI) — 1× in this paper · explained in 3 episodes
• Sparsity — 1× in this paper · explained in 4 episodes
• Trace — 1× in this paper · explained in 2 episodes

Sources

• Preference Leakage: A Contamination Problem in LLM-as-a-judge
• Passage Re-ranking with BERT

Related papers

• The Price of Isolation: Estimating the Ecosystem Cost of Symmetric Two-Sided A/B Testing
• SCAR: Semantic Continuity-Aware Retrieval for Efficient Context Expansion in RAG
• MixLoRA-DSI: Dynamically Expandable Mixture-of-LoRA Experts for Rehearsal-Free Generative Retrieval over Dynamic Corpora
• RRCM: Ranking-Driven Retrieval over Collaborative and Meta Memories for LLM Recommendation
• Right Family, Wrong Skill: Evaluating Risk Exposure in Agent Skill Retrieval
• UltRAG: a Universal Simple Scalable Recipe for Knowledge Graph RAG