MERGE: Multi-LLM Ensemble for Retrieval via Generative Enrichment

arXiv:2609.37574 · cs.IR, cs.CL · Submitted 2026-09-29 · Read on arXiv

cs.IR, cs.CL

Submitted: 2026-09-29

Updated: 2026-09-30

Terminology

• Benchmark — 16× in this paper · explained in 2 episodes
• Ablation — 7× in this paper · explained in 1 episode
• Automatic Prompt Optimization — 6× in this paper
• LLM judge — 4× in this paper · explained in 2 episodes
• Prompt Engineering — 4× in this paper · explained in 4 episodes
• Consistency — 3× in this paper · explained in 3 episodes
• Data Augmentation — 2× in this paper · explained in 7 episodes
• Hallucination — 2× in this paper · explained in 3 episodes
• Large Language Models (LLMs) — 2× in this paper · explained in 6 episodes
• Self-consistency — 2× in this paper · explained in 2 episodes
• Two-Stage Architecture — 2× in this paper · explained in 2 episodes
• Accountability — 1× in this paper · explained in 2 episodes
• Core — 1× in this paper · explained in 2 episodes
• Decode — 1× in this paper · explained in 2 episodes
• Embeddings — 1× in this paper · explained in 2 episodes
• Ensemble Learning — 1× in this paper · explained in 2 episodes
• Grounding — 1× in this paper · explained in 3 episodes
• Human-in-the-Loop — 1× in this paper · explained in 3 episodes
• In International Conference on Learning Representations — 1× in this paper
• Perplexity — 1× in this paper · explained in 3 episodes
• Steering — 1× in this paper · explained in 2 episodes
• Two-Stage Framework — 1× in this paper · explained in 2 episodes
• Verification — 1× in this paper · explained in 2 episodes

Sources

• Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution
• Mistral 7B
• More Agents Is All You Need
• Merge, Ensemble, and Cooperate! A Survey on Collaborative Strategies in the Era of Large Language Models
• Pack of LLMs: Model Fusion at Test-Time via Perplexity Optimization
• Document Expansion by Query Prediction
• RouteLLM: Learning to Route LLMs with Preference Data
• Qwen2.5 Technical Report
• A Systematic Survey of Automatic Prompt Optimization Techniques
• Llama 2: Open Foundation and Fine-Tuned Chat Models
• Large Language Models for Information Retrieval: A Survey

Related papers

• The Price of Isolation: Estimating the Ecosystem Cost of Symmetric Two-Sided A/B Testing
• SCAR: Semantic Continuity-Aware Retrieval for Efficient Context Expansion in RAG
• MixLoRA-DSI: Dynamically Expandable Mixture-of-LoRA Experts for Rehearsal-Free Generative Retrieval over Dynamic Corpora
• RRCM: Ranking-Driven Retrieval over Collaborative and Meta Memories for LLM Recommendation
• Right Family, Wrong Skill: Evaluating Risk Exposure in Agent Skill Retrieval
• UltRAG: a Universal Simple Scalable Recipe for Knowledge Graph RAG