C-MIG: Multi-view Information Gain-based Retrieval-Augmented Generation for Clinical Diagnosis Reasoning
summary
The gist
The gist: C-MIG is a Multi-view Information Gain-based retrieval-augmented generation framework for Clinical diagnosis that estimates information gain under two complementary views to jointly guide
In short
C-MIG is a retrieval-augmented generation framework for clinical diagnosis that uses information gain to guide both document retrieval and summary refinement. It addresses reward signal loss by using two complementary views: one for cross-turn retrieval quality and one for intra-turn summarization quality, leading to state-of-the-art performance.
Key concepts
- Information Gain (IG)
- Information gain measures how much a new piece of information reduces the model's uncertainty about the correct answer. C-MIG calculates this by comparing the logit probability of the answer with and without new retrieved documents or refined summaries, providing a unified reward signal that indicates diagnostic benefit.
- Multi-View Reward Views
- C-MIG uses two distinct views to supervise reasoning: one view (C-MIG-D) assesses how much the retrieval quality improves between successive steps. The second view (C-MIG-R) assesses how much the model's summary refines its understanding of the query alone, ensuring both retrieval and refinement are rewarded.
- Frozen Reference Model
- A frozen reference model is a stable, pre-trained LLM used to score information gain. By keeping this scorer fixed, C-MIG generates reproducible rewards that are not dependent on the constantly changing policy model's performance, effectively mitigating reward drift and providing reliable feedback.
- Multi-Subquery Strategy
- This strategy decomposes complex patient questions into several smaller, focused subqueries separated by semicolons. The model retrieves the best document for each subquery and then refines its knowledge based on these focused retrievals, improving overall information coverage.
Terminology used across episodes
This episode discusses
- C-MIG: Multi-view Information Gain-based Retrieval-Augmented Generation for Clinical Diagnosis Reasoning · Paper Radio
- Baichuan 2: Open Large-scale Language Models
- HuatuoGPT-II, One-stage Training for Medical Adaption of LLMs
- Med42-v2: A Suite of Clinical LLMs
- Baichuan-M2: Scaling Medical Capability with Large Verifier System
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning
- What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Exams
- UR squared: Unify RAG and Reasoning through Reinforcement Learning · Paper Radio
- R3-RAG: Learning Step-by-Step Reasoning and Retrieval for LLMs via Reinforcement Learning
- EHR-R1: A Reasoning-Enhanced Foundational Language Model for Electronic Health Record Analysis
- Med-R cubed: Enhancing Medical Retrieval-Augmented Reasoning of LLMs via Progressive Reinforcement Learning
- RJUA-QA: A Comprehensive QA Dataset for Urology
- Qwen2.5 Technical Report
- R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learning
- Information Gain-based Policy Optimization: A Simple and Effective Approach for Multi-Turn Search Agents
- ProRAG: Process-Supervised Reinforcement Learning for Retrieval-Augmented Generation
- MMedAgent-RL: Optimizing Multi-Agent Collaboration for Multimodal Medical Reasoning
- Supervising the search process produces reliable and generalizable information-seeking agents
- R-Search: Empowering LLM Reasoning with Search via Multi-Reward Reinforcement Learning
- End-to-End Agentic RAG System Training for Traceable Diagnostic Reasoning
The paper
C-MIG: Multi-view Information Gain-based Retrieval-Augmented Generation for Clinical Diagnosis Reasoning · Read on arXiv
Yuwei Miao, Gen Li, Yunsheng Zeng, Xiandong Li, Yujin Wang, Siyu Chen, Luning Wang, Yunhao Qiao, Junfeng Wang
Baidu Inc.
Transcript
Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.
Tom: Today's paper: "C-MIG: Multi-view Information Gain-based Retrieval-Augmented Generation for Clinical Diagnosis Reasoning".
Jane: The gist:
Tom: First, who's behind it and why it matters.
Paper summary: Tom: So we've covered how this C-MIG framework uses multi-view information gain to guide both retrieval and refinement, and how that leads to better credit assignment compared to older methods. The paper focuses on getting those process rewards right without relying on brittle exact matching.
Jane: The authors of C-MIG are Yuwei Miao, Gen Li, Yunsheng Zeng, Xiandong Li, Yujin Wang, Siyu Chen, Luning Wang, Yunhao Qiao, Junfeng Wang and Jianwei Lv. They’ve shown this framework can outperform RAGRL baselines on both in-domain and out-of-domain medical sets.
Lu: What this means is that instead of just rewarding the final answer, you get a signal guiding the model to perform better retrieval planning and knowledge digestion simultaneously, which is what they call multi-view information gain.
Meng: From a deployment standpoint, if we can achieve this with only three point four percent training overhead and no inference-time cost, that makes it very appealing for production systems where resources are tight.
Lalam: The paper concludes that C-MIG provides continuous information gain rewards suited for the naming ambiguity inherent in clinical diagnosis by leveraging a frozen reference model to compute drift-resistant rewards and employing a multi-subquery strategy to improve knowledge recall coverage.
Tom: So, the main implication is that we can get more reliable signals for complex reasoning tasks in medicine by rewarding the incremental benefit of new information at both the retrieval and refinement stages.
Jane: It suggests that for clinical diagnosis, focusing on how well you plan your search and how well you refine what you find is as important as just having a good final answer.
Conclusion: Tom: So we’ve been looking at C-MIG, which is this new framework for diagnosis that uses multi-view information gain to guide both what you retrieve and how you refine your answer.
Jane: It sounds like they’ve tackled a big problem where old methods gave zero credit for important reasoning steps.
Lu: Exactly. They figured out that instead of just rewarding the final output, you need to reward the incremental benefit of each step—the retrieval and the refinement.
Meng: I’m interested in how they handled that reward signal without it becoming noisy or unstable when you actually run it on real traffic at scale.
Lalam: The core idea is using a frozen reference model to calculate information gain, which gives a stable reward without needing some teacher to check everything manually.
Tom: So the title itself, C-MIG stands for Multi-view Information Gain-based Retrieval Augmented Generation for Clinical Diagnosis Reasoning. It’s quite descriptive.
Jane: It sounds very technical, but what does that mean in plain language for someone listening who isn't a machine learning expert?
Lu: Think of it like this: they break the diagnosis process into two parts—what to search and how to summarize—and they measure how much better each step makes the final answer than the step before it.
Meng: And that means you get a reward signal for planning your search well, not just for getting lucky with a single document hit.
Tom: The results are pretty strong though. They show C-MIG beats other RAG methods on both in-domain and out-of-domain medical tests, even when the questions are totally new.
Jane: That’s significant because clinical diagnosis is so messy; you need models that generalize well beyond just the specific training data they saw.
Lalam: They even show a high correlation between how accurate the final diagnosis is and how often they find the right documents, which suggests their reward signal is actually aligned with what matters.
Tom: It seems like this moves RAG from just being a retrieval tool to being an active reasoning supervisor for complex medical tasks.
Jane: It certainly does; it’s shifting the focus from just getting the right document to ensuring the entire sequence of actions—search and summarize—is medically sound.
Lu: This approach of using those two complementary views, retrieval quality and refinement quality, seems like a solid way to supervise heterogeneous reasoning capabilities in medical contexts.
More episodes
- 2604.18344-DiffTSP: A Conditional Discrete Diffusion Model for Knowledge Graph Triple Set Prediction
- 2512.13399-Dual-Evolving Reinforcement Learning for Automated Reward Design
- 2512.22174-BitFlipScope: Scalable Fault Localization and Recovery for Bit-Flip Corruptions in LLMs
- 2601.07939-SECite: Analyzing and Summarizing Citations in Software Engineering Literature
- 2605.10337-CORTEG: Foundation Models Enable Cross-Modality Representation Transfer from Scalp to Intracranial Brain Recordings
- 2601.22449-Emergence of Physical Intelligence via Controllable Information Production
- 2602.01779-LingLanMedBench: A Unified Benchmark for Evaluating Large Language Models in Traditional Chinese Medicine
- 2602.08353-TKGB: A Comprehensive Benchmark for Temporal Knowledge Graph Forecasting
- 2603.00578-Draft-Thinking: Learning Efficient Reasoning in Long Chain-of-Thought LLMs
- 2603.06977-NePPO: Near-Potential Policy Optimization for General-Sum Multi-Agent Reinforcement Learning