Mitigating Multimodal LLMs Hallucinations via Relevance Propagation at Inference Time

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: Today's paper: "Mitigating Multimodal LLMs Hallucinations via Relevance Propagation at Inference Time".

Jane: Multimodal large language models (MLLMs) often suffer from hallucinations because textual tokens dominate generation, undermining the potential of perceptual inputs.

Tom: First, who's behind it and why it matters.

Paper summary: Tom: To continue our discussion on "Mitigating Multimodal LLMs Hallucinations via Relevance Propagation at Inference Time," let's focus specifically on the paper's thesis—what exactly is it arguing and why should we care about this approach? The core argument centers on the fact that multimodal large language models often suffer from hallucinations because textual tokens dominate generation, which undermines the value of perceptual inputs.

Jane: That’s precisely where the paper starts; they observe an inherent imbalance in how these models use different input modalities during inference, where visual or auditory tokens receive insufficient attention compared to text tokens. This imbalance forces the model to rely on textual language priors instead of grounded evidence, which is what causes the outputs to diverge from the provided perceptual inputs.

Lu: The paper tackles this by proposing LIME, a training-free framework designed specifically to bolster multimodal grounding by explicitly enhancing modality usage during decoding. It claims that this can be achieved without modifying any of the model's existing parameters, which is a big deal for deployment.

Meng: So the claim is that you can improve grounding and reduce hallucinations by intervening directly in the key-value representations during inference using this LIME method, rather than trying to fix the underlying architecture or training data? That sounds like it bypasses some of the heavy lifting involved in full model fine-tuning.

Lalam: If we can achieve better grounding this way, it suggests that MLLMs could become much more reliable tools for tasks that require understanding real-world visual or auditory context, which is crucial for building useful applications.

Tom: Exactly; the paper argues that because of this imbalance, and because they use LRP to quantify token contributions, they can define a relevance-based objective to promote increased reliance on perceptual inputs through inference-time updates. It matters because it suggests inference control is a viable path to better grounding.

Jane: So the main point is that LIME uses Layer-wise Relevance Propagation to figure out token contributions and then sets up an optimization goal that increases the explanatory contribution of multimodal tokens while constraining deviations from the original model distribution through KL divergence.

Lu: That mechanism, using M for modality and T for text, captures the overall contribution of each type of token, allowing them to steer the model's internal state toward utilizing modalities more effectively during output generation.

Meng: It sounds like a clever way to get targeted improvements without needing to overhaul the entire model structure or restart a massive training cycle from scratch. That makes it very appealing for incremental improvements in production environments.

Lalam: For Lalam, this means that if we deploy an MLLM on a complex visual task, this method could make its responses far more accurate because it won't just guess based on text patterns when there is clear visual evidence present.

Tom: Right; so to summarize the gist of "Mitigating Multimodal LLMs Hallucinations via Relevance Propagation at Inference Time," the paper proposes LIME as a training-free method that uses LRP to quantify token relevance and defines an objective to increase reliance on perceptual inputs during inference, addressing the textual dominance issue that causes hallucinations.

Jane: And it matters because it shows that controlling modality utilization at inference time is an effective strategy for improving multimodal grounding, which opens up new avenues for deploying more trustworthy AI.

Conclusion: Tom: So, wrapping up our conversation on "Mitigating Multimodal LLMs Hallucinations via Relevance Propagation at Inference Time," we have looked at how LIME addresses the problem of textual tokens dominating multimodal generation by using relevance propagation to steer inference updates toward stronger perceptual grounding. The authors are Joseph Keshet and Itai Allouche from Technion.

Jane: And the implication for us is that this work suggests a path forward where we don't necessarily need massive retraining efforts to fix hallucination issues; instead, we can introduce targeted relevance control during the inference phase itself. It shifts the focus from purely training-based fixes to inference-time behavioral modification.

Lu: From a research perspective, I think this is significant because it establishes that interpretability methods like LRP can be directly leveraged not just for post-hoc analysis but as active components in guiding model behavior during decoding, which is an interesting direction for how we study AI.

Meng: Practically speaking, the implication here is that if we want to deploy multimodal AI systems in high-stakes environments where accuracy matters, having a mechanism like LIME that can be toggled on for inference could dramatically increase our confidence in the outputs without needing continuous retraining cycles.

Lalam: For Lalam, this means that future versions of the AI I represent will be inherently more trustworthy when interacting with visual or audio data because they’ll have an internal mechanism to prioritize what's actually present in the input rather than just relying on textual probability.

Tom: That seems to be the big picture, Jane; it’s about adding a layer of control at inference time that specifically addresses the modality imbalance that causes these errors, making grounded multimodal AI more robust. We'll keep an eye on how this LIME method plays out in real-world benchmarks moving forward.