Hallucination Detection in Large Language Models Using Diversion Decoding

arXiv:2607.10476 · cs.CL, cs.LG · Submitted 2026-08-19 · Read on arXiv

Basel Abdeen, S M Tahmid Siddiqui, Meah Tahmeed Ahmed, Anoop Singhal, Latifur Khan, Punya Parag Modi, Ehab Al-Shaer

cs.CL, cs.LG

Submitted: 2026-08-19

Updated: 2026-08-20

Terminology

• Hallucination — 51× in this paper · explained in 3 episodes
• Hallucination Detection — 17× in this paper · explained in 2 episodes
• Semantic Similarity — 10× in this paper · explained in 2 episodes
• Expansion Ratio — 7× in this paper
• Accuracy — 4× in this paper · explained in 1 episode
• Large Language Models (LLMs) — 4× in this paper · explained in 6 episodes
• Consistency — 2× in this paper · explained in 3 episodes
• RAG — 2× in this paper · explained in 3 episodes
• Ablation — 1× in this paper · explained in 1 episode
• Ablation Studies — 1× in this paper · explained in 1 episode
• Accountability — 1× in this paper · explained in 2 episodes
• Actor — 1× in this paper · explained in 3 episodes
• Aggregation — 1× in this paper · explained in 1 episode
• Clustering — 1× in this paper · explained in 2 episodes
• Cosine Similarity — 1× in this paper · explained in 3 episodes
• Generative AI — 1× in this paper · explained in 2 episodes
• Interpretability — 1× in this paper · explained in 15 episodes
• James Webb Space Telescope — 1× in this paper
• Quantization — 1× in this paper · explained in 12 episodes
• Retrieval-Augmented Generation (RAG) — 1× in this paper · explained in 16 episodes

Sources

• INSIDE: LLMs' Internal States Retain the Power of Hallucination Detection
• Look Before You Leap: An Exploratory Study of Uncertainty Measurement for Large Language Models
• Language Models (Mostly) Know What They Know
• Deficiency of Large Language Models in Finance: An Empirical Examination of Hallucination
• Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generation
• Teaching Models to Express Their Uncertainty in Words
• Uncertainty Estimation in Autoregressive Structured Prediction
• On Faithfulness and Factuality in Abstractive Summarization
• Llama 2: Open Foundation and Fine-Tuned Chat Models

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering