Information-Guided Frontier Decoding: Contextual Utility-Driven Commitment in dMLLMs
cs.CL
Submitted: 2026-08-27
Updated: 2026-08-27
Terminology
Sources
- $R^2$-dLLM: Accelerating Diffusion Large Language Models via Spatio-Temporal Redundancy Reduction
- Locally Confident, Globally Stuck: The Quality-Exploration Dilemma in Diffusion Language Models
- DeCoRe: Decoding by Contrasting Retrieval Heads to Mitigate Hallucinations
- LLaDA2.0: Scaling Up Diffusion Language Models to 100B
- Confidence-Based Decoding is Provably Efficient for Diffusion Language Models
- D$^{3}$ToM: Decider-Guided Dynamic Token Merging for Accelerating Diffusion MLLMs
- Mitigating Mask Prior Drift and Positional Attention Collapse in Large Diffusion Vision-Language Models
- Beyond Confidence: Adaptive and Coherent Decoding for Diffusion Language Models
- Empirical Analysis of Decoding Biases in Masked Diffusion Models
- Train for the Worst, Plan for the Best: Understanding Token Ordering in Masked Diffusions
- Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generation
- Lookahead Unmasking Elicits Accurate Decoding in Diffusion Language Models
- Diffusion Language Models Know the Answer Before Decoding
- AdaBlock-dLLM: Semantic-Aware Diffusion LLM Inference via Adaptive Block Size
- Pointer Sentinel Mixture Models
- Flexible and Efficient Grammar-Constrained Decoding
- Deferred Commitment Decoding for Diffusion Language Models
- Accelerating Diffusion Large Language Models with SlowFast Sampling: The Three Golden Principles
- Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding
- WavefrontDiffusion: Dynamic Decoding Schedule for Improved Reasoning
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering