Vision Is Not Overhead: One-Pass Block Drafting for Lossless Speculative Decoding in Vision-Language Models
cs.AI, cs.CL, cs.CV
Submitted: 2026-08-31
Updated: 2026-10-06
Code: https://github.com/js-lee-AI/GLANCE
Terminology
Sources
- AdaEDL: Early Draft Stopping for Speculative Decoding of Large Language Models via an Entropy-based Lower Bound on Token Acceptance Probability
- Hydra: Sequentially-Dependent Draft Heads for Medusa Decoding
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models
- Qwen2.5-VL Technical Report
- Accelerating Large Language Model Decoding with Speculative Sampling
- ALLaVA: Harnessing GPT4V-Synthesized Data for Lite Vision-Language Models
- DFlash: Block Diffusion for Flash Speculative Decoding
- Sequoia: Scalable, Robust, and Hardware-aware Speculative Decoding
- DEER: Draft with Diffusion, Verify with Autoregressive Models
- Speculative Diffusion Decoding: Accelerating Language Generation through Diffusion
- Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
- On Speculative Decoding for Multimodal Large Language Models
- MASSV: Multimodal Adaptation and Self-Data Distillation for Speculative Decoding of Vision-Language Models
- DREAM: Drafting with Refined Target Features and Entropy-Adaptive Cross-Attention Fusion for Multimodal Speculative Decoding
- SpecVLM: Fast Speculative Decoding in Vision-Language Models
- SpecDec++: Boosting Speculative Decoding via Adaptive Candidate Lengths
- ViSpec: Accelerating Vision-Language Models with Vision-Aware Speculative Decoding
- DiffuSpec: Unlocking Diffusion Language Models for Speculative Decoding
- EAGLE-3: Scaling up Inference Acceleration of Large Language Models via Training-Time Test
- Acceptance Dynamics Across Cognitive Domains in Speculative Decoding
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
- VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection