Hierarchical Continuous Diffusion Language Models

arXiv:2610.02193 · cs.CL, cs.AI, cs.LG · Submitted 2026-10-01 · Read on arXiv

cs.CL, cs.AI, cs.LG

Submitted: 2026-10-01

Updated: 2026-10-01

Project page: https://hc-dlm.github.io

Terminology

• Diffusion Model — 24× in this paper · explained in 8 episodes
• Accuracy — 21× in this paper · explained in 1 episode
• Diffusion Models — 18× in this paper · explained in 6 episodes
• Embeddings — 11× in this paper · explained in 2 episodes
• Perplexity — 9× in this paper · explained in 3 episodes
• Transformer — 9× in this paper · explained in 2 episodes
• Ablation — 8× in this paper · explained in 1 episode
• Flow Matching — 8× in this paper · explained in 8 episodes
• Generative Model — 8× in this paper · explained in 2 episodes
• Decode — 7× in this paper · explained in 2 episodes
• Benchmark — 3× in this paper · explained in 2 episodes
• Latent Space — 3× in this paper · explained in 7 episodes
• Structured Reasoning — 3× in this paper · explained in 3 episodes
• Block Diffusion — 2× in this paper · explained in 2 episodes
• Diffusion Process — 2× in this paper · explained in 2 episodes
• Generative Modeling — 2× in this paper · explained in 3 episodes
• Hybrid Models — 2× in this paper · explained in 2 episodes
• Variational Masked Diffusion — 2× in this paper
• Ablation Studies — 1× in this paper · explained in 1 episode
• Adam — 1× in this paper · explained in 2 episodes
• Conditional Flow Matching — 1× in this paper
• Consistency — 1× in this paper · explained in 3 episodes
• Diffusion Processes — 1× in this paper · explained in 2 episodes
• Distillation — 1× in this paper · explained in 2 episodes
• Latent Diffusion Model — 1× in this paper · explained in 2 episodes
• Physical Constraints — 1× in this paper · explained in 7 episodes
• Rectified Flow — 1× in this paper · explained in 3 episodes
• Robustness — 1× in this paper · explained in 5 episodes
• Variational Bayes — 1× in this paper · explained in 2 episodes

Sources

• One Billion Word Benchmark for Measuring Progress in Statistical Language Modeling
• DiT-Air: Revisiting the Efficiency of Diffusion Model Architecture Design in Text to Image Generation
• LangFlow: Continuous Diffusion Rivals Discrete in Language Modeling
• Continuous Latent Diffusion Language Model
• Locally Coherent Parallel Decoding in Diffusion Language Models
• ELF: Embedded Language Flows
• DAPD: Dependency-Aware Parallel Decoding via Attention for Diffusion LLMs
• DiLaDiff: Distilled Latent-Augmented Diffusion for Language Modeling
• Breaking the Factorization Barrier in Diffusion Language Models
• Understanding Diffusion Models: A Unified Perspective
• How to Train Your Latent Diffusion Language Model Jointly With the Latent Space
• CANDI: Hybrid Discrete-Continuous Diffusion Models
• Dependency-Guided Parallel Decoding in Discrete Diffusion Language Models
• Latent-Augmented Discrete Diffusion Models
• CoDAR: Continuous Diffusion Language Models are More Powerful Than You Think
• Qwen3 Technical Report
• Variational Masked Diffusion Models
• A Reparameterized Discrete Diffusion Model for Text Generation

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering