Learned Relay Representations for Forward-Thinking Discrete Diffusion Models
cs.LG
Submitted: 2026-05-21
Updated: 2026-08-28
Code: https://github.com/timvink/sudoku-solver
Terminology
Sources
- A Continuous Time Framework for Discrete Denoising Models
- Simple and Effective Masked Diffusion Language Models
- Simplified and Generalized Masked Diffusion for Discrete Data
- Can Looped Transformers Learn to Implement Multi-step Gradient Descent for In-context Learning?
- Reasoning with Latent Thoughts: On the Power of Looped Transformers
- Chain of Thought Empowers Transformers to Solve Inherently Serial Problems
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models
- Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding
- Fast-dLLM v2: Efficient Block-Diffusion LLM
- Masked Diffusion Models are Secretly Time-Agnostic Masked Models and Exploit Inaccurate Categorical Sampling
- Large Language Diffusion Models
- Train for the Worst, Plan for the Best: Understanding Token Ordering in Masked Diffusions
- Stop Training for the Worst: Progressive Unmasking Accelerates Masked Diffusion Training
- Hierarchical Reasoning Model
- Qwen2.5 Technical Report
- Llama-Nemotron: Efficient Reasoning Models
- Denoising Diffusion Probabilistic Models
- Score-Based Generative Modeling through Stochastic Differential Equations
- Dream 7B: Diffusion Large Language Models
- Loopholing Discrete Diffusion: Deterministic Bypass of the Sampling Wall
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: Local-Consistency Optimisation for Bayesian Neural Networks
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks