Flow Reasoning Models: Turning Flows Into Efficient Recurrent Reasoners
cs.AI
Submitted: 2026-06-28
Updated: 2026-09-01
License: http://creativecommons.org/licenses/by/4.0/
The gist: Structured reasoning requires making and revising interdependent decisions to reach a globally consistent solution.
Terminology
Abstract
Structured reasoning requires making and revising interdependent decisions to reach a globally consistent solution. Existing architectures struggle with this: autoregressive models commit sequentially and cannot revise earlier decisions, while masked diffusion models often require careful decoding schemes to coordinate interdependent predictions. We introduce Flow Reasoning Models (FRMs), a novel framework for structured reasoning that adapts continuous flows over discrete structured outputs with a simple recurrent refinement mechanism. By self-conditioning a flow model on its own past outputs, we turn one-shot denoising into iterative solution refinement. This lets FRMs make and revise decisions in parallel, efficiently coordinating interdependent choices across solutions. Yet conventional self-conditioning becomes unreliable at greater recurrent depth due to exposure bias between one-step training predictions and recursively generated inference states. We address this mismatch with Fixed-Point Forcing (FPF), which trains FRMs on states produced by their own inference dynamics while preserving the standard flow-matching objective. FRMs achieve solve rates of 99.5%, 100.0%, and 99.9% on Sudoku-Extreme, Zebra, and Maze-Unique, respectively. On Sudoku-Extreme, FRMs achieve higher peak accuracy than the evaluated masked-diffusion and specialized reasoning baselines while remaining highly compute-efficient, matching the next-best method's 98.7% peak solve rate with 44 times fewer inference FLOPs.
Sources
- Stochastic Interpolants: A Unifying Framework for Flows and Diffusions
- Dynamical Regimes of Diffusion Models
- Preference-Based Alignment of Discrete Diffusion Models
- Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioning
- LangFlow: Continuous Diffusion Rivals Discrete in Language Modeling
- Solve the Loop: Attractor Models for Language and Reasoning
- Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach
- ELF: Embedded Language Flows
- Scalable Best-of-N Selection for Large Language Models via Self-Certainty
- Train for the Worst, Plan for the Best: Understanding Token Ordering in Masked Diffusions
- Flow Map Language Models: One-step Language Modeling via Continuous Denoising
- Let's Verify Step by Step
- Flow Matching for Generative Modeling
- Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution
- Fixed-Point Reasoners: Stable and Adaptive Deep Looped Transformers
- It\^o maps for any-step SDEs
- Iterative Reasoning Preference Optimization
- Memorization to Generalization: Emergence of Diffusion Models from Associative Memory
- Discrete Flow Maps
- Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
- VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection