Learning to Reason Efficiently with Interventional Step Credit

arXiv:2610.25876 · cs.CL, cs.LG · Submitted 2026-10-19 · Read on arXiv

cs.CL, cs.LG

Submitted: 2026-10-19

Updated: 2026-10-19

Comments: 15 pages

License: http://creativecommons.org/licenses/by/4.0/

The gist: Large reasoning models often produce lengthy chain-of-thought (CoT) traces mixing useful intermediate steps with unnecessary ones.

Abstract

Large reasoning models often produce lengthy chain-of-thought (CoT) traces mixing useful intermediate steps with unnecessary ones. Recent methods explore step-level signals such as attention mass and step entropy to identify and suppress unnecessary steps. Despite their effectiveness, such signals reflect the model's behavior at a step rather than that step's contribution to the answer. To address this, we propose the interventional step credit (ISC), which takes a causal-intervention view and assesses step importance to the reasoning through targeted parameter-level interventions. Building on ISC, we further propose IGPO, which uses ISC to guide fine-grained advantage rescaling in reinforcement learning, reducing redundant steps while preserving the important ones. Experiments across two model scales and nine benchmarks show that IGPO achieves up to 62% average token reduction and better overall performance among compared methods.

Related papers