LCoT-GV: Graph Attention Networks for Verifying Long Reasoning Chains in Large Language Models
cs.CL, cs.AI
Submitted: 2026-08-31
Updated: 2026-08-31
Comments: 6 pages without references, 2 tables, 1 algorithm, 1 figure
Code: https://github.com/ormarv/LCoT-GV
License: http://creativecommons.org/licenses/by-sa/4.0/
The gist: Large Reasoning Models produce Long Chains-of-Thought (LCoTs) which involve breaking down the problem into smaller reasoning steps before reaching the conclusion.
Terminology
Abstract
Large Reasoning Models produce Long Chains-of-Thought (LCoTs) which involve breaking down the problem into smaller reasoning steps before reaching the conclusion. However, these steps often contain contradictions, unsupported inferences, or irrelevant steps, even when the final answer is correct. We propose Long Chain-of-Thought Graph Verifier (LCoT-GV), a graph-based framework that represents LCoTs as reasoning graphs. Each node in the graph represents a reasoning step and the edges encode semantic and logical relations. A Graph Attention Network is then trained to predict chain-of-thought correctness from the reasoning graph. We construct a new graph-oriented verification dataset from multiple reasoning benchmarks for question answering in various domains. The results show that our method is competitive with the most similar approaches.
Sources
- Measuring Mathematical Problem Solving With the MATH Dataset
- ReasoningFlow: Semantic Structure of Complex Reasoning Traces
- General Purpose Verification for Chain of Thought Prompting
- Characterizing, Evaluating, and Optimizing Complex Reasoning
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering