ADE: Agentic Data Evolution Framework for Human-Centered Objectives
cs.CL
Submitted: 2026-08-24
Updated: 2026-08-24
Comments: accepted by EMNLP 2026
Code: https://github.com/ZeroLoss-Lab/Agentic-Data-Evolution
License: http://creativecommons.org/licenses/by/4.0/
The gist: Aligning large language models to human-centered objectives is difficult when targets are non-executable and context-dependent, limiting reliable verification and scalable supervision.
Terminology
Abstract
Aligning large language models to human-centered objectives is difficult when targets are non-executable and context-dependent, limiting reliable verification and scalable supervision. Although synthetic data expands coverage, weak verification shifts the bottleneck from generation to selection. Noisy signals destabilize iterative refinement and can cause silent regressions. We propose Agentic Data Evolution (ADE), a data-centric framework that organizes synthetic supervision as evolving data snapshots. ADE improves data snapshots through a closed-loop Observation-Variation-Selection (OVS) procedure, where a steady-state admission mechanism acts as a quality ratchet that conservatively gates updates for sustained cross-round improvement. We validate these improvements through complementary intrinsic trend tracking and extrinsic post-training evaluation. On DEV300, ADE raises the intrinsic win rate from 50% to 75.81% and the extrinsic win rate from 55.20% to 68.86%, consistent performance gains across diverse benchmarks. Blind expert evaluation further confirms this, with a 66.11% preference for evolved answers. These gains extend across post-training methods, model scales, and tasks beyond the target weakly verifiable educational objectives. Resources are available at https://github.com/ZeroLoss-Lab/Agentic-Data-Evolution.
Sources
- DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models
- Kimi K2.5: Visual Agentic Intelligence
- Developing a Tutoring Dialog Dataset to Optimize LLMs for Educational Use
- GLM-5: from Vibe Coding to Agentic Engineering
- Alignment Tipping Process: How Self-Evolution Pushes LLM Agents Off the Rails
- Towards Responsible Development of Generative AI for Education: An Evaluation-Driven Approach
- TeachLM: Post-Training LLMs for Education Using Authentic Learning Data
- Qwen2.5 Technical Report
- Code Llama: Open Foundation Models for Code
- Proximal Policy Optimization Algorithms
- DeepSeekMath-V2: Towards Self-Verifiable Mathematical Reasoning
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering