Headroom-Drift Replay: A Primitive for Principled Replay Control in GRPO
cs.LG, cs.AI, cs.CL
Submitted: 2026-09-03
Updated: 2026-09-03
Terminology
Sources
- Constitutional AI: Harmlessness from AI Feedback
- RePO: Replay-Enhanced Policy Optimization
- Entropy-Preserving Reinforcement Learning
- Agentic Reinforcement Learning with Implicit Step Rewards
- MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention
- Prioritized Experience Replay
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- EFRame: Deeper Reasoning via Exploration-Filter-Replay Reinforcement Learning Framework
- Information Gain-based Policy Optimization: A Simple and Effective Approach for Multi-Turn Search Agents
- On the Entropy Dynamics in Reinforcement Fine-Tuning of Large Language Models
- ExGRPO: Learning to Reason from Experience
- Group Sequence Policy Optimization
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: Local-Consistency Optimisation for Bayesian Neural Networks
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks