AdaGEPA: Adaptive Feedback Allocation for Reflective Prompt Optimization

arXiv:2609.39927 · cs.CL · Submitted 2026-09-30 · Read on arXiv

cs.CL

Submitted: 2026-09-30

Updated: 2026-09-30

Terminology

• AUC — 40× in this paper · explained in 2 episodes
• Verifier — 18× in this paper · explained in 2 episodes
• Benchmark — 13× in this paper · explained in 2 episodes
• APEX — 11× in this paper · explained in 1 episode
• Ablation — 6× in this paper · explained in 1 episode
• Aggregation — 5× in this paper · explained in 1 episode
• Alignment — 5× in this paper · explained in 1 episode
• Trace — 5× in this paper · explained in 2 episodes
• Accuracy — 3× in this paper · explained in 1 episode
• Frozen model — 3× in this paper · explained in 3 episodes
• Schema-Guided Dialogue — 3× in this paper
• Verification — 3× in this paper · explained in 2 episodes
• Downstream Tasks — 2× in this paper · explained in 2 episodes
• Reinforcement Learning — 2× in this paper · explained in 4 episodes
• Ablation Studies — 1× in this paper · explained in 1 episode
• Generative AI — 1× in this paper · explained in 2 episodes
• Prompt Engineering — 1× in this paper · explained in 4 episodes
• Pruning — 1× in this paper · explained in 4 episodes
• Reasoning Traces — 1× in this paper · explained in 3 episodes
• Self-Evolving Agents — 1× in this paper · explained in 2 episodes

Sources

• GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning
• Learning to Self-Evolve
• Beyond Benchmarks: MathArena as an Evaluation Platform for Mathematics with LLMs
• Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution
• EvoPrompt: Connecting LLMs with Evolutionary Algorithms Yields Powerful Prompt Optimizers
• The Optimizer Is the Agent: Reasoning-Driven Search across Prompts, Programs, and ML Workflows
• Submodular Evaluation Subset Selection in Automatic Prompt Optimization
• RLMOpt: Adaptive Prompt Optimization via Recursive Language Models
• APEX: Automated Prompt Engineering eXpert with Dynamic Data Selection
• DIVE: Unlocking Self-Improvement in Frozen Language Models Through Diversity-Driven Skill Evolution
• Rethinking Self-Evolving Agents: Do We Still Need Prescribed Optimization Pipelines?
• Large Language Models as Optimizers
• Gradient Surgery for Multi-Task Learning
• TextGrad: Automatic "Differentiation" via Text

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering