ReproAgent: Contract-Guided Paper-to-Code Reproduction

arXiv:2608.24291 · cs.AI, cs.SE · Submitted 2026-08-25 · Read on arXiv

cs.AI, cs.SE

Submitted: 2026-08-25

Updated: 2026-08-25

Code: https://github.com/kernel-14/ReproAgent

Terminology

• Ablation — 43× in this paper · explained in 1 episode
• Trace — 20× in this paper · explained in 2 episodes
• Adaptation — 15× in this paper · explained in 1 episode
• Benchmark — 10× in this paper · explained in 2 episodes
• Provenance — 10× in this paper · explained in 3 episodes
• Core — 8× in this paper · explained in 2 episodes
• Pruning — 7× in this paper · explained in 4 episodes
• Grounding — 5× in this paper · explained in 3 episodes
• Fidelity — 4× in this paper · explained in 2 episodes
• Scaffolding — 4× in this paper · explained in 3 episodes
• Verification — 3× in this paper · explained in 2 episodes
• Agentic Coding — 2× in this paper · explained in 1 episode
• Alignment — 2× in this paper · explained in 1 episode
• Fine-Tuning — 2× in this paper · explained in 5 episodes
• Mask Generation — 2× in this paper · explained in 2 episodes
• PDE residual — 2× in this paper · explained in 2 episodes
• Transferability — 2× in this paper · explained in 4 episodes
• Ablation study — 1× in this paper · explained in 1 episode
• Benchmarking — 1× in this paper · explained in 3 episodes
• Data Augmentation — 1× in this paper · explained in 7 episodes
• Fisher Information — 1× in this paper · explained in 3 episodes
• International Conference on Machine Learning — 1× in this paper
• Loss Function — 1× in this paper · explained in 2 episodes
• Multi-Agent Framework — 1× in this paper · explained in 3 episodes
• Multi-agent Collaborative Framework — 1× in this paper · explained in 2 episodes

Sources

• SciCoQA: Quality Assurance for Scientific Paper--Code Alignment
• MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering
• Toward Autonomous Long-Horizon Engineering for ML Research
• ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Models
• HiRAS: A Hierarchical Multi-Agent Framework for Paper-to-Code Generation and Execution
• GraphCodeAgent: Dual Graph-Guided LLM Agent for Retrieval-Augmented Repo-Level Code Generation
• DeepCode: Open Agentic Coding
• AutoP2C: An LLM-Based Agent Framework for Code Repository Generation from Multimodal Content in Academic Papers
• The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
• Agent Laboratory: Using LLM Agents as Research Assistants
• ML-Bench: Evaluating Large Language Models and Agents for Machine Learning Tasks on Repository-Level Code
• SciReplicate-Bench: Benchmarking LLMs in Agent-driven Algorithmic Reproduction from Research Papers
• AutoReproduce: Automatic AI Experiment Reproduction with Paper Lineage
• Reflective Paper-to-Code Reproduction Enabled by Fine-Grained Verification

Related papers

• MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
• Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
• The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
• MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
• Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
• VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection