EvolveNet: Collaborative Harness Evolution for Agent Self-Improvement
Jun Nie, Yonggang Zhang, Qianshu Cai, Yiu-ming Cheung, Xinmei Tian, Bo Han
cs.LG
Submitted: 2026-08-05
Comments: 20 pages, 3 figures
Code: https://github.com/junnie00/EvolveNet
License: http://creativecommons.org/licenses/by/4.0/
The gist: The capabilities of an LLM agent depend not only on its model but on the harness: the executable program that constructs context, invokes tools, verifies results, and recovers from failure.
Terminology
Abstract
The capabilities of an LLM agent depend not only on its model but on the harness: the executable program that constructs context, invokes tools, verifies results, and recovers from failure. Recent work shows that evolving the harness yields persistent improvements without updating model weights. Existing approaches, however, assume that all execution experience can be routed to a single optimizer, which evolves one harness along a sequential trajectory. Real agent ecosystems violate that assumption: users, organizations, and environments generate isolated streams of experience that cannot be pooled, so the experience most worth learning from is exactly the experience that cannot be directly centralized. We introduce EvolveNet, a paradigm of collaborative harness evolution that moves experience extraction to the data. A shared harness is broadcast to data-local agent deployments, each of which evolves it on its own workload. Only the resulting program adaptations are composed into an updated shared harness and redistributed, so that every participating agent inherits operational experience discovered by the others. By shifting the aggregation boundary from raw workloads to learned adaptations, EvolveNet keeps workloads local and allows multiple evolutionary searches to proceed concurrently with reduced serial depth. Because independently modified programs cannot be averaged like model parameters and may conflict when composed, EvolveNet introduces scope-typed, evidence-guided program aggregation. Across five settings spanning text-to-SQL, data-science coding, competitive programming, software engineering, and agentic workflows, EvolveNet improves the shared harness in all five, with the largest gains under heterogeneous workloads, and ablations attribute the improvement to composition of adaptations from different agents rather than to selecting among them.
Sources
- MOSS: Self-Evolution through Source-Level Rewriting in Autonomous Agent Systems
- Fed-SE: Federated Self-Evolution for Privacy-Constrained Multi-Environment LLM Agents
- Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution
- EvoTest: Evolutionary Test-Time Learning for Self-Improving Agentic Systems
- Meta-Harness: End-to-End Optimization of Model Harnesses
- TTHE: Test-Time Harness Evolution
- AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
- FederatedSkill: Federated Learning for Agentic Skill Evolution
- Federation over Text: Insight Sharing for Multi-Agent Reasoning
- Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generation
- Self-Harness: Harnesses That Improve Themselves
- Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: Local-Consistency Optimisation for Bayesian Neural Networks
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks