English

Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoning

Machine Learning 2025-11-21 v1

Abstract

Large Language Model (LLM) Agents, often trained with Reinforcement Learning (RL), are constrained by a dependency on human-curated data, limiting scalability and tethering AI to human knowledge. Existing self-evolution frameworks offer an alternative but are typically restricted by the model's inherent capabilities and single-round interactions, hindering the development of complex curricula involving tool use or dynamic reasoning. We introduce Agent0, a fully autonomous framework that evolves high-performing agents without external data through multi-step co-evolution and seamless tool integration. Agent0 establishes a symbiotic competition between two agents initialized from the same base LLM: a curriculum agent that proposes increasingly challenging frontier tasks, and an executor agent that learns to solve them. We integrate external tools to enhance the executor's problem-solving capacity; this improvement, in turn, pressures the curriculum agent to construct more complex, tool-aware tasks. Through this iterative process, Agent0 establishes a self-reinforcing cycle that continuously produces high-quality curricula. Empirically, Agent0 substantially boosts reasoning capabilities, improving the Qwen3-8B-Base model by 18% on mathematical reasoning and 24% on general reasoning benchmarks. Code is available at https://github.com/aiming-lab/Agent0.

Keywords

Cite

@article{arxiv.2511.16043,
  title  = {Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoning},
  author = {Peng Xia and Kaide Zeng and Jiaqi Liu and Can Qin and Fang Wu and Yiyang Zhou and Caiming Xiong and Huaxiu Yao},
  journal= {arXiv preprint arXiv:2511.16043},
  year   = {2025}
}
R2 v1 2026-07-01T07:46:35.612Z