Beyond Quantity: Trajectory Diversity Scaling for Code Agents
Abstract
As code large language models (LLMs) evolve into tool-interactive agents via the Model Context Protocol (MCP), their generalization is increasingly limited by low-quality synthetic data and the diminishing returns of quantity scaling. Moreover, quantity-centric scaling exhibits an early bottleneck that underutilizes trajectory data. We propose TDScaling, a Trajectory Diversity Scaling-based data synthesis framework for code agents that scales performance through diversity rather than raw volume. Under a fixed training budget, increasing trajectory diversity yields larger gains than adding more trajectories, improving the performance-cost trade-off for agent training. TDScaling integrates four innovations: (1) a Business Cluster mechanism that captures real-service logical dependencies; (2) a blueprint-driven multi-agent paradigm that enforces trajectory coherence; (3) an adaptive evolution mechanism that steers synthesis toward long-tail scenarios using Domain Entropy, Reasoning Mode Entropy, and Cumulative Action Complexity to prevent mode collapse; and (4) a sandboxed code tool that mitigates catastrophic forgetting of intrinsic coding capabilities. Experiments on general tool-use benchmarks (BFCL, tau^2-Bench) and code agent tasks (RebenchT, CodeCI, BIRD) demonstrate a win-win outcome: TDScaling improves both tool-use generalization and inherent coding proficiency. We plan to release the full codebase and the synthesized dataset (including 30,000+ tool clusters) upon publication.
Keywords
Cite
@article{arxiv.2602.03219,
title = {Beyond Quantity: Trajectory Diversity Scaling for Code Agents},
author = {Guhong Chen and Chenghao Sun and Cheng Fu and Qiyao Wang and Zhihong Huang and Chaopeng Wei and Guangxu Chen and Feiteng Fang and Ahmadreza Argha and Bing Zhao and Xander Xu and Qi Han and Hamid Alinejad-Rokny and Qiang Qu and Binhua Li and Shiwen Ni and Min Yang and Hu Wei and Yongbin Li},
journal= {arXiv preprint arXiv:2602.03219},
year = {2026}
}