Phase Transition for Budgeted Multi-Agent Synergy
Abstract
Multi-agent systems can improve reliability, yet under a fixed inference budget they often help, saturate, or even collapse. We develop a minimal and calibratable theory that predicts these regimes from three binding constraints of modern agent stacks: finite context windows, lossy inter-agent communication, and shared failures among similar agents. Each leaf agent is summarized by a compute-performance scaling exponent ; communication is captured by a message-length fidelity curve ; dependence is captured by an effective shared-error correlation ; and a context window imposes hard fan-in limits that make hierarchy necessary. For binary success/failure tasks with majority aggregation, we prove a sharp phase transition for deep -ary trees with correlated inputs and lossy communication: a single scalar (combining , , and fan-in ) determines whether weak signal is amplified to a nontrivial fixed point or washed out to chance. In the amplifying regime, we derive an organization exponent and show that budgeted synergy, i.e., outperforming the best single agent under the same total budget, occurs exactly when , yielding closed-form compute allocation rules and explicit budget thresholds. We further characterize saturation via a mixing depth and provide a conservative clipped predictor that remains accurate across growth and saturation. A continuous-performance warm-up gives closed-form risks for star, chain, and tree organizations, making correlation- and communication-induced floors explicit and exposing the core design trade-offs in a smooth setting. Finally, we validate the predicted phase boundaries in controlled synthetic simulations and show how the same mechanisms explain the dominant bottlenecks reported in recent large-scale matched-budget studies of LLM agent-system scaling.
Cite
@article{arxiv.2601.17311,
title = {Phase Transition for Budgeted Multi-Agent Synergy},
author = {Bang Liu and Linglong Kong and Jian Pei},
journal= {arXiv preprint arXiv:2601.17311},
year = {2026}
}
Comments
55 pages, 12 figures