English
Related papers

Related papers: Understanding Agent Scaling in LLM-Based Multi-Age…

200 papers

Recent work reports strong performance from multi-agent LLM systems (MAS), but these gains are often confounded by increased test-time computation. When computation is normalized, single-agent systems (SAS) can match or outperform MAS, yet…

Computation and Language · Computer Science 2026-04-14 Dat Tran , Douwe Kiela

Large Language Model-based multi-agent systems (MAS) have shown remarkable progress in solving complex tasks through collaborative reasoning and inter-agent critique. However, existing approaches typically treat each task in isolation,…

Computation and Language · Computer Science 2025-05-30 Yilong Li , Chen Qian , Yu Xia , Ruijie Shi , Yufan Dang , Zihao Xie , Ziming You , Weize Chen , Cheng Yang , Weichuan Liu , Ye Tian , Xuantang Xiong , Lei Han , Zhiyuan Liu , Maosong Sun

Large language models (LLMs) have enabled multi-agent systems (MAS) in which multiple agents argue, critique, and coordinate to solve complex tasks, making communication topology a first-class design choice. Yet most existing LLM-based MAS…

Artificial Intelligence · Computer Science 2025-12-23 Boxuan Wang , Zhuoyun Li , Xiaowei Huang , Yi Dong

Therapy recommendation for chronic patients with multimorbidity is challenging due to risks of treatment conflicts. Existing decision support systems face scalability limitations. Inspired by the way in which general practitioners (GP)…

Artificial Intelligence · Computer Science 2025-07-16 Yicong Wu , Ting Chen , Irit Hochberg , Zhoujian Sun , Ruth Edry , Zhengxing Huang , Mor Peleg

Multi-Agent Reinforcement Learning (MARL) has shown clear effectiveness in coordinating multiple agents across simulated benchmarks and constrained scenarios. However, its deployment in real-world multi-agent systems (MAS) remains limited,…

Artificial Intelligence · Computer Science 2025-07-15 Siyi Hu , Mohamad A Hady , Jianglin Qiao , Jimmy Cao , Mahardhika Pratama , Ryszard Kowalczyk

In complex, open, and heterogeneous environments, agents must be able to reorganize towards the most appropriate organizations to adapt unpredictable environment changes within Multi-Agent Systems (MAS). Types of reorganization can be seen…

Multiagent Systems · Computer Science 2015-08-19 Hosny Ahmed Abbas , Samir Ibrahim Shaheen , Mohammed Hussein Amin

Multi-agent systems (MAS) leveraging the impressive capabilities of Large Language Models (LLMs) hold significant potential for tackling complex tasks. However, most current MAS depend on manually designed agent roles and communication…

Computation and Language · Computer Science 2026-03-10 Zixuan Ke , Austin Xu , Yifei Ming , Xuan-Phi Nguyen , Ryan Chin , Caiming Xiong , Shafiq Joty

Telecom networks are rapidly growing in scale and complexity, making effective management, operation, and optimization increasingly challenging. Although Artificial Intelligence (AI) has been applied to many telecom tasks, existing models…

Artificial Intelligence · Computer Science 2025-11-04 Chenhua Shi , Bhavika Jalli , Gregor Macdonald , John Zou , Wanlu Lei , Mridul Jain , Joji Philip

We find that, simply via a sampling-and-voting method, the performance of large language models (LLMs) scales with the number of agents instantiated. Also, this method, termed as Agent Forest, is orthogonal to existing complicated methods…

Computation and Language · Computer Science 2024-10-14 Junyou Li , Qin Zhang , Yangbin Yu , Qiang Fu , Deheng Ye

LLM-based multi-agent systems (MAS) have demonstrated significant potential in enhancing single LLMs to address complex and diverse tasks in practical applications. Despite considerable advancements, the field lacks a unified codebase that…

Multi-Agent Systems (MAS) built on Large Language Models (LLMs) often exhibit high variance in their reasoning trajectories. Process verification, which evaluates intermediate steps in trajectories, has shown promise in general reasoning…

Artificial Intelligence · Computer Science 2026-02-04 Vishal Venkataramani , Haizhou Shi , Zixuan Ke , Austin Xu , Xiaoxiao He , Yingbo Zhou , Semih Yavuz , Hao Wang , Shafiq Joty

Large language model (LLM) multi-agent systems can scale along two distinct dimensions: by increasing the number of agents and by improving through accumulated experience over time. Although prior work has studied these dimensions…

Multiagent Systems · Computer Science 2026-04-07 Shanglin Wu , Yuyang Luo , Yueqing Liang , Kaiwen Shi , Yanfang Ye , Ali Payani , Kai Shu

LLM-based multi-agent systems (MAS) have emerged as an effective paradigm for complex and long-horizon tasks. However, in real-world tasks, MAS often exhibit various failures during execution and such failures are difficult to eliminate…

Multiagent Systems · Computer Science 2026-05-29 Zhezheng Hao , Tianfu Wang , Huanshuo Dong , Ziyan Liu , Hong Wang , Xiankun Lin , Qiang Lin , Can Wang , Hande Dong , Jiawei Chen

Multi-agent applications often execute complex tasks as multi-stage workflows, where each stage is an LLM call whose output becomes part of context for subsequent steps. Existing LLM serving systems largely assume homogeneous clusters with…

Machine Learning · Computer Science 2026-03-24 Kangqi Ni , Wenyue Hua , Xiaoxiang Shi , Jiang Guo , Shiyu Chang , Tianlong Chen

Large-language models (LLMs) have demonstrated powerful problem-solving capabilities, in particular when organized in multi-agent systems. However, the advent of such systems also raises several questions on the ability of a complex network…

Multiagent Systems · Computer Science 2025-07-14 Florian Grötschla , Luis Müller , Jan Tönshoff , Mikhail Galkin , Bryan Perozzi

Large language model (LLM)-driven multi-agent systems (MAS) are transforming how humans and AIs collaboratively generate ideas and artifacts. While existing surveys provide comprehensive overviews of MAS infrastructures, they largely…

Human-Computer Interaction · Computer Science 2025-05-28 Yi-Cheng Lin , Kang-Chieh Chen , Zhe-Yan Li , Tzu-Heng Wu , Tzu-Hsuan Wu , Kuan-Yu Chen , Hung-yi Lee , Yun-Nung Chen

This survey investigates foundational technologies essential for developing effective Large Language Model (LLM)-based multi-agent systems. Aiming to answer how best to optimize these systems for collaborative, dynamic environments, we…

Multiagent Systems · Computer Science 2025-04-04 R. M. Aratchige , W. M. K. S. Ilmini

The potential of Large Language Model (LLM) as agents has been widely acknowledged recently. Thus, there is an urgent need to quantitatively \textit{evaluate LLMs as agents} on challenging tasks in interactive environments. We present…

Multi-agent systems (MAS) increasingly solve complex tasks by orchestrating agents and tools selected from rapidly growing marketplaces. As these marketplaces expand, many candidates become functionally overlapping, making selection not…

Multiagent Systems · Computer Science 2026-02-02 Xinyuan Song , Liang Zhao

Large language model (LLM)-based multi-agent systems have demonstrated remarkable promise for tackling complex tasks by breaking them down into subtasks that are iteratively planned, executed, observed, and refined. Despite their…

Multiagent Systems · Computer Science 2025-07-15 Enhao Zhang , Erkang Zhu , Gagan Bansal , Adam Fourney , Hussein Mozannar , Jack Gerrits