English
Related papers

Related papers: Diversity Collapse in Multi-Agent LLM Systems: Str…

200 papers

Large language models, employed as multiple agents that interact and collaborate with each other, have excelled at solving complex tasks. The agents are programmed with prompts that declare their functionality, along with the topologies…

Machine Learning · Computer Science 2026-02-03 Han Zhou , Xingchen Wan , Ruoxi Sun , Hamid Palangi , Shariq Iqbal , Ivan Vulić , Anna Korhonen , Sercan Ö. Arık

A multi-agent AI system (MAS) is composed of multiple autonomous agents that interact, exchange information, and make decisions based on internal generative models. Recent advances in large language models and tool-using agents have made…

Large language models (LLMs) have achieved impressive results in natural language understanding, yet their reasoning capabilities remain limited when operating as single agents. Multi-Agent Debate (MAD) has been proposed to address this…

Computation and Language · Computer Science 2026-03-25 Xiao Wang , Jia Wang , Yijie Wang , Pengtao Dang , Sha Cao , Chi Zhang

Multi-agent systems (MAS) decompose complex tasks and delegate subtasks to different large language model (LLM) agents and tools. Prior studies have reported the superior accuracy performance of MAS across diverse domains, enabled by…

Multiagent Systems · Computer Science 2025-05-27 Mingyan Gao , Yanzi Li , Banruo Liu , Yifan Yu , Phillip Wang , Ching-Yu Lin , Fan Lai

Large language models (LLMs) have enabled multi-agent systems (MAS) in which multiple agents argue, critique, and coordinate to solve complex tasks, making communication topology a first-class design choice. Yet most existing LLM-based MAS…

Artificial Intelligence · Computer Science 2025-12-23 Boxuan Wang , Zhuoyun Li , Xiaowei Huang , Yi Dong

Multi-agent systems (MASs) have emerged as a promising paradigm for automated code generation, demonstrating impressive performance on established benchmarks. Despite their prosperous development, the fundamental mechanisms underlying their…

Software Engineering · Computer Science 2026-02-02 Zongyi Lyu , Songqiang Chen , Zhenlan Ji , Liwen Wang , Shuai Wang , Daoyuan Wu , Wenxuan Wang , Shing-Chi Cheung

While Multi-Agent Systems (MAS) are increasingly deployed for complex workflows, their emergent properties-particularly the accumulation of bias-remain poorly understood. Because real-world MAS are too complex to analyze entirely,…

Multiagent Systems · Computer Science 2026-04-14 Keyu Li , Jin Gao , Dequan Wang

Large language models (LLMs) have proven effective in artificial intelligence, where the multi-agent system (MAS) holds considerable promise for healthcare development by achieving the collaboration of LLMs. However, the absence of a…

Artificial Intelligence · Computer Science 2026-05-13 Zhihao Peng , Liuxin Bao , Yixuan Yuan

While Visual Multi-Agent Systems (VMAS) promise to enhance comprehensive abilities through inter-agent collaboration, empirical evidence reveals a counter-intuitive "scaling wall": increasing agent turns often degrades performance while…

Artificial Intelligence · Computer Science 2026-02-03 Xinlei Yu , Chengming Xu , Zhangquan Chen , Bo Yin , Cheng Yang , Yongbo He , Yihao Hu , Jiangning Zhang , Cheng Tan , Xiaobin Hu , Shuicheng Yan

Large Language Model-based Multi-Agent Systems (MASs) have emerged as a powerful paradigm for tackling complex tasks through collaborative intelligence. However, the topology of these systems--how agents in MASs should be configured,…

Multiagent Systems · Computer Science 2025-10-20 Jiaxi Yang , Mengqi Zhang , Yiqiao Jin , Hao Chen , Qingsong Wen , Lu Lin , Yi He , Srijan Kumar , Weijie Xu , James Evans , Jindong Wang

Multi-agent systems (MAS) assume that collaborating inherently improves Large Language Model (LLM) reasoning. We challenge this by demonstrating that simulated social pressure triggers an algorithmic ``Bystander Effect,'' inducing severe…

Multiagent Systems · Computer Science 2026-05-12 Dahlia Shehata , Ming Li

LLM-based multi-agent systems (MAS) have emerged as an effective paradigm for complex and long-horizon tasks. However, in real-world tasks, MAS often exhibit various failures during execution and such failures are difficult to eliminate…

Multiagent Systems · Computer Science 2026-05-29 Zhezheng Hao , Tianfu Wang , Huanshuo Dong , Ziyan Liu , Hong Wang , Xiankun Lin , Qiang Lin , Can Wang , Hande Dong , Jiawei Chen

Consensus formation is pivotal in multi-agent systems (MAS), balancing collective coherence with individual diversity. Conventional LLM-based MAS primarily rely on explicit coordination, e.g., prompts or voting, risking premature…

Multiagent Systems · Computer Science 2025-05-20 Zengqing Wu , Takayuki Ito

Large Language Models (LLMs) are increasingly deployed as reasoning systems, where reasoning paradigms - such as Chain-of-Thought (CoT) and multi-agent systems (MAS) - play a critical role, yet their relative effectiveness and cost-accuracy…

Machine Learning · Computer Science 2026-01-21 Yapeng Li , Jiakuo Yu , Zhixin Liu , Xinnan Liu , Jing Yu , Songze Li , Tonghua Su

Multi-agent systems (MAS) composed of large language models often exhibit improved problem-solving performance despite operating on identical information. In this work, we provide a formal explanation for this phenomenon grounded in…

Computation and Language · Computer Science 2026-01-22 Christopher Scofield

Multi-agent systems powered by large language models exhibit strong capabilities in collaborative problem-solving. However, these systems suffer from substantial knowledge redundancy. Agents duplicate efforts in retrieval and reasoning…

Graphics · Computer Science 2026-02-27 Heng Zhang , Yuling Shi , Xiaodong Gu , Haochen You , Zijian Zhang , Lubin Gan , Yilei Yuan , Jin Huang

Multi-agent systems (MAS) built on large language models promise improved problem-solving through collaboration, yet they often fail to consistently outperform strong single-agent baselines due to error propagation at inter-agent message…

Artificial Intelligence · Computer Science 2026-01-21 Bohan Lin , Kuo Yang , Zelin Tan , Yingchuan Lai , Chen Zhang , Guibin Zhang , Xinlei Yu , Miao Yu , Xu Wang , Yudong Zhang , Yang Wang

Recent advancements in Large Language Models (LLMs) and autonomous agents have demonstrated remarkable capabilities across various domains. However, standalone agents frequently encounter limitations when handling complex tasks that demand…

Computation and Language · Computer Science 2025-05-29 Rennai Qiu , Chen Qian , Ran Li , Yufan Dang , Weize Chen , Cheng Yang , Yingli Zhang , Ye Tian , Xuantang Xiong , Lei Han , Zhiyuan Liu , Maosong Sun

In this paper, we propose to incorporate the blackboard architecture into LLM multi-agent systems (MASs) so that (1) agents with various roles can share all the information and others' messages during the whole problem-solving process, (2)…

Multiagent Systems · Computer Science 2025-07-03 Bochen Han , Songmao Zhang

Multi-agent coordination studies the underlying mechanism enabling the trending spread of diverse multi-agent systems (MAS) and has received increasing attention, driven by the expansion of emerging applications and rapid AI advances. This…

Multiagent Systems · Computer Science 2025-02-24 Lijun Sun , Yijun Yang , Qiqi Duan , Yuhui Shi , Chao Lyu , Yu-Cheng Chang , Chin-Teng Lin , Yang Shen