English
Related papers

Related papers: Diversity Collapse in Multi-Agent LLM Systems: Str…

200 papers

Recent interest in Multi-Agent Systems of Large Language Models (MAS LLMs) has led to an increase in frameworks leveraging multiple LLMs to tackle complex tasks. However, much of this literature appropriates the terminology of MAS without…

Large language model(LLM)-driven multi-agent systems(MAS) coordinate specialized agents through predefined interaction topologies and have shown promise for complex tasks such as competition-level code generation. Recent studies demonstrate…

Multiagent Systems · Computer Science 2026-02-20 Siyu Wang , Ruotian Lu , Zhihao Yang , Yuchao Wang , Yanzhou Zhang , Lei Xu , Qimin Xu , Guojun Yin , Cailian Chen , Xinping Guan

The rise of Agent AI and Large Language Model-powered Multi-Agent Systems (LLM-MAS) has underscored the need for responsible and dependable system operation. Tools like LangChain and Retrieval-Augmented Generation have expanded LLM…

Multiagent Systems · Computer Science 2025-02-05 Jinwei Hu , Yi Dong , Shuang Ao , Zhuoyun Li , Boxuan Wang , Lokesh Singh , Guangliang Cheng , Sarvapali D. Ramchurn , Xiaowei Huang

While AI agents show potential in scientific ideation, most existing frameworks rely on single-agent refinement, limiting creativity due to bounded knowledge and perspective. Inspired by real-world research dynamics, this paper investigates…

Computation and Language · Computer Science 2025-08-07 Nuo Chen , Yicheng Tong , Jiaying Wu , Minh Duc Duong , Qian Wang , Qingyun Zou , Bryan Hooi , Bingsheng He

Large language models (LLMs) often display sycophancy, a tendency toward excessive agreeability. This behavior poses significant challenges for multi-agent debating systems (MADS) that rely on productive disagreement to refine arguments and…

Computation and Language · Computer Science 2025-09-30 Binwei Yao , Chao Shang , Wanyu Du , Jianfeng He , Ruixue Lian , Yi Zhang , Hang Su , Sandesh Swamy , Yanjun Qi

Bias in large language models (LLMs) remains a persistent challenge, manifesting in stereotyping and unfair treatment across social groups. While prior research has primarily focused on individual models, the rise of multi-agent systems…

Multiagent Systems · Computer Science 2025-10-14 Thi-Nhung Nguyen , Linhao Luo , Thuy-Trang Vu , Dinh Phung

Multi-agent collaboration has emerged as a pivotal paradigm for addressing complex, distributed tasks in large language model (LLM)-driven applications. While prior research has focused on high-level architectural frameworks, the granular…

Multiagent Systems · Computer Science 2025-05-20 Haochun Wang , Sendong Zhao , Jingbo Wang , Zewen Qiang , Bing Qin , Ting Liu

This paper explores the integration of advanced Multi-Agent Systems (MAS) techniques to develop a team of agents with enhanced logical reasoning, long-term knowledge retention, and Theory of Mind (ToM) capabilities. By uniting these core…

Multiagent Systems · Computer Science 2025-07-04 Adam Kostka , Jarosław A. Chudziak

Large Language Models (LLMs) are increasingly instantiated as interacting agents in multi-agent systems (MAS), where collective decisions emerge through social interaction rather than independent reasoning. A fundamental yet underexplored…

Multiagent Systems · Computer Science 2026-01-12 Chen Han , Jin Tan , Bohan Yu , Wenzhen Zheng , Xijin Tang

Large language models are increasingly deployed in multi-agent systems to overcome context limitations by distributing information across agents. Yet whether agents can reliably compute with distributed information, rather than merely…

Multiagent Systems · Computer Science 2026-04-15 Yuzhe Zhang , Feiran Liu , Yi Shan , Xinyi Huang , Xin Yang , Yueqi Zhu , Xuxin Cheng , Cao Liu , Ke Zeng , Terry Jingchen Zhang , Wenyuan Jiang

LLM-based multi-agent systems (MAS) have shown significant potential in tackling diverse tasks. However, to design effective MAS, existing approaches heavily rely on manual configurations or multiple calls of advanced LLMs, resulting in…

Computation and Language · Computer Science 2025-03-06 Rui Ye , Shuo Tang , Rui Ge , Yaxin Du , Zhenfei Yin , Siheng Chen , Jing Shao

LLM-based agents are increasingly deployed in multi-agent systems (MAS). As these systems move toward real-world applications, their security becomes paramount. Existing research largely evaluates single-agent security, leaving a critical…

Multiagent Systems · Computer Science 2025-11-17 Nirmit Arora , Sathvik Joel , Ishan Kavathekar , Palak , Rohan Gandhi , Yash Pandya , Tanuja Ganu , Aditya Kanade , Akshay Nambi

Multi-agent LLM committees replicate the same model under different role prompts and aggregate outputs by majority vote, implicitly assuming that agents contribute complementary evidence. We embed each agent's chain-of-thought rationale and…

Machine Learning · Computer Science 2026-04-07 Dipkumar Patel

Multi-agent systems (MAS) have emerged as a promising paradigm for solving complex tasks. Recent work has explored self-evolving MAS that automatically optimize agent capabilities or communication topologies. However, existing methods…

Computation and Language · Computer Science 2026-05-12 Chen Xu , Yicheng Hu , Ruizi Wang , Xinyu Lin , Wenjie Wang , Dongrui Liu , Fuli Feng

A large amount of work has been done in Multi-Agent Systems (MAS) for modeling and solving problems with multiple interacting agents. However, most LLMs are pretrained independently and not specifically optimized for coordination. Existing…

Artificial Intelligence · Computer Science 2025-12-10 Shuo Liu , Tianle Chen , Zeyu Liang , Xueguang Lyu , Christopher Amato

Multi-agent systems built on large language models (LLMs) are expected to enhance decision-making by pooling distributed information, yet systematically evaluating this capability has remained challenging. We introduce HiddenBench, a…

Computation and Language · Computer Science 2026-05-14 Yuxuan Li , Aoi Naito , Hirokazu Shirado

LLM-based multi-agent systems (MAS) extend the capabilities of single LLMs by enabling cooperation among multiple specialized agents. However, most existing MAS frameworks rely on a single LLM to drive all agents, constraining the system's…

Artificial Intelligence · Computer Science 2025-05-23 Rui Ye , Xiangrui Liu , Qimin Wu , Xianghe Pang , Zhenfei Yin , Lei Bai , Siheng Chen

Remarkable performance of large language models (LLMs) in a variety of tasks brings forth many opportunities as well as challenges of utilizing them in production settings. Towards practical adoption of LLMs, multi-agent systems hold great…

Computation and Language · Computer Science 2024-02-05 Pouya Pezeshkpour , Eser Kandogan , Nikita Bhutani , Sajjadur Rahman , Tom Mitchell , Estevam Hruschka

Multi-agent large language model (LLM) architectures increasingly rely on response-level aggregation, such as Majority Voting (MAJ), to raise reasoning ceilings. However, in open environments, agents are highly susceptible to stealthy…

Computation and Language · Computer Science 2026-04-21 Jiayuan Liu , Shiyi Du , Weihua Du , Mingyu Guo , Vincent Conitzer

Recent work reports strong performance from multi-agent LLM systems (MAS), but these gains are often confounded by increased test-time computation. When computation is normalized, single-agent systems (SAS) can match or outperform MAS, yet…

Computation and Language · Computer Science 2026-04-14 Dat Tran , Douwe Kiela