English
Related papers

Related papers: Why Do Multi-Agent LLM Systems Fail?

200 papers

Telecom networks are rapidly growing in scale and complexity, making effective management, operation, and optimization increasingly challenging. Although Artificial Intelligence (AI) has been applied to many telecom tasks, existing models…

Artificial Intelligence · Computer Science 2025-11-04 Chenhua Shi , Bhavika Jalli , Gregor Macdonald , John Zou , Wanlu Lei , Mridul Jain , Joji Philip

Large Language Models (LLM)-based Multi-Agent Systems (MASs) have emerged as a new paradigm in software system design, increasingly demonstrating strong reasoning and collaboration capabilities. As these systems become more complex and…

Software Engineering · Computer Science 2026-03-24 Lingzhe Zhang , Tong Jia , Mingyu Wang , Weijie Hong , Chiming Duan , Minghua He , Rongqian Wang , Xi Peng , Meiling Wang , Gong Zhang , Renhai Chen , Ying Li

Large language model based multi-agent systems (MAS) have unlocked significant advancements in tackling complex problems, but their increasing capability introduces a structural fragility that makes them difficult to debug. A key obstacle…

Agentic AI systems combine LLM-based reasoning, orchestration, tool invocation, and interaction with external environments. These systems introduce faults that are difficult to characterize using existing taxonomies. To address this gap, we…

Software Engineering · Computer Science 2026-05-08 Mehil B Shah , Mohammad Mehdi Morovati , Mohammad Masudur Rahman , Foutse Khomh

Failure attribution is essential for diagnosing and improving multi-agent systems (MAS), yet existing benchmarks and methods largely assume a single deterministic root cause for each failure. In practice, MAS failures often admit multiple…

Multi-agent systems powered by large language models (LLMs) are transforming enterprise automation, yet systematic evaluation methodologies for assessing tool-use reliability remain underdeveloped. We introduce a comprehensive diagnostic…

Artificial Intelligence · Computer Science 2026-01-26 Donghao Huang , Gauri Malwe , Zhaoxia Wang

Multi-agent systems (MAS) are increasingly used for open-ended idea generation, driven by the expectation that collective interaction will broaden the exploration diversity. However, when and why such collaboration truly expands the…

Multiagent Systems · Computer Science 2026-04-22 Nuo Chen , Yicheng Tong , Yuzhe Yang , Yufei He , Xueyi Zhang , Qingyun Zou , Qian Wang , Bingsheng He

Large language model (LLM)-based multi-agent systems have demonstrated impressive capabilities in handling complex tasks. However, the complexity of agentic behaviors makes these systems difficult to understand. When failures occur,…

Human-Computer Interaction · Computer Science 2026-02-06 Rui Sheng , Yukun Yang , Chuhan Shi , Yanna Lin , Zixin Chen , Huamin Qu , Furui Cheng

Failure attribution in LLM-based multi-agent systems aims to identify the steps that contribute to a failed execution. This task remains difficult because a single execution can contain many agent actions and tool calls, failure evidence…

Software Engineering · Computer Science 2026-05-15 Yang Liu , Hongjiang Feng , Junsong Pu , Zhuangbin Chen

Multi-agent systems (MAS) leveraging the impressive capabilities of Large Language Models (LLMs) hold significant potential for tackling complex tasks. However, most current MAS depend on manually designed agent roles and communication…

Computation and Language · Computer Science 2026-03-10 Zixuan Ke , Austin Xu , Yifei Ming , Xuan-Phi Nguyen , Ryan Chin , Caiming Xiong , Shafiq Joty

Large language model-based multi-agent systems (LLM-MAS) effectively accomplish complex and dynamic tasks through inter-agent communication, but this reliance introduces substantial safety vulnerabilities. Existing attack methods targeting…

Cryptography and Security · Computer Science 2025-08-06 Bingyu Yan , Ziyi Zhou , Xiaoming Zhang , Chaozhuo Li , Ruilin Zeng , Yirui Qi , Tianbo Wang , Litian Zhang

LLM-based Multi-Agent Systems ( LLM-MAS ) have become a research hotspot since the rise of large language models (LLMs). However, with the continuous influx of new related works, the existing reviews struggle to capture them…

Computation and Language · Computer Science 2025-01-08 Shuaihang Chen , Yuanxing Liu , Wei Han , Weinan Zhang , Ting Liu

Large language model-based multi-agent systems have shown great abilities across various tasks due to the collaboration of expert agents, each focusing on a specific domain. However, the impact of clumsy or even malicious agents--those who…

Artificial Intelligence · Computer Science 2025-05-30 Jen-tse Huang , Jiaxu Zhou , Tailin Jin , Xuhui Zhou , Zixi Chen , Wenxuan Wang , Youliang Yuan , Michael R. Lyu , Maarten Sap

Failure attribution, i.e., identifying the responsible agent and decisive step of a failure, is particularly challenging in LLM-based multi-agent systems (MAS) due to their natural-language reasoning, nondeterministic outputs, and intricate…

Multiagent Systems · Computer Science 2026-04-27 Mengzhuo Chen , Junjie Wang , Fangwen Mu , Yawen Wang , Zhe Liu , Huanxiang Feng , Qing Wang

With recent advances in Large Language Models (LLMs), Agentic AI has become phenomenal in real-world applications, moving toward multiple LLM-based agents to perceive, learn, reason, and act collaboratively. These LLM-based Multi-Agent…

Artificial Intelligence · Computer Science 2025-01-14 Khanh-Tung Tran , Dung Dao , Minh-Duong Nguyen , Quoc-Viet Pham , Barry O'Sullivan , Hoang D. Nguyen

The incorporation of LLMs in multi-agent systems (MASs) has the potential to significantly improve our ability to autonomously solve complex problems. However, such systems introduce unique challenges in monitoring, interpreting, and…

Recent interest in Multi-Agent Systems of Large Language Models (MAS LLMs) has led to an increase in frameworks leveraging multiple LLMs to tackle complex tasks. However, much of this literature appropriates the terminology of MAS without…

Failures in large-scale cloud systems incur substantial financial losses, making automated Root Cause Analysis (RCA) essential for operational stability. Recent efforts leverage Large Language Model (LLM) agents to automate this task, yet…

Artificial Intelligence · Computer Science 2026-03-05 Taeyoon Kim , Woohyeok Park , Hoyeong Yun , Kyungyong Lee

LLM-based multi-agent systems (MAS) extend the capabilities of single LLMs by enabling cooperation among multiple specialized agents. However, most existing MAS frameworks rely on a single LLM to drive all agents, constraining the system's…

Artificial Intelligence · Computer Science 2025-05-23 Rui Ye , Xiangrui Liu , Qimin Wu , Xianghe Pang , Zhenfei Yin , Lei Bai , Siheng Chen

The increasing demand for software development has driven interest in automating software engineering (SE) tasks using Large Language Models (LLMs). Recent efforts extend LLMs into multi-agent systems (MAS) that emulate collaborative…

Software Engineering · Computer Science 2025-10-15 Zhenyu Mao , Jacky Keung , Fengji Zhang , Shuo Liu , Yifei Wang , Jialong Li