English
Related papers

Related papers: Agents that Matter: Optimizing Multi-Agent LLMs vi…

200 papers

Recent advances in LLM Multi-Agent Systems enable scalable orchestration of sub-agents, each coordinating hundreds or thousands of tools or Model Context Protocol (MCP) servers. However, existing retrieval methods typically match queries…

Computation and Language · Computer Science 2025-11-05 Elias Lumer , Faheem Nizar , Anmol Gulati , Pradeep Honaganahalli Basavaraju , Vamse Kumar Subbiah

Large language model (LLM)-powered multi-agent systems (MAS) demonstrate remarkable collective intelligence, wherein multi-agent memory serves as a pivotal mechanism for continual adaptation. However, existing multi-agent memory designs…

Computation and Language · Computer Science 2026-03-10 Muxin Fu , Xiangyuan Xue , Yafu Li , Zefeng He , Siyuan Huang , Xiaoye Qu , Yu Cheng , Yang Yang

Multi-agent large language model (LLM) systems have shown promise for solving complex tasks through agent collaboration. However, existing frameworks assign tasks based on predefined roles without considering whether an agent can accurately…

Artificial Intelligence · Computer Science 2026-05-19 Chenyu Wang , Yang Shu

Large language models (LLMs) have demonstrated remarkable capabilities across diverse tasks, and LLM-based agents further extend these abilities to various practical workflows. While recent progress shows that multi-agent systems (MAS) can…

Computation and Language · Computer Science 2025-10-10 Zheyuan Zhang , Lin Ge , Hongjiang Li , Weicheng Zhu , Chuxu Zhang , Yanfang Ye

The alignment of Multi-Agent Systems (MAS) for autonomous software engineering is constrained by evaluator epistemic uncertainty. Current paradigms, such as Reinforcement Learning from Human Feedback (RLHF) and AI Feedback (RLAIF),…

Artificial Intelligence · Computer Science 2026-04-14 Kun Liu , Liqun Chen

Large Language Model-based Multi-Agent Systems (MASs) have emerged as a powerful paradigm for tackling complex tasks through collaborative intelligence. However, the topology of these systems--how agents in MASs should be configured,…

Multiagent Systems · Computer Science 2025-10-20 Jiaxi Yang , Mengqi Zhang , Yiqiao Jin , Hao Chen , Qingsong Wen , Lu Lin , Yi He , Srijan Kumar , Weijie Xu , James Evans , Jindong Wang

Algorithmic problem solving serves as a rigorous testbed for evaluating structured reasoning in AI coding systems, as it directly reflects a model's ability to perform structured reasoning in complex scenarios. Existing approaches…

Artificial Intelligence · Computer Science 2026-05-11 Yuliang Xu , Xiang Xu , Yao Wan , Hu Wei , Tong Jia

Only limited studies and superficial evaluations are available on agents' behaviors and roles within a Multi-Agent System (MAS). We simulate a MAS using Reinforcement Learning (RL) in a pursuit-evasion (a.k.a predator-prey pursuit) game,…

Artificial Intelligence · Computer Science 2022-12-16 Piyush K. Sharma , Erin Zaroukian , Derrik E. Asher , Bryson Howell

LLM-based multi-agent systems (MAS) show promise on complex tasks but remain prone to coordination failures such as goal drift, error cascades, and misaligned behaviors. We propose Explicit Trait Inference (ETI), a psychologically grounded…

Artificial Intelligence · Computer Science 2026-04-23 Suhaib Abdurahman , Etsuko Ishii , Katerina Margatina , Divya Bhargavi , Monica Sunkara , Yi Zhang

Human decision-making often involves constrained optimization. As LLM agents are deployed to assist with real-world tasks like travel planning, shopping, and scheduling, they must mirror this capability. We introduce COMPASS, a benchmark…

Many complex tasks require extended effort, diverse capabilities, or coordinated actions beyond what a single agent can provide. However, simply adding more agents does not guarantee better performance, as effective cooperation depends on…

Artificial Intelligence · Computer Science 2026-05-28 Hanqing Yang , Narjes Nourzad , Shiyu Chen , Marie Siew , Jingdi Chen , Carlee Joe-Wong

A central problem in the theory of multi-agent reinforcement learning (MARL) is to understand what structural conditions and algorithmic principles lead to sample-efficient learning guarantees, and how these considerations change as we move…

Machine Learning · Computer Science 2023-05-02 Dylan J. Foster , Dean P. Foster , Noah Golowich , Alexander Rakhlin

In recent years, multi-agent reinforcement learning (MARL) has presented impressive performance in various applications. However, physical limitations, budget restrictions, and many other factors usually impose \textit{constraints} on a…

Machine Learning · Computer Science 2021-11-11 Zhaoxing Yang , Rong Ding , Haiming Jin , Yifei Wei , Haoyi You , Guiyun Fan , Xiaoying Gan , Xinbing Wang

Fairness in multi-agent systems (MAS) focuses on equitable reward distribution among agents in scenarios involving sensitive attributes such as race, gender, or socioeconomic status. This paper introduces fairness in Proximal Policy…

Multiagent Systems · Computer Science 2025-09-03 Gabriele La Malfa , Jie M. Zhang , Michael Luck , Elizabeth Black

We investigate the mechanism design problem faced by a principal who hires \emph{multiple} agents to gather and report costly information. Then, the principal exploits the information to make an informed decision. We model this problem as a…

Computer Science and Game Theory · Computer Science 2023-07-13 Federico Cacciamani , Matteo Castiglioni , Nicola Gatti

In this paper, we propose to incorporate the blackboard architecture into LLM multi-agent systems (MASs) so that (1) agents with various roles can share all the information and others' messages during the whole problem-solving process, (2)…

Multiagent Systems · Computer Science 2025-07-03 Bochen Han , Songmao Zhang

Large Language Models (LLMs) are increasingly deployed as reasoning systems, where reasoning paradigms - such as Chain-of-Thought (CoT) and multi-agent systems (MAS) - play a critical role, yet their relative effectiveness and cost-accuracy…

Machine Learning · Computer Science 2026-01-21 Yapeng Li , Jiakuo Yu , Zhixin Liu , Xinnan Liu , Jing Yu , Songze Li , Tonghua Su

Agents, language model-based systems capable of reasoning, planning, and acting are widely adopted in real-world tasks, yet how their performance changes as these systems scale across key dimensions remains underexplored. We introduce…

Identifying and articulating limitations is essential for transparent and rigorous scientific research. However, zero-shot large language models (LLMs) approach often produce superficial or general limitation statements (e.g., dataset bias…

Computation and Language · Computer Science 2026-03-17 Ibrahim Al Azher , Zhishuai Guo , Hamed Alhoori

Attribution methods provide an insight into the decision-making process of machine learning models, especially deep neural networks, by assigning contribution scores to each individual feature. However, the attribution problem has not been…

Machine Learning · Computer Science 2023-02-28 Huiqi Deng , Na Zou , Mengnan Du , Weifu Chen , Guocan Feng , Xia Hu