English
Related papers

Related papers: Coordination Matters: Evaluation of Cooperative Mu…

200 papers

Multi-agent reinforcement learning (MARL) has exploded in popularity in recent years. While numerous approaches have been developed, they can be broadly categorized into three main types: centralized training and execution (CTE),…

Machine Learning · Computer Science 2025-05-22 Christopher Amato

Many advances in cooperative multi-agent reinforcement learning (MARL) are based on two common design principles: value decomposition and parameter sharing. A typical MARL algorithm of this fashion decomposes a centralized Q-function into…

Artificial Intelligence · Computer Science 2022-08-09 Wei Fu , Chao Yu , Zelai Xu , Jiaqi Yang , Yi Wu

A central problem in the theory of multi-agent reinforcement learning (MARL) is to understand what structural conditions and algorithmic principles lead to sample-efficient learning guarantees, and how these considerations change as we move…

Machine Learning · Computer Science 2023-05-02 Dylan J. Foster , Dean P. Foster , Noah Golowich , Alexander Rakhlin

Multiagent Reinforcement Learning (MARL) poses significant challenges due to the exponential growth of state and action spaces and the non-stationary nature of multiagent environments. This results in notable sample inefficiency and hinders…

Multiagent Systems · Computer Science 2025-02-27 Nikhilesh Prabhakar , Ranveer Singh , Harsha Kokel , Sriraam Natarajan , Prasad Tadepalli

Cooperative Multi-Agent Reinforcement Learning (MARL) necessitates seamless collaboration among agents, often represented by an underlying relation graph. Existing methods for learning this graph primarily focus on agent-pair relations,…

Machine Learning · Computer Science 2026-04-13 Wei Duan , Jie Lu , Junyu Xuan

A large amount of work has been done in Multi-Agent Systems (MAS) for modeling and solving problems with multiple interacting agents. However, most LLMs are pretrained independently and not specifically optimized for coordination. Existing…

Artificial Intelligence · Computer Science 2025-12-10 Shuo Liu , Tianle Chen , Zeyu Liang , Xueguang Lyu , Christopher Amato

Analysing learning in Multi-Agent Reinforcement Learning (MARL) environments is challenging, in particular with respect to \textit{individual} decision-making. Practitioners frequently struggle to compare training runs due to the inherent…

Multiagent Systems · Computer Science 2026-05-29 James Rudd-Jones , María Pérez-Ortiz , Mirco Musolesi

Multi-Agent Reinforcement Learning (MARL) is an increasingly important research field that can model and control multiple large-scale autonomous systems. Despite its achievements, existing multi-agent learning methods typically involve…

Multiagent Systems · Computer Science 2023-05-25 Kailash Gogineni , Peng Wei , Tian Lan , Guru Venkataramani

Achieving distributed reinforcement learning (RL) for large-scale cooperative multi-agent systems (MASs) is challenging because: (i) each agent has access to only limited information; (ii) issues on convergence or computational complexity…

Machine Learning · Computer Science 2024-04-15 Gangshan Jing , He Bai , Jemin George , Aranya Chakrabortty , Piyush K. Sharma

Cooperative Multi-agent Reinforcement Learning (MARL) has attracted significant attention and played the potential for many real-world applications. Previous arts mainly focus on facilitating the coordination ability from different aspects…

Multiagent Systems · Computer Science 2023-05-24 Lei Yuan , Lihe Li , Ziqian Zhang , Fuxiang Zhang , Cong Guan , Yang Yu

In this paper, we study the cooperative Multi-Agent Reinforcement Learning (MARL) problems using Reward Machines (RMs) to specify the reward functions such that the prior knowledge of high-level events in a task can be leveraged to…

Artificial Intelligence · Computer Science 2024-03-13 Xuejing Zheng , Chao Yu

In cooperative Multi-Agent Reinforcement Learning (MARL), it is a common practice to tune hyperparameters in ideal simulated environments to maximize cooperative performance. However, policies tuned for cooperation often fail to maintain…

We propose a multimodal (vision-and-language) benchmark for cooperative and heterogeneous multi-agent learning. We introduce a benchmark multimodal dataset with tasks involving collaboration between multiple simulated heterogeneous robots…

Artificial Intelligence · Computer Science 2022-08-30 Vasu Sharma , Prasoon Goyal , Kaixiang Lin , Govind Thattai , Qiaozi Gao , Gaurav S. Sukhatme

This work leverages adaptive social learning to estimate partially observable global states in multi-agent reinforcement learning (MARL) problems. Unlike existing methods, the proposed approach enables the concurrent operation of social…

Multiagent Systems · Computer Science 2025-08-11 Ainur Zhaikhan , Malek Khammassi , Ali H. Sayed

Cooperative multi-agent reinforcement learning (MARL) for navigation enables agents to cooperate to achieve their navigation goals. Using emergent communication, agents learn a communication protocol to coordinate and share information that…

Machine Learning · Computer Science 2024-02-13 Mohamed K. Abdelaziz , Mohammed S. Elbamby , Sumudu Samarakoon , Mehdi Bennis

In cooperative multi-agent reinforcement learning (c-MARL), agents learn to cooperatively take actions as a team to maximize a total team reward. We analyze the robustness of c-MARL to adversaries capable of attacking one of the agents on a…

Machine Learning · Computer Science 2020-03-10 Jieyu Lin , Kristina Dzeparoska , Sai Qian Zhang , Alberto Leon-Garcia , Nicolas Papernot

Cooperative Multi-agent Reinforcement Learning (MARL) is crucial for cooperative decentralized decision learning in many domains such as search and rescue, drone surveillance, package delivery and fire fighting problems. In these domains, a…

Machine Learning · Computer Science 2020-01-23 Rajiv Ranjan Kumar , Pradeep Varakantham

Monitoring human activity in indoor environments is important for applications such as facility management, safety assessment, and space utilization analysis. While mobile robot teams offer the potential to actively improve observation…

Multi-Agent Reinforcement Learning can lead to the development of collaborative agent behaviors that show similarities with organizational concepts. Pushing forward this perspective, we introduce a novel framework that explicitly…

Artificial Intelligence · Computer Science 2025-04-01 Julien Soulé , Jean-Paul Jamont , Michel Occello , Louis-Marie Traonouez , Paul Théron

Effective coordination is crucial to solve multi-agent collaborative (MAC) problems. While centralized reinforcement learning methods can optimally solve small MAC instances, they do not scale to large problems and they fail to generalize…

Machine Learning · Computer Science 2019-10-22 Nicolas Carion , Gabriel Synnaeve , Alessandro Lazaric , Nicolas Usunier