English
Related papers

Related papers: CORD: Generalizable Cooperation via Role Diversity

200 papers

We consider a warehouse in which dozens of mobile robots and human pickers work together to collect and deliver items within the warehouse. The fundamental problem we tackle, called the order-picking problem, is how these worker agents must…

Advances in multi-agent reinforcement learning (MARL) enable sequential decision making for a range of exciting multi-agent applications such as cooperative AI and autonomous driving. Explaining agent decisions is crucial for improving…

Artificial Intelligence · Computer Science 2022-05-24 Kayla Boggess , Sarit Kraus , Lu Feng

While many robotic tasks can be addressed using either centralized single-agent control with full state observation or decentralized multi-agent control, clear criteria for choosing between these approaches remain underexplored. This paper…

Cooperative multi-agent reinforcement learning (MARL) has made prominent progress in recent years. For training efficiency and scalability, most of the MARL algorithms make all agents share the same policy or value network. However, in many…

Machine Learning · Computer Science 2022-11-07 Mingyu Yang , Jian Zhao , Xunhan Hu , Wengang Zhou , Jiangcheng Zhu , Houqiang Li

To achieve general intelligence, agents must learn how to interact with others in a shared environment: this is the challenge of multiagent reinforcement learning (MARL). The simplest form is independent reinforcement learning (InRL), where…

Artificial Intelligence · Computer Science 2017-11-08 Marc Lanctot , Vinicius Zambaldi , Audrunas Gruslys , Angeliki Lazaridou , Karl Tuyls , Julien Perolat , David Silver , Thore Graepel

Offline cooperative multi-agent reinforcement learning (MARL) faces unique challenges due to distributional shifts, particularly stemming from the high dimensionality of joint action spaces and the presence of out-of-distribution joint…

Machine Learning · Computer Science 2026-05-29 Dan Qiao , Wenhao Li , Shanchao Yang , Hongyuan Zha , Baoxiang Wang

Multiagent Reinforcement Learning (MARL) poses significant challenges due to the exponential growth of state and action spaces and the non-stationary nature of multiagent environments. This results in notable sample inefficiency and hinders…

Multiagent Systems · Computer Science 2025-02-27 Nikhilesh Prabhakar , Ranveer Singh , Harsha Kokel , Sriraam Natarajan , Prasad Tadepalli

In multi-agent systems, agents possess only local observations of the environment. Communication between teammates becomes crucial for enhancing coordination. Past research has primarily focused on encoding local information into embedding…

Multiagent Systems · Computer Science 2023-11-09 Peihong Yu , Bhoram Lee , Aswin Raghavan , Supun Samarasekara , Pratap Tokekar , James Zachary Hare

Multi-agent reinforcement learning (MARL) has emerged as a useful approach to solving decentralised decision-making problems at scale. Research in the field has been growing steadily with many breakthrough algorithms proposed in recent…

Machine Learning · Computer Science 2022-09-22 Rihab Gorsane , Omayma Mahjoub , Ruan de Kock , Roland Dubb , Siddarth Singh , Arnu Pretorius

When solving a complex task, humans will spontaneously form teams and to complete different parts of the whole task, respectively. Meanwhile, the cooperation between teammates will improve efficiency. However, for current cooperative MARL…

Machine Learning · Computer Science 2021-02-10 Wenhao Li , Xiangfeng Wang , Bo Jin , Junjie Sheng , Yun Hua , Hongyuan Zha

We discuss the role of coordination as a direct learning objective in multi-agent reinforcement learning (MARL) domains. To this end, we present a novel means of quantifying coordination in multi-agent systems, and discuss the implications…

Multiagent Systems · Computer Science 2022-08-15 Sean L. Barton , Nicholas R. Waytowich , Derrik E. Asher

The majority of Multi-Agent Reinforcement Learning (MARL) literature equates the cooperation of self-interested agents in mixed environments to the problem of social welfare maximization, allowing agents to arbitrarily share rewards and…

Multiagent Systems · Computer Science 2023-06-16 Dmitry Ivanov , Ilya Zisman , Kirill Chernyshev

Cooperative multi-agent reinforcement learning (MARL) is typically formalised as a Decentralised Partially Observable Markov Decision Process (Dec-POMDP), where agents must reason about the environment and other agents' behaviour. In…

Machine Learning · Computer Science 2025-07-25 Kale-ab Abebe Tessera , Leonard Hinckeldey , Riccardo Zamboni , David Abel , Amos Storkey

In Multi-Agent Reinforcement Learning (MARL), specialized channels are often introduced that allow agents to communicate directly with one another. In this paper, we propose an alternative approach whereby agents communicate through an…

Artificial Intelligence · Computer Science 2022-05-26 Dianbo Liu , Vedant Shah , Oussama Boussif , Cristian Meo , Anirudh Goyal , Tianmin Shu , Michael Mozer , Nicolas Heess , Yoshua Bengio

Cooperative multi-agent reinforcement learning (MARL) is widely used to address large joint observation and action spaces by decomposing a centralized control problem into multiple interacting agents. However, such decomposition often…

Machine Learning · Computer Science 2026-04-16 Zijian Zhao , Jing Gao , Sen Li

Effective coordination is crucial to solve multi-agent collaborative (MAC) problems. While centralized reinforcement learning methods can optimally solve small MAC instances, they do not scale to large problems and they fail to generalize…

Machine Learning · Computer Science 2019-10-22 Nicolas Carion , Gabriel Synnaeve , Alessandro Lazaric , Nicolas Usunier

Value-based methods of multi-agent reinforcement learning (MARL), especially the value decomposition methods, have been demonstrated on a range of challenging cooperative tasks. However, current methods pay little attention to the…

Machine Learning · Computer Science 2021-02-12 Xiaoteng Ma , Yiqin Yang , Chenghao Li , Yiwen Lu , Qianchuan Zhao , Yang Jun

Multi-agent reinforcement learning (MARL) has exploded in popularity in recent years. While numerous approaches have been developed, they can be broadly categorized into three main types: centralized training and execution (CTE),…

Machine Learning · Computer Science 2025-05-22 Christopher Amato

This paper proposes a distributed Multi-Agent Reinforcement Learning (MARL) algorithm for a team of Unmanned Aerial Vehicles (UAVs). The proposed MARL algorithm allows UAVs to learn cooperatively to provide a full coverage of an unknown…

Robotics · Computer Science 2018-09-18 Huy Xuan Pham , Hung Manh La , David Feil-Seifer , Aria Nefian

Cooperative Multi-Agent Reinforcement Learning (MARL) necessitates seamless collaboration among agents, often represented by an underlying relation graph. Existing methods for learning this graph primarily focus on agent-pair relations,…

Machine Learning · Computer Science 2026-04-13 Wei Duan , Jie Lu , Junyu Xuan