English
Related papers

Related papers: Tackling Uncertainties in Multi-Agent Reinforcemen…

200 papers

Cooperative multi-agent reinforcement learning (MARL) benchmarks commonly emphasize aggregate outcomes such as return, success rate, or completion time. While essential, these metrics often fail to reveal how agents coordinate, particularly…

Multiagent Systems · Computer Science 2026-05-08 Maria Ana Cardei , Matthew Landers , Afsaneh Doryab

Multiagent Reinforcement Learning (MARL) poses significant challenges due to the exponential growth of state and action spaces and the non-stationary nature of multiagent environments. This results in notable sample inefficiency and hinders…

Multiagent Systems · Computer Science 2025-02-27 Nikhilesh Prabhakar , Ranveer Singh , Harsha Kokel , Sriraam Natarajan , Prasad Tadepalli

Multi-agent Reinforcement Learning (MARL) problems often require cooperation among agents in order to solve a task. Centralization and decentralization are two approaches used for cooperation in MARL. While fully decentralized methods are…

Multiagent Systems · Computer Science 2021-11-30 Bengisu Guresti , Nazim Kemal Ure

In cooperative multi-agent tasks, a team of agents jointly interact with an environment by taking actions, receiving a team reward and observing the next state. During the interactions, the uncertainty of environment and reward will…

Machine Learning · Computer Science 2022-05-23 Jian Zhao , Mingyu Yang , Youpeng Zhao , Xunhan Hu , Wengang Zhou , Jiangcheng Zhu , Houqiang Li

A central problem in the theory of multi-agent reinforcement learning (MARL) is to understand what structural conditions and algorithmic principles lead to sample-efficient learning guarantees, and how these considerations change as we move…

Machine Learning · Computer Science 2023-05-02 Dylan J. Foster , Dean P. Foster , Noah Golowich , Alexander Rakhlin

Reinforcement Learning (RL) is a potent tool for sequential decision-making and has achieved performance surpassing human capabilities across many challenging real-world tasks. As the extension of RL in the multi-agent system domain,…

Artificial Intelligence · Computer Science 2024-08-20 Ruiqi Zhang , Jing Hou , Florian Walter , Shangding Gu , Jiayi Guan , Florian Röhrbein , Yali Du , Panpan Cai , Guang Chen , Alois Knoll

This paper serves to introduce the reader to the field of multi-agent reinforcement learning (MARL) and its intersection with methods from the study of causality. We highlight key challenges in MARL and discuss these in the context of how…

Machine Learning · Computer Science 2021-12-02 St John Grimbly , Jonathan Shock , Arnu Pretorius

Cooperation is central to multi-agent reinforcement learning (MARL), yet learned coordination can be fragile when external perturbations disrupt inter-agent interactions. Prior robust MARL methods have primarily considered value-oriented…

Machine Learning · Computer Science 2026-05-19 Sunwoo Lee , Mingu Kang , Yonghyeon Jo , Seungyul Han

Achieving distributed reinforcement learning (RL) for large-scale cooperative multi-agent systems (MASs) is challenging because: (i) each agent has access to only limited information; (ii) issues on convergence or computational complexity…

Machine Learning · Computer Science 2024-04-15 Gangshan Jing , He Bai , Jemin George , Aranya Chakrabortty , Piyush K. Sharma

Multi-Agent Reinforcement Learning (MARL) has achieved significant success in large-scale AI systems and big-data applications such as smart grids, surveillance, etc. Existing advancements in MARL algorithms focus on improving the rewards…

Machine Learning · Computer Science 2023-09-14 Samuel Wiggins , Yuan Meng , Rajgopal Kannan , Viktor Prasanna

Multi-Agent Reinforcement Learning (MARL) is a widely used technique for optimization in decentralised control problems. However, most applications of MARL are in static environments, and are not suitable when agent behaviour and…

Multiagent Systems · Computer Science 2014-09-17 Andrei Marinescu , Ivana Dusparic , Adam Taylor , Vinny Cahill , Siobhán Clarke

Real-time dynamic scheduling is a crucial but notoriously challenging task in modern manufacturing processes due to its high decision complexity. Recently, reinforcement learning (RL) has been gaining attention as an impactful technique to…

Multiagent Systems · Computer Science 2024-09-23 Jaeyeon Jang , Diego Klabjan , Han Liu , Nital S. Patel , Xiuqi Li , Balakrishnan Ananthanarayanan , Husam Dauod , Tzung-Han Juang

Multiagent reinforcement learning algorithms (MARL) have been demonstrated on complex tasks that require the coordination of a team of multiple agents to complete. Existing works have focused on sharing information between agents via…

Machine Learning · Computer Science 2019-03-18 Samir Wadhwania , Dong-Ki Kim , Shayegan Omidshafiei , Jonathan P. How

We study multi-agent reinforcement learning (MARL) with centralized training and decentralized execution. During the training, new agents may join, and existing agents may unexpectedly leave the training. In such situations, a standard deep…

Machine Learning · Computer Science 2022-08-05 Xuting Tang , Jia Xu , Shusen Wang

The role concept provides a useful tool to design and understand complex multi-agent systems, which allows agents with a similar role to share similar behaviors. However, existing role-based methods use prior domain knowledge and predefine…

Multiagent Systems · Computer Science 2020-07-07 Tonghan Wang , Heng Dong , Victor Lesser , Chongjie Zhang

Climate policy development faces significant challenges due to deep uncertainty, complex system dynamics, and competing stakeholder interests. Climate simulation methods, such as Earth System Models, have become valuable tools for policy…

Multiagent Systems · Computer Science 2026-02-11 James Rudd-Jones , Mirco Musolesi , María Pérez-Ortiz

Multi-agent reinforcement learning (MARL) has made significant strides in enabling coordinated behaviors among autonomous agents. However, most existing approaches assume that communication is instantaneous, reliable, and has unlimited…

Artificial Intelligence · Computer Science 2025-11-17 Zejiao Liu , Yi Li , Jiali Wang , Junqi Tu , Yitian Hong , Fangfei Li , Yang Liu , Toshiharu Sugawara , Yang Tang

The multi-agent setting is intricate and unpredictable since the behaviors of multiple agents influence one another. To address this environmental uncertainty, distributional reinforcement learning algorithms that incorporate uncertainty…

Machine Learning · Computer Science 2023-03-06 Jihwan Oh , Joonkee Kim , Minchan Jeong , Se-Young Yun

Multi-agent systems are trained to maximize shared cost objectives, which typically reflect system-level efficiency. However, in the resource-constrained environments of mobility and transportation systems, efficiency may be achieved at the…

Multiagent Systems · Computer Science 2024-10-30 Jasmine Jerry Aloor , Siddharth Nayak , Sydney Dolan , Hamsa Balakrishnan

In a multirobot system, a number of cyber-physical attacks (e.g., communication hijack, observation perturbations) can challenge the robustness of agents. This robustness issue worsens in multiagent reinforcement learning because there…

Machine Learning · Computer Science 2021-09-15 Chuangchuang Sun , Dong-Ki Kim , Jonathan P. How