English
Related papers

Related papers: SMACv2: An Improved Benchmark for Cooperative Mult…

200 papers

The field of Multi-Agent Reinforcement Learning (MARL) is currently facing a reproducibility crisis. While solutions for standardized reporting have been proposed to address the issue, we still lack a benchmarking tool that enables…

Machine Learning · Computer Science 2024-11-26 Matteo Bettini , Amanda Prorok , Vincent Moens

Learning to collaborate has witnessed significant progress in multi-agent reinforcement learning (MARL). However, promoting coordination among agents and enhancing exploration capabilities remain challenges. In multi-agent environments,…

Artificial Intelligence · Computer Science 2023-12-18 Xiao Du , Yutong Ye , Pengyu Zhang , Yaning Yang , Mingsong Chen , Ting Wang

Recent advances in multi-agent reinforcement learning (MARL) have achieved super-human performance in games like Quake 3 and Dota 2. Unfortunately, these techniques require orders-of-magnitude more training rounds than humans and don't…

Machine Learning · Computer Science 2020-10-19 Tianjun Zhang , Huazhe Xu , Xiaolong Wang , Yi Wu , Kurt Keutzer , Joseph E. Gonzalez , Yuandong Tian

In cooperative Multi-Agent Reinforcement Learning (MARL), efficient exploration is crucial for optimizing the performance of joint policy. However, existing methods often update joint policies via independent agent exploration, without…

Machine Learning · Computer Science 2025-11-18 Zejiao Liu , Junqi Tu , Yitian Hong , Luolin Xiong , Yaochu Jin , Yang Tang , Fangfei Li

Cooperative multi-agent reinforcement learning (MARL) is typically formalised as a Decentralised Partially Observable Markov Decision Process (Dec-POMDP), where agents must reason about the environment and other agents' behaviour. In…

Machine Learning · Computer Science 2025-07-25 Kale-ab Abebe Tessera , Leonard Hinckeldey , Riccardo Zamboni , David Abel , Amos Storkey

The necessity for cooperation among intelligent machines has popularised cooperative multi-agent reinforcement learning (MARL) in AI research. However, many research endeavours heavily rely on parameter sharing among agents, which confines…

Machine Learning · Computer Science 2023-12-29 Yifan Zhong , Jakub Grudzien Kuba , Xidong Feng , Siyi Hu , Jiaming Ji , Yaodong Yang

Recent Multi-Agent Reinforcement Learning (MARL) literature has been largely focused on Centralized Training with Decentralized Execution (CTDE) paradigm. CTDE has been a dominant approach for both cooperative and mixed environments due to…

Machine Learning · Computer Science 2022-05-31 Vladimir Egorov , Aleksei Shpilman

Centralised training with decentralised execution is an important setting for cooperative deep multi-agent reinforcement learning due to communication constraints during execution and computational tractability in training. In this paper,…

Machine Learning · Computer Science 2020-01-22 Anuj Mahajan , Tabish Rashid , Mikayel Samvelyan , Shimon Whiteson

Multi-agent reinforcement learning has emerged as a powerful framework for enabling agents to learn complex, coordinated behaviors but faces persistent challenges regarding its generalization, scalability and sample efficiency. Recent…

Robotics · Computer Science 2025-04-28 Nikolaos Bousias , Stefanos Pertigkiozoglou , Kostas Daniilidis , George Pappas

Recent advances in multi-agent reinforcement learning (MARL) allow agents to coordinate their behaviors in complex environments. However, common MARL algorithms still suffer from scalability and sparse reward issues. One promising approach…

Artificial Intelligence · Computer Science 2023-02-08 Rundong Wang , Longtao Zheng , Wei Qiu , Bowei He , Bo An , Zinovi Rabinovich , Yujing Hu , Yingfeng Chen , Tangjie Lv , Changjie Fan

Offline-to-Online Reinforcement Learning has emerged as a powerful paradigm, leveraging offline data for initialization and online fine-tuning to enhance both sample efficiency and performance. However, most existing research has focused on…

Artificial Intelligence · Computer Science 2026-03-05 Hai Zhong , Xun Wang , Zhuoran Li , Longbo Huang

Safe Multi-agent reinforcement learning (safe MARL) has increasingly gained attention in recent years, emphasizing the need for agents to not only optimize the global return but also adhere to safety requirements through behavioral…

Machine Learning · Computer Science 2024-03-13 Xuefeng Wang , Henglin Pu , Hyung Jun Kim , Husheng Li

In this paper, we propose a new mutual information framework for multi-agent reinforcement learning to enable multiple agents to learn coordinated behaviors by regularizing the accumulated return with the simultaneous mutual information…

Multiagent Systems · Computer Science 2023-03-02 Woojun Kim , Whiyoung Jung , Myungsik Cho , Youngchul Sung

Action and observation delays exist prevalently in the real-world cyber-physical systems which may pose challenges in reinforcement learning design. It is particularly an arduous task when handling multi-agent systems where the delay of one…

Machine Learning · Computer Science 2020-09-01 Baiming Chen , Mengdi Xu , Zuxin Liu , Liang Li , Ding Zhao

The Transformer model has demonstrated success across a wide range of domains, including in Multi-Agent Reinforcement Learning (MARL) where the Multi-Agent Transformer (MAT) has emerged as a leading algorithm in the field. However, a…

Training a multi-agent reinforcement learning (MARL) algorithm is more challenging than training a single-agent reinforcement learning algorithm, because the result of a multi-agent task strongly depends on the complex interactions among…

Machine Learning · Computer Science 2021-01-19 Heechang Ryu , Hayong Shin , Jinkyoo Park

Multi-Agent Path Finding (MAPF) is a critical component of logistics and warehouse management, which focuses on planning collision-free paths for a team of robots in a known environment. Recent work introduced a novel MAPF approach, LNS2,…

Robotics · Computer Science 2025-02-03 Yutong Wang , Tanishq Duhan , Jiaoyang Li , Guillaume Sartoretti

While the maximum entropy (MaxEnt) reinforcement learning (RL) framework -- often touted for its exploration and robustness capabilities -- is usually motivated from a probabilistic perspective, the use of deep probabilistic models has not…

Machine Learning · Computer Science 2023-02-13 Dinghuai Zhang , Aaron Courville , Yoshua Bengio , Qinqing Zheng , Amy Zhang , Ricky T. Q. Chen

Learning a stable and generalizable centralized value function (CVF) is a crucial but challenging task in multi-agent reinforcement learning (MARL), as it has to deal with the issue that the joint action space increases exponentially with…

Multiagent Systems · Computer Science 2020-08-11 Xinghu Yao , Chao Wen , Yuhui Wang , Xiaoyang Tan

Multi-Agent Reinforcement Learning (MARL) has become a powerful framework for numerous real-world applications, modeling distributed decision-making and learning from interactions with complex environments. Resource Allocation Optimization…

Multiagent Systems · Computer Science 2025-05-01 Mohamad A. Hady , Siyi Hu , Mahardhika Pratama , Jimmy Cao , Ryszard Kowalczyk