English
Related papers

Related papers: Greedy UnMixing for Q-Learning in Multi-Agent Rein…

200 papers

In this paper, we consider the problem of multi-agent navigation in partially observable grid environments. This problem is challenging for centralized planning approaches as they, typically, rely on the full knowledge of the environment.…

Machine Learning · Computer Science 2021-08-16 Vasilii Davydov , Alexey Skrynnik , Konstantin Yakovlev , Aleksandr I. Panov

In the last decade, there have been significant advances in multi-agent reinforcement learning (MARL) but there are still numerous challenges, such as high sample complexity and slow convergence to stable policies, that need to be overcome…

Artificial Intelligence · Computer Science 2023-03-02 Sriram Ganapathi Subramanian , Matthew E. Taylor , Kate Larson , Mark Crowley

Deep reinforcement learning (DRL) performance is generally impacted by state-adversarial attacks, a perturbation applied to an agent's observation. Most recent research has concentrated on robust single-agent reinforcement learning (SARL)…

Machine Learning · Computer Science 2024-03-07 Weiran Guo , Guanjun Liu , Ziyuan Zhou , Ling Wang , Jiacun Wang

We present a comparative study of multi-agent reinforcement learning (MARL) algorithms for cooperative warehouse robotics. We evaluate QMIX and IPPO on the Robotic Warehouse (RWARE) environment and a custom Unity 3D simulation. Our…

Artificial Intelligence · Computer Science 2025-12-10 Price Allman , Lian Thang , Dre Simmons , Salmon Riaz

Due to the representation limitation of the joint Q value function, multi-agent reinforcement learning methods with linear value decomposition (LVD) or monotonic value decomposition (MVD) suffer from relative overgeneralization. As a…

Multiagent Systems · Computer Science 2026-03-05 Lipeng Wan , Zeyang Liu , Xingyu Chen , Han Wang , Xuguang Lan

Due to the representation limitation of the joint Q value function, multi-agent reinforcement learning methods with linear value decomposition (LVD) or monotonic value decomposition (MVD) suffer from relative overgeneralization. As a…

Multiagent Systems · Computer Science 2022-11-23 Lipeng Wan , Zeyang Liu , Xingyu Chen , Xuguang Lan , Nanning Zheng

Deep Reinforcement Learning has made significant progress in multi-agent systems in recent years. In this review article, we have focused on presenting recent approaches on Multi-Agent Reinforcement Learning (MARL) algorithms. In…

Machine Learning · Computer Science 2021-05-03 Afshin OroojlooyJadid , Davood Hajinezhad

We explore value-based multi-agent reinforcement learning (MARL) in the popular paradigm of centralized training with decentralized execution (CTDE). CTDE has an important concept, Individual-Global-Max (IGM) principle, which requires the…

Machine Learning · Computer Science 2021-10-05 Jianhao Wang , Zhizhou Ren , Terry Liu , Yang Yu , Chongjie Zhang

Cooperative multi-agent reinforcement learning (MARL) commonly adopts centralized training with decentralized execution, where value-factorization methods enforce the individual-global-maximum (IGM) principle so that decentralized greedy…

Artificial Intelligence · Computer Science 2026-02-13 Chengrui Qu , Christopher Yeh , Kishan Panaganti , Eric Mazumdar , Adam Wierman

The deployment of Unmanned Aerial Vehicle (UAV) swarms as dynamic communication relays is critical for next-generation tactical networks. However, operating in contested environments requires solving a complex trade-off, including…

Networking and Internet Architecture · Computer Science 2025-12-10 Thai Duong Nguyen , Ngoc-Tan Nguyen , Thanh-Dao Nguyen , Nguyen Van Huynh , Dinh-Hieu Tran , Symeon Chatzinotas

In this paper, we study cooperative multi-agent reinforcement learning (MARL) where the joint reward exhibits submodularity, which is a natural property capturing diminishing marginal returns when adding agents to a team. Unlike standard…

Machine Learning · Computer Science 2026-03-10 Wenjing Chen , Chengyuan Qian , Shuo Xing , Yi Zhou , Victoria Crawford

Much work has been dedicated to the exploration of Multi-Agent Reinforcement Learning (MARL) paradigms implementing a centralized learning with decentralized execution (CLDE) approach to achieve human-like collaboration in cooperative…

Multiagent Systems · Computer Science 2023-07-26 Piyush K. Sharma , Rolando Fernandez , Erin Zaroukian , Michael Dorothy , Anjon Basak , Derrik E. Asher

In Cooperative Multi-Agent Reinforcement Learning (MARL) and under the setting of Centralized Training with Decentralized Execution (CTDE), agents observe and interact with their environment locally and independently. With local observation…

Machine Learning · Computer Science 2021-02-24 Jian Hu , Seth Austin Harding , Haibin Wu , Siyue Hu , Shih-wei Liao

In real-world environments, autonomous agents rely on their egocentric observations. They must learn adaptive strategies to interact with others who possess mixed motivations, discernible only through visible cues. Several Multi-Agent…

Multiagent Systems · Computer Science 2023-12-15 Violet Xiang , Logan Cross , Jan-Philipp Fränken , Nick Haber

Offline multi-agent reinforcement learning (MARL) leverages static datasets of experience to learn optimal multi-agent control. However, learning from static data presents several unique challenges to overcome. In this paper, we focus on…

Machine Learning · Computer Science 2024-07-02 Callum Rhys Tilbury , Claude Formanek , Louise Beyers , Jonathan P. Shock , Arnu Pretorius

In recent years, Model-based Multi-Agent Reinforcement Learning (MARL) has demonstrated significant advantages over model-free methods in terms of sample efficiency by using independent environment dynamics world models for data sample…

Multiagent Systems · Computer Science 2025-01-20 Zifeng Shi , Meiqin Liu , Senlin Zhang , Ronghao Zheng , Shanling Dong , Ping Wei

Inspired by a graph-based technique for predicting molecular properties in quantum chemistry -- atoms' position within molecules in three-dimensional space -- we present Q-MARL, a completely decentralised learning architecture that supports…

Machine Learning · Computer Science 2025-03-11 Kha Vo , Chin-Teng Lin

Model-based reinforcement learning algorithms make decisions by building and utilizing a model of the environment. However, none of the existing algorithms attempts to infer the dynamics of any state-action pair from known state-action…

Machine Learning · Computer Science 2020-02-25 Yanchao Sun , Furong Huang

Non-stationarity is a fundamental challenge in multi-agent reinforcement learning (MARL), where agents update their behaviour as they learn. Many theoretical advances in MARL avoid the challenge of non-stationarity by coordinating the…

Computer Science and Game Theory · Computer Science 2025-03-19 Bora Yongacoglu , Gürdal Arslan , Serdar Yüksel

Multi-agent reinforcement learning (MARL) optimizes strategic interactions in non-cooperative dynamic games, where agents have misaligned objectives. However, data-driven methods such as multi-agent policy gradients (MA-PG) often suffer…

Systems and Control · Electrical Eng. & Systems 2026-02-13 Jingqi Li , Gechen Qu , Jason J. Choi , Somayeh Sojoudi , Claire Tomlin