English
Related papers

Related papers: More Centralized Training, Still Decentralized Exe…

200 papers

The inability to communicate poses a major challenge to coordination in multi-agent reinforcement learning (MARL). Prior work has explored correlating local policies via shared randomness, sometimes in the form of a correlation device, as a…

Multiagent Systems · Computer Science 2026-02-12 John Gardiner , Orlando Romero , Brendan Tivnan , Nicolò Dal Fabbro , George J. Pappas

In this paper, we propose a novel model-free reinforcement learning algorithm to compute the optimal policies for a multi-agent system with $N$ cooperative agents where each agent privately observes it's own private type and publicly…

Systems and Control · Electrical Eng. & Systems 2020-03-24 Rajesh K Mishra , Deepanshu Vasal , Sriram Vishwanath

Centralized training is widely utilized in the field of multi-agent reinforcement learning (MARL) to assure the stability of training process. Once a joint policy is obtained, it is critical to design a value function factorization method…

Artificial Intelligence · Computer Science 2023-11-02 Rizhong Wang , Huiping Li , Di Cui , Demin Xu

Centralized Training for Decentralized Execution, where agents are trained offline using centralized information but execute in a decentralized manner online, has gained popularity in the multi-agent reinforcement learning community. In…

Machine Learning · Computer Science 2021-12-06 Xueguang Lyu , Yuchen Xiao , Brett Daley , Christopher Amato

The primary objective of Multi-Agent Pathfinding (MAPF) is to plan efficient and conflict-free paths for all agents. Traditional multi-agent path planning algorithms struggle to achieve efficient distributed path planning for multiple…

Artificial Intelligence · Computer Science 2024-07-18 Zhenyu Song , Ronghao Zheng , Senlin Zhang , Meiqin Liu

In open multi-agent environments, the agents may encounter unexpected teammates. Classical multi-agent learning approaches train agents that can only coordinate with seen teammates. Recent studies attempted to generate diverse teammates to…

Multiagent Systems · Computer Science 2023-09-25 Lei Yuan , Lihe Li , Ziqian Zhang , Feng Chen , Tianyi Zhang , Cong Guan , Yang Yu , Zhi-Hua Zhou

A challenge in reinforcement learning (RL) is minimizing the cost of sampling associated with exploration. Distributed exploration reduces sampling complexity in multi-agent RL (MARL). We investigate the benefits to performance in MARL when…

Machine Learning · Computer Science 2022-05-03 Justin Lidard , Udari Madhushani , Naomi Ehrich Leonard

Multi-agent reinforcement learning (MARL) algorithms often suffer from an exponential sample complexity dependence on the number of agents, a phenomenon known as \emph{the curse of multiagents}. In this paper, we address this challenge by…

Machine Learning · Computer Science 2022-02-01 Weichao Mao , Lin F. Yang , Kaiqing Zhang , Tamer Başar

Decentralized execution is one core demand in multi-agent reinforcement learning (MARL). Recently, most popular MARL algorithms have adopted decentralized policies to enable decentralized execution, and use gradient descent as the…

Multiagent Systems · Computer Science 2025-12-30 Jianing Ye , Chenghao Li , Yongqiang Dou , Jianhao Wang , Guangwen Yang , Chongjie Zhang

A fundamental challenge in multi-agent reinforcement learning (MARL) is to learn the joint policy in an extremely large search space, which grows exponentially with the number of agents. Moreover, fully decentralized policy factorization…

Multiagent Systems · Computer Science 2024-01-24 Zhiyuan Li , Wenshuai Zhao , Lijun Wu , Joni Pajarinen

Multi-Agent Reinforcement Learning (MARL) has emerged as a foundational approach for addressing diverse, intelligent control tasks in various scenarios like the Internet of Vehicles, Internet of Things, and Unmanned Aerial Vehicles.…

Multiagent Systems · Computer Science 2024-10-15 Xiaoxue Yu , Rongpeng Li , Chengchao Liang , Zhifeng Zhao

Multi-agent reinforcement learning (MARL) has long been a significant and everlasting research topic in both machine learning and control. With the recent development of (single-agent) deep RL, there is a resurgence of interests in…

Machine Learning · Computer Science 2019-12-10 Kaiqing Zhang , Zhuoran Yang , Tamer Başar

Reinforcement learning in multi-agent scenarios is important for real-world applications but presents challenges beyond those seen in single-agent settings. We present an actor-critic algorithm that trains decentralized policies in…

Machine Learning · Computer Science 2019-05-29 Shariq Iqbal , Fei Sha

Value function factorization via centralized training and decentralized execution is promising for solving cooperative multi-agent reinforcement tasks. One of the approaches in this area, QMIX, has become state-of-the-art and achieved the…

Multiagent Systems · Computer Science 2023-07-27 Hanhan Zhou , Tian Lan , Vaneet Aggarwal

Multi-agent reinforcement learning tasks put a high demand on the volume of training samples. Different from its single-agent counterpart, distributed value-based multi-agent reinforcement learning faces the unique challenges of demanding…

Machine Learning · Computer Science 2021-12-06 Siyang Wu , Tonghan Wang , Chenghao Li , Yang Hu , Chongjie Zhang

Reinforcement Learning (RL) has emerged as a crucial method for training or fine-tuning large language models (LLMs), enabling adaptive, task-specific optimizations through interactive feedback. Multi-Agent Reinforcement Learning (MARL), in…

Machine Learning · Computer Science 2026-02-10 Junwei Su , Chuan Wu

Cooperative multi-agent reinforcement learning (MARL) under sparse rewards remains fundamentally challenging because agents often fail to concentrate their influence, leading to insufficiently coordinated exploration. To address this, we…

Machine Learning · Computer Science 2026-05-13 Yisak Park , Sunwoo Lee , Seungyul Han

As a data-driven approach, multi-agent reinforcement learning (MARL) has made remarkable advances in solving cooperative residential load scheduling problems. However, centralized training, the most common paradigm for MARL, limits…

Multiagent Systems · Computer Science 2025-03-05 Zhaoming Qin , Nanqing Dong , Di Liu , Zhefan Wang , Junwei Cao

A central problem in the theory of multi-agent reinforcement learning (MARL) is to understand what structural conditions and algorithmic principles lead to sample-efficient learning guarantees, and how these considerations change as we move…

Machine Learning · Computer Science 2023-05-02 Dylan J. Foster , Dean P. Foster , Noah Golowich , Alexander Rakhlin

Multi-Agent Path Finding (MAPF) is a fundamental coordination problem in large-scale robotic and cyber-physical systems, where multiple agents must compute conflict-free trajectories with limited computational and communication resources.…

Systems and Control · Electrical Eng. & Systems 2026-04-10 Kevin Riehl , Julius Schlapbach , Anastasios Kouvelas , Michail A. Makridis