English
Related papers

Related papers: Fully-Decentralized MADDPG with Networked Agents

200 papers

This paper introduces an information-theoretic constraint on learned policy complexity in the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) reinforcement learning algorithm. Previous research with a related approach in continuous…

Artificial Intelligence · Computer Science 2025-05-16 Tailia Malloy , Tim Klinger , Miao Liu , Matthew Riemer , Gerald Tesauro , Chris R. Sims

In decentralized cooperative multi-agent reinforcement learning, agents can aggregate information from one another to learn policies that maximize a team-average objective function. Despite the willingness to cooperate with others, the…

Systems and Control · Electrical Eng. & Systems 2022-07-27 Martin Figura , Yixuan Lin , Ji Liu , Vijay Gupta

Multi-agent reinforcement learning (MARL) has long been a significant and everlasting research topic in both machine learning and control. With the recent development of (single-agent) deep RL, there is a resurgence of interests in…

Machine Learning · Computer Science 2019-12-10 Kaiqing Zhang , Zhuoran Yang , Tamer Başar

We explore deep reinforcement learning methods for multi-agent domains. We begin by analyzing the difficulty of traditional algorithms in the multi-agent case: Q-learning is challenged by an inherent non-stationarity of the environment,…

Machine Learning · Computer Science 2020-03-17 Ryan Lowe , Yi Wu , Aviv Tamar , Jean Harb , Pieter Abbeel , Igor Mordatch

In many real-world multi-robot tasks, high-quality solutions often require a team of robots to perform asynchronous actions under decentralized control. Decentralized multi-agent reinforcement learning methods have difficulty learning…

Robotics · Computer Science 2020-03-05 Yuchen Xiao , Joshua Hoffman , Tian Xia , Christopher Amato

Traditional centralized multi-agent reinforcement learning (MARL) algorithms are sometimes unpractical in complicated applications, due to non-interactivity between agents, curse of dimensionality and computation complexity. Hence, several…

Machine Learning · Computer Science 2023-07-10 Wenhao Li , Bo Jin , Xiangfeng Wang , Junchi Yan , Hongyuan Zha

In this paper, we explore using deep reinforcement learning for problems with multiple agents. Most existing methods for deep multi-agent reinforcement learning consider only a small number of agents. When the number of agents increases,…

Machine Learning · Computer Science 2018-05-24 Arbaaz Khan , Clark Zhang , Daniel D. Lee , Vijay Kumar , Alejandro Ribeiro

Cooperative problems under continuous control have always been the focus of multi-agent reinforcement learning. Existing algorithms suffer from the problem of uneven learning degree with the increase of the number of agents. In this paper,…

Multiagent Systems · Computer Science 2021-07-05 Kai Liu , Yuyang Zhao , Gang Wang , Bei Peng

This paper considers a distributed reinforcement learning problem in which a network of multiple agents aim to cooperatively maximize the globally averaged return through communication with only local neighbors. A randomized…

Machine Learning · Computer Science 2019-07-09 Yixuan Lin , Kaiqing Zhang , Zhuoran Yang , Zhaoran Wang , Tamer Başar , Romeil Sandhu , Ji Liu

Finding feasible, collision-free paths for multiagent systems can be challenging, particularly in non-communicating scenarios where each agent's intent (e.g. goal) is unobservable to the others. In particular, finding time efficient paths…

Multiagent Systems · Computer Science 2016-09-29 Yu Fan Chen , Miao Liu , Michael Everett , Jonathan P. How

This article reviews recent advances in multi-agent reinforcement learning algorithms for large-scale control systems and communication networks, which learn to communicate and cooperate. We provide an overview of this emerging field, with…

Machine Learning · Computer Science 2020-06-24 Donghwan Lee , Niao He , Parameswaran Kamalaruban , Volkan Cevher

Most previous studies on multi-agent reinforcement learning focus on deriving decentralized and cooperative policies to maximize a common reward and rarely consider the transferability of trained policies to new tasks. This prevents such…

Machine Learning · Computer Science 2019-11-28 Heechang Ryu , Hayong Shin , Jinkyoo Park

Current approaches to multi-agent cooperation rely heavily on centralized mechanisms or explicit communication protocols to ensure convergence. This paper studies the problem of distributed multi-agent learning without resorting to…

Multiagent Systems · Computer Science 2025-08-19 Caroline Wang , Ishan Durugkar , Elad Liebman , Peter Stone

Although multi-agent reinforcement learning can tackle systems of strategically interacting entities, it currently fails in scalability and lacks rigorous convergence guarantees. Crucially, learning in multi-agent systems can become…

Multiagent Systems · Computer Science 2018-03-15 David Mguni , Joel Jennings , Enrique Munoz de Cote

In this paper, we propose a distributed off-policy actor critic method to solve multi-agent reinforcement learning problems. Specifically, we assume that all agents keep local estimates of the global optimal policy parameter and update…

Machine Learning · Computer Science 2019-03-25 Yan Zhang , Michael M. Zavlanos

We propose an efficient multi-agent reinforcement learning approach to derive equilibrium strategies for multi-agents who are participating in a Markov game. Mainly, we are focused on obtaining decentralized policies for agents to maximize…

Multiagent Systems · Computer Science 2018-10-23 Heechang Ryu , Hayong Shin , Jinkyoo Park

Reinforcement learning (RL) algorithms can find an optimal policy for a single agent to accomplish a particular task. However, many real-world problems require multiple agents to collaborate in order to achieve a common goal. For example, a…

Machine Learning · Computer Science 2025-10-20 Jan Corazza , Hadi Partovi Aria , Hyohun Kim , Daniel Neider , Zhe Xu

This paper studies a policy optimization problem arising from collaborative multi-agent reinforcement learning in a decentralized setting where agents communicate with their neighbors over an undirected graph to maximize the sum of their…

Optimization and Control · Mathematics 2022-09-07 Jinchi Chen , Jie Feng , Weiguo Gao , Ke Wei

Almost all multi-agent reinforcement learning algorithms without communication follow the principle of centralized training with decentralized execution. During centralized training, agents can be guided by the same signals, such as the…

Multiagent Systems · Computer Science 2022-12-08 Zhiwei Xu , Bin Zhang , Dapeng Li , Zeren Zhang , Guangchong Zhou , Hao Chen , Guoliang Fan

[Zhang, ICML 2018] provided the first decentralized actor-critic algorithm for multi-agent reinforcement learning (MARL) that offers convergence guarantees. In that work, policies are stochastic and are defined on finite action spaces. We…

Machine Learning · Computer Science 2021-02-22 Antoine Grosnit , Desmond Cai , Laura Wynter