English
Related papers

Related papers: Distributed Neural Policy Gradient Algorithm for G…

200 papers

Multi-agent actor-critic algorithms are an important part of the Reinforcement Learning paradigm. We propose three fully decentralized multi-agent natural actor-critic (MAN) algorithms in this work. The objective is to collectively find a…

Machine Learning · Computer Science 2022-04-05 Prashant Trivedi , Nandyala Hemachandra

Handling the problem of scalability is one of the essential issues for multi-agent reinforcement learning (MARL) algorithms to be applied to real-world problems typically involving massively many agents. For this, parameter sharing across…

Multiagent Systems · Computer Science 2023-03-03 Woojun Kim , Youngchul Sung

For Industry 4.0 Revolution, cooperative autonomous mobility systems are widely used based on multi-agent reinforcement learning (MARL). However, the MARL-based algorithms suffer from huge parameter utilization and convergence difficulties…

Multiagent Systems · Computer Science 2023-08-04 Soohyun Park , Jae Pyoung Kim , Chanyoung Park , Soyi Jung , Joongheon Kim

In this work, we investigate constrained multi-agent reinforcement learning (CMARL), where agents collaboratively maximize the sum of their local objectives while satisfying individual safety constraints. We propose a framework where agents…

Multiagent Systems · Computer Science 2025-11-20 Pengcheng Dai , He Wang , Dongming Wang , Wenwu Yu

Multiagent reinforcement learning algorithms (MARL) have been demonstrated on complex tasks that require the coordination of a team of multiple agents to complete. Existing works have focused on sharing information between agents via…

Machine Learning · Computer Science 2019-03-18 Samir Wadhwania , Dong-Ki Kim , Shayegan Omidshafiei , Jonathan P. How

The recent success of single-agent reinforcement learning (RL) in Internet of things (IoT) systems motivates the study of multi-agent reinforcement learning (MARL), which is more challenging but more useful in large-scale IoT. In this…

Machine Learning · Computer Science 2020-09-01 Yue Xu , Zengde Deng , Mengdi Wang , Wenjun Xu , Anthony Man-Cho So , Shuguang Cui

This paper considers a distributed reinforcement learning problem in which a network of multiple agents aim to cooperatively maximize the globally averaged return through communication with only local neighbors. A randomized…

Machine Learning · Computer Science 2019-07-09 Yixuan Lin , Kaiqing Zhang , Zhuoran Yang , Zhaoran Wang , Tamer Başar , Romeil Sandhu , Ji Liu

In this paper, we explore using deep reinforcement learning for problems with multiple agents. Most existing methods for deep multi-agent reinforcement learning consider only a small number of agents. When the number of agents increases,…

Machine Learning · Computer Science 2018-05-24 Arbaaz Khan , Clark Zhang , Daniel D. Lee , Vijay Kumar , Alejandro Ribeiro

Existing distributed cooperative multi-agent reinforcement learning (MARL) frameworks usually assume undirected coordination graphs and communication graphs while estimating a global reward via consensus algorithms for policy evaluation.…

Multiagent Systems · Computer Science 2022-01-14 Gangshan Jing , He Bai , Jemin George , Aranya Chakrabortty , Piyush. K. Sharma

Scaling cooperative multi-agent reinforcement learning (MARL) is fundamentally limited by cross-agent noise. When agents share a common reward, each agent's learning signal is computed from a shared return that depends on all agents, so the…

Multiagent Systems · Computer Science 2026-05-06 Shan Yang , Yang Liu

Most multi-agent reinforcement learning (MARL) methods are limited in the scale of problems they can handle. With increasing numbers of agents, the number of training iterations required to find the optimal behaviors increases exponentially…

Multiagent Systems · Computer Science 2025-01-03 Baoqian Wang , Junfei Xie , Nikolay Atanasov

Stochastic games are a popular framework for studying multi-agent reinforcement learning (MARL). Recent advances in MARL have focused primarily on games with finitely many states. In this work, we study multi-agent learning in stochastic…

Machine Learning · Computer Science 2024-03-28 Awni Altabaa , Bora Yongacoglu , Serdar Yüksel

We consider the problem of learning fair policies in (deep) cooperative multi-agent reinforcement learning (MARL). We formalize it in a principled way as the problem of optimizing a welfare function that explicitly encodes two important…

Machine Learning · Computer Science 2021-06-23 Matthieu Zimmer , Claire Glanois , Umer Siddique , Paul Weng

We study the scalable multi-agent reinforcement learning (MARL) with general utilities, defined as nonlinear functions of the team's long-term state-action occupancy measure. The objective is to find a localized policy that maximizes the…

Machine Learning · Computer Science 2023-08-29 Donghao Ying , Yuhao Ding , Alec Koppel , Javad Lavaei

This paper proposes a scalable distributed policy gradient method and proves its convergence to near-optimal solution in multi-agent linear quadratic networked systems. The agents engage within a specified network under local communication…

Multiagent Systems · Computer Science 2024-03-06 Yuzi Yan , Yuan Shen

This paper presents a novel approach to Multi-Agent Reinforcement Learning (MARL) that combines cooperative task decomposition with the learning of reward machines (RMs) encoding the structure of the sub-tasks. The proposed method helps…

Artificial Intelligence · Computer Science 2025-02-17 Leo Ardon , Daniel Furelos-Blanco , Alessandra Russo

Designing efficient algorithms for multi-agent reinforcement learning (MARL) is fundamentally challenging because the size of the joint state and action spaces grows exponentially in the number of agents. These difficulties are exacerbated…

Machine Learning · Computer Science 2025-10-27 Emile Anand , Ishani Karmarkar , Guannan Qu

Collaboration is a key challenge in distributed multi-agent reinforcement learning (MARL) environments. Learning frameworks for these decentralized systems must weigh the benefits of explicit player coordination against the communication…

Quantum Physics · Physics 2025-02-21 Alexander DeRieux , Walid Saad

Multi-agent reinforcement learning has drawn increasing attention in practice, e.g., robotics and automatic driving, as it can explore optimal policies using samples generated by interacting with the environment. However, high reward…

Machine Learning · Computer Science 2022-10-17 Jifeng Hu , Yanchao Sun , Hechang Chen , Sili Huang , haiyin piao , Yi Chang , Lichao Sun

Many recent successful off-policy multi-agent reinforcement learning (MARL) algorithms for cooperative partially observable environments focus on finding factorized value functions, leading to convoluted network structures. Building on the…

Machine Learning · Computer Science 2023-10-27 Raphaël Avalos , Mathieu Reymond , Ann Nowé , Diederik M. Roijers