English
Related papers

Related papers: Descent-Guided Policy Gradient for Scalable Cooper…

200 papers

Distributed learning has gained significant attention due to its advantages in scalability, privacy, and fault tolerance.In this paradigm, multiple agents collaboratively train a global model by exchanging parameters only with their…

Machine Learning · Computer Science 2026-03-31 Ziqin Chen , Yongqiang Wang

In this paper, a new offline actor-critic learning algorithm is introduced: Sampled Policy Gradient (SPG). SPG samples in the action space to calculate an approximated policy gradient by using the critic to evaluate the samples. This…

Artificial Intelligence · Computer Science 2018-09-18 Anton Orell Wiehe , Nil Stolt Ansó , Madalina M. Drugan , Marco A. Wiering

In multi-agent reinforcement learning (MARL), it is challenging for a collection of agents to learn complex temporally extended tasks. The difficulties lie in computational complexity and how to learn the high-level ideas behind reward…

Multiagent Systems · Computer Science 2021-10-04 Jueming Hu , Zhe Xu , Weichang Wang , Guannan Qu , Yutian Pang , Yongming Liu

A fundamental challenge in multiagent reinforcement learning is to learn beneficial behaviors in a shared environment with other simultaneously learning agents. In particular, each agent perceives the environment as effectively…

We consider the networked multi-agent reinforcement learning (MARL) problem in a fully decentralized setting, where agents learn to coordinate to achieve the joint success. This problem is widely encountered in many areas including traffic…

Machine Learning · Computer Science 2019-10-01 Chao Qu , Shie Mannor , Huan Xu , Yuan Qi , Le Song , Junwu Xiong

Multi-agent reinforcement learning (MARL) has long been a significant and everlasting research topic in both machine learning and control. With the recent development of (single-agent) deep RL, there is a resurgence of interests in…

Machine Learning · Computer Science 2019-12-10 Kaiqing Zhang , Zhuoran Yang , Tamer Başar

MADDPG is an algorithm in multi-agent reinforcement learning (MARL) that extends the popular single-agent method, DDPG, to multi-agent scenarios. Importantly, DDPG is an algorithm designed for continuous action spaces, where the gradient of…

Machine Learning · Computer Science 2023-06-16 Callum Rhys Tilbury , Filippos Christianos , Stefano V. Albrecht

As a data-driven approach, multi-agent reinforcement learning (MARL) has made remarkable advances in solving cooperative residential load scheduling problems. However, centralized training, the most common paradigm for MARL, limits…

Multiagent Systems · Computer Science 2025-03-05 Zhaoming Qin , Nanqing Dong , Di Liu , Zhefan Wang , Junwei Cao

Independent on-policy policy gradient algorithms are widely used for multi-agent reinforcement learning (MARL) in cooperative and no-conflict games, but they are known to converge sub-optimally when each agent's individual policy gradient…

Machine Learning · Computer Science 2026-05-14 Nicholas E. Corrado , Josiah P. Hanna

Collaborations among multiple organizations, such as financial institutions, medical centers, and retail markets in decentralized settings are crucial to providing improved service and performance. However, the underlying organizations may…

Machine Learning · Computer Science 2022-10-12 Enmao Diao , Jie Ding , Vahid Tarokh

Deep reinforcement learning algorithms have recently been used to train multiple interacting agents in a centralised manner whilst keeping their execution decentralised. When the agents can only acquire partial observations and are faced…

Machine Learning · Computer Science 2020-01-27 Emanuele Pesce , Giovanni Montana

Multi-agent Reinforcement Learning (MARL) is emerging as a key framework for various sequential decision-making and control tasks. Unlike their single-agent counterparts, multi-agent systems necessitate successful cooperation among the…

Multiagent Systems · Computer Science 2026-03-13 Jahir Sadik Monon , Deeparghya Dutta Barua , Md. Mosaddek Khan

Prompt engineering is crucial for fully leveraging large language models (LLMs), yet most existing optimization methods follow a single trajectory, resulting in limited adaptability, gradient conflicts, and high computational overhead. We…

Artificial Intelligence · Computer Science 2026-02-04 Yichen Han , Yuhang Han , Siteng Huang , Guanyu Liu , Zhengpeng Zhou , Bojun Liu , Yujia Zhang , Isaac N Shi , Lewei He , Tianyu Shi

Connected and autonomous vehicles across land, water, and air must often operate in dynamic, unpredictable environments with limited communication, no centralized control, and partial observability. These real-world constraints pose…

Multiagent Systems · Computer Science 2025-11-18 Hung Du , Hy Nguyen , Srikanth Thudumu , Rajesh Vasa , Kon Mouzakis

The domain of safe multi-agent reinforcement learning (MARL), despite its potential applications in areas ranging from drone delivery and vehicle automation to the development of zero-energy communities, remains relatively unexplored. The…

Multiagent Systems · Computer Science 2024-04-05 Raheeb Hassan , K. M. Shadman Wadith , Md. Mamun or Rashid , Md. Mosaddek Khan

We propose a fully distributed actor-critic algorithm approximated by deep neural networks, named \textit{Diff-DAC}, with application to single-task and to average multitask reinforcement learning (MRL). Each agent has access to data from…

In this paper, we explore using deep reinforcement learning for problems with multiple agents. Most existing methods for deep multi-agent reinforcement learning consider only a small number of agents. When the number of agents increases,…

Machine Learning · Computer Science 2018-05-24 Arbaaz Khan , Clark Zhang , Daniel D. Lee , Vijay Kumar , Alejandro Ribeiro

Multi-agent reinforcement learning (MARL) holds substantial promise for intelligent decision-making in complex environments. However, it suffers from a coordination and scalability bottleneck as the number of agents increases. To address…

Multiagent Systems · Computer Science 2025-09-19 Tianyang Duan , Zongyuan Zhang , Songxiao Guo , Dong Huang , Yuanye Zhao , Zheng Lin , Zihan Fang , Dianxin Luan , Heming Cui , Yong Cui

Decentralized learning over distributed datasets can have significantly different data distributions across the agents. The current state-of-the-art decentralized algorithms mostly assume the data distributions to be Independent and…

Machine Learning · Computer Science 2023-03-22 Sai Aparna Aketi , Sangamesh Kodge , Kaushik Roy

The aim of decentralized gradient descent (DGD) is to minimize a sum of $n$ functions held by interconnected agents. We study the stability of DGD in open contexts where agents can join or leave the system, resulting each time in the…

Optimization and Control · Mathematics 2020-09-14 Julien M. Hendrickx , Michael G. Rabbat