English
Related papers

Related papers: Decentralized Multi-Agent Actor-Critic with Genera…

200 papers

Centralised training with decentralised execution (CT-DE) serves as the foundation of many leading multi-agent reinforcement learning (MARL) algorithms. Despite its popularity, it suffers from a critical drawback due to its reliance on…

Multiagent Systems · Computer Science 2023-06-23 Taher Jafferjee , Juliusz Ziomek , Tianpei Yang , Zipeng Dai , Jianhong Wang , Matthew Taylor , Kun Shao , Jun Wang , David Mguni

In many real-world settings, a team of agents must coordinate their behaviour while acting in a decentralised way. At the same time, it is often possible to train the agents in a centralised fashion in a simulated or laboratory setting,…

Centralized training with decentralized execution (CTDE) is a widely-used learning paradigm that has achieved significant success in complex tasks. However, partial observability issues and the absence of effectively shared signals between…

Multiagent Systems · Computer Science 2023-05-01 Dapeng Li , Zhiwei Xu , Bin Zhang , Guoliang Fan

Most works on multi-agent reinforcement learning focus on scenarios where the state of the environment is fully observable. In this work, we consider a cooperative policy evaluation task in which agents are not assumed to observe the…

Machine Learning · Computer Science 2023-05-17 Mert Kayaalp , Fatima Ghadieh , Ali H. Sayed

Efforts in this paper seek to combine graph theory with adaptive dynamic programming (ADP) as a reinforcement learning (RL) framework to determine forward-in-time, real-time, approximate optimal controllers for distributed multi-agent…

Systems and Control · Computer Science 2017-07-25 Rushikesh Kamalapurkar , Huyen Dinh , Patrick Walters , Warren Dixon

Multi-agent reinforcement learning (MARL) has long been a significant and everlasting research topic in both machine learning and control. With the recent development of (single-agent) deep RL, there is a resurgence of interests in…

Machine Learning · Computer Science 2019-12-10 Kaiqing Zhang , Zhuoran Yang , Tamer Başar

Multiagent reinforcement learning algorithms have not been widely adopted in large scale environments with many agents as they often scale poorly with the number of agents. Using mean field theory to aggregate agents has been proposed as a…

Multiagent Systems · Computer Science 2022-04-14 Sriram Ganapathi Subramanian , Matthew E. Taylor , Mark Crowley , Pascal Poupart

The purpose of this report is to define abstractions for multi-agent systems under coupled constraints. In the proposed decentralized framework, we specify a finite or countable transition system for each agent which only takes into account…

Systems and Control · Computer Science 2015-03-02 Dimitris Boskos , Dimos V. Dimarogonas

To integrate high amounts of renewable energy resources, electrical power grids must be able to cope with high amplitude, fast timescale variations in power generation. Frequency regulation through demand response has the potential to…

Multiagent Systems · Computer Science 2023-01-09 Vincent Mai , Philippe Maisonneuve , Tianyu Zhang , Hadi Nekoei , Liam Paull , Antoine Lesage-Landry

Multiagent reinforcement learning, as a prominent intelligent paradigm, enables collaborative decision-making within complex systems. However, existing approaches often rely on explicit action exchange between agents to evaluate action…

Robotics · Computer Science 2026-01-09 Zhenglong Luo , Zhiyong Chen , Aoxiang Liu

Deep reinforcement learning methods have shown great performance on many challenging cooperative multi-agent tasks. Two main promising research directions are multi-agent value function decomposition and multi-agent policy gradients. In…

Artificial Intelligence · Computer Science 2021-05-11 Yuan Pu , Shaochen Wang , Rui Yang , Xin Yao , Bin Li

Large transformer models, trained on diverse datasets, have demonstrated impressive few-shot performance on previously unseen tasks without requiring parameter updates. This capability has also been explored in Reinforcement Learning (RL),…

Multiagent Systems · Computer Science 2026-04-02 Tao Jiang , Zichuan Lin , Lihe Li , Yi-Chen Li , Cong Guan , Lei Yuan , Zongzhang Zhang , Yang Yu , Deheng Ye

Decentralized planning is a key element of cooperative multi-agent systems for information gathering tasks. However, despite the high frequency of agent failures in realistic large deployment scenarios, current approaches perform poorly in…

Multiagent Systems · Computer Science 2024-09-04 Nhat Nguyen , Duong Nguyen , Gianluca Rizzo , Hung Nguyen

Multi-agent reinforcement learning (MARL) has emerged as a promising paradigm for adaptive traffic signal control (ATSC) of multiple intersections. Existing approaches typically follow either a fully centralized or a fully decentralized…

Multiagent Systems · Computer Science 2026-03-31 Arash Rezaali , Pouria Yazdani , Monireh Abdoos

In this paper we investigate multi-agent discrete-event systems with partial observation. The agents can be divided into several groups in each of which the agents have similar (isomorphic) state transition structures, and thus can be…

Systems and Control · Electrical Eng. & Systems 2021-03-22 Yingying Liu , Jan Komenda , Zhiwu Li

Extracting relevant information from a stream of high-dimensional observations is a central challenge for deep reinforcement learning agents. Actor-critic algorithms add further complexity to this challenge, as it is often unclear whether…

There are several real-world tasks that would benefit from applying multiagent reinforcement learning (MARL) algorithms, including the coordination among self-driving cars. The real world has challenging conditions for multiagent learning…

Multiagent Systems · Computer Science 2020-02-19 Rose E. Wang , Michael Everett , Jonathan P. How

This paper addresses the considerations that comes along with adopting decentralized communication for multi-agent localization applications in discrete state spaces. In this framework, we extend the original formulation of the Bayes…

Multiagent Systems · Computer Science 2023-01-24 Dom Huh , Prasant Mohapatra

Multi-agent systems cooperation to achieve global goals is usually limited by sensing, actuation, and communication issues. At the local level, continuous measurement and actuation is only approximated by the use of digital mechanisms that…

Optimization and Control · Mathematics 2016-11-18 Eloy Garcia , Yongcan Cao , David W. Casbeer

Action and observation delays commonly occur in many Reinforcement Learning applications, such as remote control scenarios. We study the anatomy of randomly delayed environments, and show that partially resampling trajectory fragments in…

Machine Learning · Computer Science 2021-05-06 Simon Ramstedt , Yann Bouteiller , Giovanni Beltrame , Christopher Pal , Jonathan Binas