English
Related papers

Related papers: Communication-Efficient Actor-Critic Methods for H…

200 papers

Exploration in multi-agent reinforcement learning is a challenging problem, especially in environments with sparse rewards. We propose a general method for efficient exploration by sharing experience amongst agents. Our proposed algorithm,…

Multiagent Systems · Computer Science 2021-05-20 Filippos Christianos , Lukas Schäfer , Stefano V. Albrecht

Multi-agent reinforcement learning (MARL) has emerged as a useful approach to solving decentralised decision-making problems at scale. Research in the field has been growing steadily with many breakthrough algorithms proposed in recent…

Machine Learning · Computer Science 2022-09-22 Rihab Gorsane , Omayma Mahjoub , Ruan de Kock , Roland Dubb , Siddarth Singh , Arnu Pretorius

Multi-agent reinforcement learning (MARL) methods have achieved state-of-the-art results on a range of multi-agent tasks. Yet, MARL algorithms typically require significantly more environment interactions than their single-agent…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Tom Danino , Nahum Shimkin

In many real-world problems, a team of agents need to collaborate to maximize the common reward. Although existing works formulate this problem into a centralized learning with decentralized execution framework, which avoids the…

Multiagent Systems · Computer Science 2019-11-21 Liheng Chen , Hongyi Guo , Yali Du , Fei Fang , Haifeng Zhang , Yaoming Zhu , Ming Zhou , Weinan Zhang , Qing Wang , Yong Yu

Learning stationary policies in infinite-horizon general-sum Markov games (MGs) remains a fundamental open problem in Multi-Agent Reinforcement Learning (MARL). While stationary strategies are preferred for their practicality, computing…

Multiagent Systems · Computer Science 2026-02-16 Yizhou Zhang , Eric Mazumdar

Coordinating actions is the most fundamental form of cooperation in multi-agent reinforcement learning (MARL). Successful decentralized decision-making often depends not only on good individual actions, but on selecting compatible actions…

Machine Learning · Computer Science 2026-02-24 Nikunj Gupta , James Zachary Hare , Jesse Milzman , Rajgopal Kannan , Viktor Prasanna

Communication is essential for the collective execution of complex tasks by human agents, motivating interest in communication mechanisms for multi-agent reinforcement learning (MARL). However, existing communication protocols in MARL are…

Machine Learning · Computer Science 2026-01-26 Maciej Wojtala , Bogusz Stefańczyk , Dominik Bogucki , Łukasz Lepak , Jakub Strykowski , Paweł Wawrzyński

Large language models (LLMs) have demonstrated a remarkable ability to serve as general-purpose tools for various language-based tasks. Recent works have demonstrated that the efficacy of such models can be improved through iterative dialog…

Computation and Language · Computer Science 2025-03-07 Andrew Estornell , Jean-Francois Ton , Yuanshun Yao , Yang Liu

Multi-agent actor-critic algorithms are an important part of the Reinforcement Learning paradigm. We propose three fully decentralized multi-agent natural actor-critic (MAN) algorithms in this work. The objective is to collectively find a…

Machine Learning · Computer Science 2022-04-05 Prashant Trivedi , Nandyala Hemachandra

Cooperative MARL often assumes frequent access to global information in a data buffer, such as team rewards or other agents' actions, which is typically unrealistic in decentralized MARL systems due to high communication costs. When…

Machine Learning · Computer Science 2026-01-21 Nuoya Xiong , Aarti Singh

This paper proposes a reinforcement learning (RL)-based backstepping control strategy to achieve fixed time consensus in nonlinear multi-agent systems with strict feedback dynamics. Agents exchange only output information with their…

Systems and Control · Electrical Eng. & Systems 2025-07-23 Aria Delshad , Maryam Babazadeh

While multi-agent reinforcement learning (MARL) has produced numerous algorithms that converge to Nash or related equilibria, such equilibria are often non-unique and can exhibit widely varying efficiency. This raises a fundamental…

Computer Science and Game Theory · Computer Science 2026-01-29 Runyu Zhang , Gioele Zardini , Asuman Ozdaglar , Jeff Shamma , Na Li

Multi-Agent Reinforcement Learning (MARL) methods have shown promise in enabling agents to learn a shared communication protocol from scratch and accomplish challenging team tasks. However, the learned language is usually not interpretable…

We consider model-based multi-agent reinforcement learning, where the environment transition model is unknown and can only be learned via expensive interactions with the environment. We propose H-MARL (Hallucinated Multi-Agent Reinforcement…

Machine Learning · Computer Science 2022-07-12 Pier Giuseppe Sessa , Maryam Kamgarpour , Andreas Krause

Multi-agent reinforcement learning (MARL) has achieved great progress in cooperative tasks in recent years. However, in the local reward scheme, where only local rewards for each agent are given without global rewards shared by all the…

Machine Learning · Computer Science 2023-02-21 Yunbo Qiu , Yue Jin , Lebin Yu , Jian Wang , Xudong Zhang

Centralized training with decentralized execution (CTDE) is a widely-used learning paradigm that has achieved significant success in complex tasks. However, partial observability issues and the absence of effectively shared signals between…

Multiagent Systems · Computer Science 2023-05-01 Dapeng Li , Zhiwei Xu , Bin Zhang , Guoliang Fan

We consider multi-agent reinforcement learning (MARL) for cooperative communication and coordination tasks. MARL agents can be brittle because they can overfit their training partners' policies. This overfitting can produce agents that…

Artificial Intelligence · Computer Science 2022-03-08 Tessa van der Heiden , Herke van Hoof , Efstratios Gavves , Christoph Salge

In typical multi-agent reinforcement learning (MARL) problems, communication is important for agents to share information and make the right decisions. However, due to the complexity of training multi-agent communication, existing methods…

Multiagent Systems · Computer Science 2025-05-01 Xuyan Ma , Yawen Wang , Junjie Wang , Xiaofei Xie , Boyu Wu , Shoubin Li , Fanjiang Xu , Qing Wang

Efficient information dissemination is crucial for supporting critical operations across domains like disaster response, autonomous vehicles, and sensor networks. This paper introduces a Multi-Agent Reinforcement Learning (MARL) approach as…

Machine Learning · Computer Science 2024-02-22 Raffaele Galliera , Kristen Brent Venable , Matteo Bassani , Niranjan Suri

This paper considers a distributed reinforcement learning problem in which a network of multiple agents aim to cooperatively maximize the globally averaged return through communication with only local neighbors. A randomized…

Machine Learning · Computer Science 2019-07-09 Yixuan Lin , Kaiqing Zhang , Zhuoran Yang , Zhaoran Wang , Tamer Başar , Romeil Sandhu , Ji Liu