English
Related papers

Related papers: Learning Cooperative Multi-Agent Policies with Par…

200 papers

Real-world multi-agent tasks usually involve dynamic team composition with the emergence of roles, which should also be a key to efficient cooperation in multi-agent reinforcement learning (MARL). Drawing inspiration from the correlation…

Multiagent Systems · Computer Science 2024-03-05 Zican Hu , Zongzhang Zhang , Huaxiong Li , Chunlin Chen , Hongyu Ding , Zhi Wang

This paper studies a class of multi-agent reinforcement learning (MARL) problems where the reward that an agent receives depends on the states of other agents, but the next state only depends on the agent's own current state and action. We…

Multiagent Systems · Computer Science 2023-05-16 Xin Liu , Honghao Wei , Lei Ying

Multi-agent reinforcement learning holds the key for solving complex tasks that demand the coordination of learning agents. However, strong coordination often leads to expensive exploration over the exponentially large state-action space. A…

Machine Learning · Computer Science 2022-04-28 Dung Nguyen , Phuoc Nguyen , Svetha Venkatesh , Truyen Tran

Training cooperative agents in sparse-reward scenarios poses significant challenges for multi-agent reinforcement learning (MARL). Without clear feedback on actions at each step in sparse-reward setting, previous methods struggle with…

Machine Learning · Computer Science 2025-05-14 Shuai Han , Mehdi Dastani , Shihan Wang

The domain of safe multi-agent reinforcement learning (MARL), despite its potential applications in areas ranging from drone delivery and vehicle automation to the development of zero-energy communities, remains relatively unexplored. The…

Multiagent Systems · Computer Science 2024-04-05 Raheeb Hassan , K. M. Shadman Wadith , Md. Mamun or Rashid , Md. Mosaddek Khan

In this paper, we explore using deep reinforcement learning for problems with multiple agents. Most existing methods for deep multi-agent reinforcement learning consider only a small number of agents. When the number of agents increases,…

Machine Learning · Computer Science 2018-05-24 Arbaaz Khan , Clark Zhang , Daniel D. Lee , Vijay Kumar , Alejandro Ribeiro

In this paper, we study the cooperative Multi-Agent Reinforcement Learning (MARL) problems using Reward Machines (RMs) to specify the reward functions such that the prior knowledge of high-level events in a task can be leveraged to…

Artificial Intelligence · Computer Science 2024-03-13 Xuejing Zheng , Chao Yu

A large amount of work has been done in Multi-Agent Systems (MAS) for modeling and solving problems with multiple interacting agents. However, most LLMs are pretrained independently and not specifically optimized for coordination. Existing…

Artificial Intelligence · Computer Science 2025-12-10 Shuo Liu , Tianle Chen , Zeyu Liang , Xueguang Lyu , Christopher Amato

In this paper, we devise three actor-critic algorithms with decentralized training for multi-agent reinforcement learning in cooperative, adversarial, and mixed settings with continuous action spaces. To this goal, we adapt the MADDPG…

Machine Learning · Computer Science 2025-03-11 Diego Bolliger , Lorenz Zauter , Robert Ziegler

Many real-world problems, such as network packet routing and urban traffic control, are naturally modeled as multi-agent reinforcement learning (RL) problems. However, existing multi-agent RL methods typically scale poorly in the problem…

Artificial Intelligence · Computer Science 2018-05-22 Jakob Foerster , Nantas Nardelli , Gregory Farquhar , Triantafyllos Afouras , Philip H. S. Torr , Pushmeet Kohli , Shimon Whiteson

This work considers the problem of learning cooperative policies in multi-agent settings with partially observable and non-stationary environments without a communication channel. We focus on improving information sharing between agents and…

Machine Learning · Computer Science 2021-09-03 Eshagh Kargar , Ville Kyrki

In this paper, we consider the problem of large scale multi agent reinforcement learning. Firstly, we studied the representation problem of the pairwise value function to reduce the complexity of the interactions among agents. Secondly, we…

Machine Learning · Computer Science 2020-01-13 Weiya Ren

In cooperative multi-agent reinforcement learning (MARL), combining value decomposition with actor-critic enables agents to learn stochastic policies, which are more suitable for the partially observable environment. Given the goal of…

Machine Learning · Computer Science 2023-02-13 Jiangxing Wang , Deheng Ye , Zongqing Lu

Reinforcement learning, mathematically described by Markov Decision Problems, may be approached either through dynamic programming or policy search. Actor-critic algorithms combine the merits of both approaches by alternating between steps…

Machine Learning · Computer Science 2023-01-31 Harshat Kumar , Alec Koppel , Alejandro Ribeiro

Existing agents for solving tasks such as ML engineering rely on prompting powerful language models. As a result, these agents do not improve with more experience. In this paper, we show that agents backed by weaker models that improve via…

Machine Learning · Computer Science 2025-09-04 Sherry Yang , Joy He-Yueya , Percy Liang

Credit assignment in reinforcement learning is the problem of measuring an action's influence on future rewards. In particular, this requires separating skill from luck, i.e. disentangling the effect of an action on rewards from that of…

Training for multi-agent reinforcement learning(MARL) is a time-consuming process caused by distribution shift of each agent. One drawback is that strategy of each agent in MARL is independent but actually in cooperation. Thus, a vertical…

Artificial Intelligence · Computer Science 2024-03-06 Ke Zhang , DanDan Zhu , Qiuhan Xu , Hao Zhou , Ce Zheng

SOTA multiagent reinforcement algorithms distinguish themselves in many ways from their single-agent equivalences. However, most of them still totally inherit the single-agent exploration-exploitation strategy. Naively inheriting this…

Artificial Intelligence · Computer Science 2023-12-06 Qingxu Fu , Tenghai Qiu , Jianqiang Yi , Zhiqiang Pu , Xiaolin Ai , Wanmai Yuan

Single-task RL agents are typically trained under a fixed reward function, which limits their robustness to reward misspecification and their ability to adapt to changing preferences. We introduce Reward-Conditioned Reinforcement Learning…

Machine Learning · Computer Science 2026-05-20 Michal Nauman , Marek Cygan , Pieter Abbeel

[Zhang, ICML 2018] provided the first decentralized actor-critic algorithm for multi-agent reinforcement learning (MARL) that offers convergence guarantees. In that work, policies are stochastic and are defined on finite action spaces. We…

Machine Learning · Computer Science 2021-02-22 Antoine Grosnit , Desmond Cai , Laura Wynter