English
Related papers

Related papers: Taming Multi-Agent Reinforcement Learning with Est…

200 papers

Current value-based multi-agent reinforcement learning methods optimize individual Q values to guide individuals' behaviours via centralized training with decentralized execution (CTDE). However, such expected, i.e., risk-neutral, Q value…

Machine Learning · Computer Science 2021-03-23 Wei Qiu , Xinrun Wang , Runsheng Yu , Xu He , Rundong Wang , Bo An , Svetlana Obraztsova , Zinovi Rabinovich

Large sequence model (SM) such as GPT series and BERT has displayed outstanding performance and generalization capabilities on vision, language, and recently reinforcement learning tasks. A natural follow-up question is how to abstract…

Multiagent Systems · Computer Science 2022-10-31 Muning Wen , Jakub Grudzien Kuba , Runji Lin , Weinan Zhang , Ying Wen , Jun Wang , Yaodong Yang

Multi-agent reinforcement learning (MARL) commonly relies on a centralized critic to estimate the value function. However, learning such a critic from scratch is highly sample-inefficient and often lacks generalization across environments.…

Robotics · Computer Science 2026-03-17 Shahil Shaik , Aditya Parameshwaran , Anshul Nayak , Jonathon M. Smereka , Yue Wang

In cooperative multi-agent reinforcement learning (c-MARL), agents learn to cooperatively take actions as a team to maximize a total team reward. We analyze the robustness of c-MARL to adversaries capable of attacking one of the agents on a…

Machine Learning · Computer Science 2020-03-10 Jieyu Lin , Kristina Dzeparoska , Sai Qian Zhang , Alberto Leon-Garcia , Nicolas Papernot

In tabular multi-agent reinforcement learning with average-cost criterion, a team of agents sequentially interacts with the environment and observes local incentives. We focus on the case that the global reward is a sum of local rewards,…

Optimization and Control · Mathematics 2021-10-26 Alec Koppel , Amrit Singh Bedi , Bhargav Ganguly , Vaneet Aggarwal

The number of agents can be an effective curriculum variable for controlling the difficulty of multi-agent reinforcement learning (MARL) tasks. Existing work typically uses manually defined curricula such as linear schemes. We identify two…

Artificial Intelligence · Computer Science 2025-05-16 Wenshuai Zhao , Zhiyuan Li , Joni Pajarinen

Many real world tasks require multiple agents to work together. Multi-agent reinforcement learning (RL) methods have been proposed in recent years to solve these tasks, but current methods often fail to efficiently learn policies. We thus…

Machine Learning · Computer Science 2019-12-03 Johannes Ackermann , Volker Gabler , Takayuki Osa , Masashi Sugiyama

Recent reinforcement learning (RL) methods have achieved success in various domains. However, multi-agent RL (MARL) remains a challenge in terms of decentralization, partial observability and scalability to many agents. Meanwhile,…

Machine Learning · Computer Science 2024-02-26 Kai Cui , Sascha Hauck , Christian Fabian , Heinz Koeppl

Recent advances in learnable reward shaping have shown promise in single-agent reinforcement learning by automatically discovering effective feedback signals. However, the effectiveness of decentralized learnable reward shaping in…

Multiagent Systems · Computer Science 2025-11-04 Aditya Akella

Cooperative multi-agent reinforcement learning (MARL) has achieved significant results, most notably by leveraging the representation-learning abilities of deep neural networks. However, large centralized approaches quickly become…

Multiagent Systems · Computer Science 2022-12-05 Nikunj Gupta , G Srinivasaraghavan , Swarup Kumar Mohalik , Nishant Kumar , Matthew E. Taylor

Significant advances have recently been achieved in Multi-Agent Reinforcement Learning (MARL) which tackles sequential decision-making problems involving multiple participants. However, MARL requires a tremendous number of samples for…

Multiagent Systems · Computer Science 2024-12-30 Xihuai Wang , Zhicheng Zhang , Weinan Zhang

Due to the partial observability and communication constraints in many multi-agent reinforcement learning (MARL) tasks, centralized training with decentralized execution (CTDE) has become one of the most widely used MARL paradigms. In CTDE,…

Multiagent Systems · Computer Science 2022-03-17 Jian Zhao , Xunhan Hu , Mingyu Yang , Wengang Zhou , Jiangcheng Zhu , Houqiang Li

Traditional methods plan feasible paths for multiple agents in the stochastic environment. However, the methods' iterations with the changes in the environment result in computation complexities, especially for the decentralized agents…

Robotics · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen , Jinhu Lü

In Reinforcement Learning (RL), agents have no incentive to exhibit predictable behaviors, and are often pushed (through e.g. policy entropy regularisation) to randomise their actions in favor of exploration. This often makes it challenging…

Machine Learning · Computer Science 2025-06-04 Daniel Jarne Ornia , Giannis Delimpaltadakis , Jens Kober , Javier Alonso-Mora

Large language models (LLMs) exhibit complementary strengths across domains and come with varying inference costs, motivating the design of multi-agent LLM systems where specialized models collaborate efficiently. Existing approaches…

Computation and Language · Computer Science 2025-11-05 Bowen Jin , TJ Collins , Donghan Yu , Mert Cemri , Shenao Zhang , Mengyu Li , Jay Tang , Tian Qin , Zhiyang Xu , Jiarui Lu , Guoli Yin , Jiawei Han , Zirui Wang

Recently, deep multi-agent reinforcement learning (MARL) has shown the promise to solve complex cooperative tasks. Its success is partly because of parameter sharing among agents. However, such sharing may lead agents to behave similarly…

Machine Learning · Computer Science 2021-11-02 Chenghao Li , Tonghan Wang , Chengjie Wu , Qianchuan Zhao , Jun Yang , Chongjie Zhang

Cooperative multi-agent reinforcement learning (MARL) is making rapid progress for solving tasks in a grid world and real-world scenarios, in which agents are given different attributes and goals, resulting in different behavior through the…

Multiagent Systems · Computer Science 2022-07-13 Siyi Hu , Chuanlong Xie , Xiaodan Liang , Xiaojun Chang

Achieving distributed reinforcement learning (RL) for large-scale cooperative multi-agent systems (MASs) is challenging because: (i) each agent has access to only limited information; (ii) issues on convergence or computational complexity…

Machine Learning · Computer Science 2024-04-15 Gangshan Jing , He Bai , Jemin George , Aranya Chakrabortty , Piyush K. Sharma

We consider multi-agent reinforcement learning (MARL) for cooperative communication and coordination tasks. MARL agents can be brittle because they can overfit their training partners' policies. This overfitting can produce agents that…

Artificial Intelligence · Computer Science 2022-03-08 Tessa van der Heiden , Herke van Hoof , Efstratios Gavves , Christoph Salge

We consider the problem of robust multi-agent reinforcement learning (MARL) for cooperative communication and coordination tasks. MARL agents, mainly those trained in a centralized way, can be brittle because they can adopt policies that…

Multiagent Systems · Computer Science 2020-12-16 T. van der Heiden , C. Salge , E. Gavves , H. van Hoof