English
Related papers

Related papers: Transformer-based Value Function Decomposition for…

200 papers

Offline multi-agent reinforcement learning (MARL) with multi-task datasets is challenging due to varying numbers of agents across tasks and the need to generalize to unseen scenarios. Prior works employ transformers with observation…

Artificial Intelligence · Computer Science 2026-03-13 Jiwon Jeon , Myungsik Cho , Youngchul Sung

The empirical success of multi-agent reinforcement learning (MARL) has motivated the search for more efficient and scalable algorithms for large scale multi-agent systems. However, existing state-of-the-art algorithms do not fully exploit…

Multiagent Systems · Computer Science 2025-10-14 Shahbaz P Qadri Syed , He Bai

Cooperative multi-agent reinforcement learning (MARL) faces significant scalability issues due to state and action spaces that are exponentially large in the number of agents. As environments grow in size, effective credit assignment…

Artificial Intelligence · Computer Science 2021-09-23 Roy Zohar , Shie Mannor , Guy Tennenholtz

Value-decomposition methods, which reduce the difficulty of a multi-agent system by decomposing the joint state-action space into local observation-action spaces, have become popular in cooperative multi-agent reinforcement learning (MARL).…

Artificial Intelligence · Computer Science 2023-03-17 Shuhan Qi , Shuhao Zhang , Qiang Wang , Jiajia Zhang , Jing Xiao , Xuan Wang

Multi-agent Reinforcement Learning (MARL) problems often require cooperation among agents in order to solve a task. Centralization and decentralization are two approaches used for cooperation in MARL. While fully decentralized methods are…

Multiagent Systems · Computer Science 2021-11-30 Bengisu Guresti , Nazim Kemal Ure

The Transformer model has demonstrated success across a wide range of domains, including in Multi-Agent Reinforcement Learning (MARL) where the Multi-Agent Transformer (MAT) has emerged as a leading algorithm in the field. However, a…

Many complex multi-agent systems such as robot swarms control and autonomous vehicle coordination can be modeled as Multi-Agent Reinforcement Learning (MARL) tasks. QMIX, a widely popular MARL algorithm, has been used as a baseline for the…

Machine Learning · Computer Science 2023-06-09 Jian Hu , Siyang Jiang , Seth Austin Harding , Haibin Wu , Shih-wei Liao

In the real world, many tasks require multiple agents to cooperate with each other under the condition of local observations. To solve such problems, many multi-agent reinforcement learning methods based on Centralized Training with…

Multiagent Systems · Computer Science 2021-06-23 Zhiwei Xu , Dapeng Li , Yunpeng Bai , Guoliang Fan

Deep multi-agent reinforcement learning (MARL) algorithms are booming in the field of collaborative intelligence, and StarCraft multi-agent challenge (SMAC) is widely-used as the benchmark therein. However, imaginary opponents of MARL…

Artificial Intelligence · Computer Science 2025-12-19 Yadong Li , Tong Zhang , Bo Huang , Zhen Cui

Communication is essential for the collective execution of complex tasks by human agents, motivating interest in communication mechanisms for multi-agent reinforcement learning (MARL). However, existing communication protocols in MARL are…

Machine Learning · Computer Science 2026-01-26 Maciej Wojtala , Bogusz Stefańczyk , Dominik Bogucki , Łukasz Lepak , Jakub Strykowski , Paweł Wawrzyński

Reward decomposition is a critical problem in centralized training with decentralized execution~(CTDE) paradigm for multi-agent reinforcement learning. To take full advantage of global information, which exploits the states from all agents…

Machine Learning · Computer Science 2021-02-26 Jianzhun Shao , Hongchang Zhang , Yuhang Jiang , Shuncheng He , Xiangyang Ji

The availability of challenging simulation environments is pivotal for advancing the field of Multi-Agent Reinforcement Learning (MARL). In cooperative MARL settings, the StarCraft Multi-Agent Challenge (SMAC) has gained prominence as a…

Artificial Intelligence · Computer Science 2024-12-25 Yue Deng , Yan Yu , Weiyu Ma , Zirui Wang , Wenhui Zhu , Jian Zhao , Yin Zhang

It has long been recognized that multi-agent reinforcement learning (MARL) faces significant scalability issues due to the fact that the size of the state and action spaces are exponentially large in the number of agents. In this paper, we…

Optimization and Control · Mathematics 2020-06-12 Guannan Qu , Yiheng Lin , Adam Wierman , Na Li

Cooperation in multi-agent reinforcement learning (MARL) benefits from inter-agent communication, yet most approaches assume idealized channels and existing value decomposition methods ignore who successfully shared information with whom.…

Machine Learning · Computer Science 2026-04-13 Diyi Hu , Bhaskar Krishnamachari

Instead of making behavioral decisions directly from the exponentially expanding joint observational-action space, subtask-based multi-agent reinforcement learning (MARL) methods enable agents to learn how to tackle different subtasks. Most…

Artificial Intelligence · Computer Science 2024-03-05 Wenjing Zhang , Wei Zhang

Current value-based multi-agent reinforcement learning methods optimize individual Q values to guide individuals' behaviours via centralized training with decentralized execution (CTDE). However, such expected, i.e., risk-neutral, Q value…

Machine Learning · Computer Science 2021-03-23 Wei Qiu , Xinrun Wang , Runsheng Yu , Xu He , Rundong Wang , Bo An , Svetlana Obraztsova , Zinovi Rabinovich

Distributed decision-making in multi-agent systems presents difficult challenges for interactive behavior learning in both cooperative and competitive systems. To mitigate this complexity, MAIDRL presents a semi-centralized Dense…

Artificial Intelligence · Computer Science 2024-02-13 Ayesha Siddika Nipu , Siming Liu , Anthony Harris

Despite substantial progress in applying neural networks (NN) to multi-agent reinforcement learning (MARL) areas, they still largely suffer from a lack of transparency and interoperability. However, its implicit cooperative mechanism is not…

Artificial Intelligence · Computer Science 2025-07-29 Zhonghan Ge , Yuanyang Zhu , Chunlin Chen

Multiagent reinforcement learning (MARL) has attracted considerable attention due to its potential in addressing complex cooperative tasks. However, existing MARL approaches often rely on frequent exchanges of action or state information…

Machine Learning · Computer Science 2026-01-14 Zhenglong Luo , Zhiyong Chen , Aoxiang Liu , Ke Pan

Role-based learning holds the promise of achieving scalable multi-agent learning by decomposing complex tasks using roles. However, it is largely unclear how to efficiently discover such a set of roles. To solve this problem, we propose to…

Machine Learning · Computer Science 2020-10-06 Tonghan Wang , Tarun Gupta , Anuj Mahajan , Bei Peng , Shimon Whiteson , Chongjie Zhang