English
Related papers

Related papers: Dual Self-Awareness Value Decomposition Framework …

200 papers

Cooperative problems under continuous control have always been the focus of multi-agent reinforcement learning. Existing algorithms suffer from the problem of uneven learning degree with the increase of the number of agents. In this paper,…

Multiagent Systems · Computer Science 2021-07-05 Kai Liu , Yuyang Zhao , Gang Wang , Bei Peng

Cooperative multi-agent reinforcement learning is a powerful tool to solve many real-world cooperative tasks, but restrictions of real-world applications may require training the agents in a fully decentralized manner. Due to the lack of…

Multiagent Systems · Computer Science 2024-01-11 Jiechuan Jiang , Kefan Su , Zongqing Lu

Despite substantial progress in applying neural networks (NN) to multi-agent reinforcement learning (MARL) areas, they still largely suffer from a lack of transparency and interoperability. However, its implicit cooperative mechanism is not…

Artificial Intelligence · Computer Science 2025-07-29 Zhonghan Ge , Yuanyang Zhu , Chunlin Chen

Value function factorization methods have become a dominant approach for cooperative multiagent reinforcement learning under a centralized training and decentralized execution paradigm. By factorizing the optimal joint action-value function…

Machine Learning · Computer Science 2023-02-14 Yongsheng Mei , Hanhan Zhou , Tian Lan

We study the problem of designing autonomous agents that can learn to cooperate effectively with a potentially suboptimal partner while having no access to the joint reward function. This problem is modeled as a cooperative episodic…

Machine Learning · Computer Science 2022-06-14 Thomas Kleine Buening , Anne-Marie George , Christos Dimitrakakis

Cooperative multi-agent reinforcement learning (MARL) faces significant scalability issues due to state and action spaces that are exponentially large in the number of agents. As environments grow in size, effective credit assignment…

Artificial Intelligence · Computer Science 2021-09-23 Roy Zohar , Shie Mannor , Guy Tennenholtz

Multi-agent reinforcement learning (MARL) requires agents to explore within a vast joint action space to find joint actions that lead to coordination. Existing value-based MARL algorithms commonly rely on random exploration, such as…

Multiagent Systems · Computer Science 2025-02-10 Lukas Schäfer , Oliver Slumbers , Stephen McAleer , Yali Du , Stefano V. Albrecht , David Mguni

We consider a multi-agent reinforcement learning problem where each agent seeks to maximize a shared reward while interacting with other agents, and they may or may not be able to communicate. Typically the agents do not have access to…

Multiagent Systems · Computer Science 2021-04-26 Alex Tong Lin , Mark J. Debord , Katia Estabridis , Gary Hewer , Guido Montufar , Stanley Osher

Value function factorization methods are commonly used in cooperative multi-agent reinforcement learning, with QMIX receiving significant attention. Many QMIX-based methods introduce monotonicity constraints between the joint action value…

Machine Learning · Computer Science 2025-04-11 Chang Huang , Shatong Zhu , Junqiao Zhao , Hongtu Zhou , Chen Ye , Tiantian Feng , Changjun Jiang

Value decomposition is widely used in cooperative multi-agent reinforcement learning, however, its implicit credit assignment mechanism is not yet fully understood due to black-box networks. In this work, we study an interpretable value…

Multiagent Systems · Computer Science 2024-01-30 Zichuan Liu , Yuanyang Zhu , Chunlin Chen

The exploitation of extra state information has been an active research area in multi-agent reinforcement learning (MARL). QMIX represents the joint action-value using a non-negative function approximator and achieves the best performance,…

Artificial Intelligence · Computer Science 2020-12-21 Jianyu Su , Stephen Adams , Peter A. Beling

In cooperative multi-agent systems, agents jointly take actions and receive a team reward instead of individual rewards. In the absence of individual reward signals, credit assignment mechanisms are usually introduced to discriminate the…

Artificial Intelligence · Computer Science 2022-02-17 Jian Zhao , Yue Zhang , Xunhan Hu , Weixun Wang , Wengang Zhou , Jianye Hao , Jiangcheng Zhu , Houqiang Li

Existing value-factorized based Multi-Agent deep Reinforce-ment Learning (MARL) approaches are well-performing invarious multi-agent cooperative environment under thecen-tralized training and decentralized execution(CTDE) scheme,where all…

Artificial Intelligence · Computer Science 2019-11-19 Runsheng Yu , Zhenyu Shi , Xinrun Wang , Rundong Wang , Buhong Liu , Xinwen Hou , Hanjiang Lai , Bo An

Most recently developed approaches to cooperative multi-agent reinforcement learning in the \emph{centralized training with decentralized execution} setting involve estimating a centralized, joint value function. In this paper, we…

Achieving and maintaining cooperation between agents to accomplish a common objective is one of the central goals of Multi-Agent Reinforcement Learning (MARL). Nevertheless in many real-world scenarios, separately trained and specialized…

Multiagent Systems · Computer Science 2023-03-07 Bengisu Guresti , Abdullah Vanlioglu , Nazim Kemal Ure

Value function factorization via centralized training and decentralized execution is promising for solving cooperative multi-agent reinforcement tasks. One of the approaches in this area, QMIX, has become state-of-the-art and achieved the…

Multiagent Systems · Computer Science 2023-07-27 Hanhan Zhou , Tian Lan , Vaneet Aggarwal

Multi-agent reinforcement learning (MARL) provides a promising paradigm for coordinating multi-agent systems (MAS). However, most existing methods rely on restrictive assumptions, such as a fixed number of agents and fully synchronous…

Multiagent Systems · Computer Science 2026-02-17 Yexin Li , Jinjin Guo , Haoyu Zhang , Yuhan Zhao , Yiwen Sun , Zihao Jiao

In multi-agent reinforcement learning (MARL), it is challenging for a collection of agents to learn complex temporally extended tasks. The difficulties lie in computational complexity and how to learn the high-level ideas behind reward…

Multiagent Systems · Computer Science 2021-10-04 Jueming Hu , Zhe Xu , Weichang Wang , Guannan Qu , Yutian Pang , Yongming Liu

Many real world tasks require multiple agents to work together. Multi-agent reinforcement learning (RL) methods have been proposed in recent years to solve these tasks, but current methods often fail to efficiently learn policies. We thus…

Machine Learning · Computer Science 2019-12-03 Johannes Ackermann , Volker Gabler , Takayuki Osa , Masashi Sugiyama

Discrete-action reinforcement learning algorithms often falter in tasks with high-dimensional discrete action spaces due to the vast number of possible actions. A recent advancement leverages value-decomposition, a concept from multi-agent…

Machine Learning · Computer Science 2024-03-11 David Ireland , Giovanni Montana