English
Related papers

Related papers: Weighted QMIX: Expanding Monotonic Value Function …

200 papers

Deep reinforcement learning (RL) has been applied extensively to solve complex decision-making problems. In many real-world scenarios, tasks often have several conflicting objectives and may require multiple agents to cooperate, which are…

Artificial Intelligence · Computer Science 2026-03-03 Tianmeng Hu , Biao Luo , Chunhua Yang , Tingwen Huang

For Industry 4.0 Revolution, cooperative autonomous mobility systems are widely used based on multi-agent reinforcement learning (MARL). However, the MARL-based algorithms suffer from huge parameter utilization and convergence difficulties…

Multiagent Systems · Computer Science 2023-08-04 Soohyun Park , Jae Pyoung Kim , Chanyoung Park , Soyi Jung , Joongheon Kim

VDN and QMIX are two popular value-based algorithms for cooperative MARL that learn a centralized action value function as a monotonic mixing of per-agent utilities. While this enables easy decentralization of the learned policy, the…

Machine Learning · Computer Science 2021-06-11 Tarun Gupta , Anuj Mahajan , Bei Peng , Wendelin Böhmer , Shimon Whiteson

In decentralized multi-agent reinforcement learning, agents learning in isolation can lead to relative over-generalization (RO), where optimal joint actions are undervalued in favor of suboptimal ones. This hinders effective coordination in…

Machine Learning · Computer Science 2024-11-19 Ting Zhu , Yue Jin , Jeremie Houssineau , Giovanni Montana

In cooperative multi-agent reinforcement learning (MARL), combining value decomposition with actor-critic enables agents to learn stochastic policies, which are more suitable for the partially observable environment. Given the goal of…

Machine Learning · Computer Science 2023-02-13 Jiangxing Wang , Deheng Ye , Zongqing Lu

Multi-agent reinforcement learning (MARL) requires agents to explore within a vast joint action space to find joint actions that lead to coordination. Existing value-based MARL algorithms commonly rely on random exploration, such as…

Multiagent Systems · Computer Science 2025-02-10 Lukas Schäfer , Oliver Slumbers , Stephen McAleer , Yali Du , Stefano V. Albrecht , David Mguni

In cooperative multi-agent tasks, a team of agents jointly interact with an environment by taking actions, receiving a team reward and observing the next state. During the interactions, the uncertainty of environment and reward will…

Machine Learning · Computer Science 2022-05-23 Jian Zhao , Mingyu Yang , Youpeng Zhao , Xunhan Hu , Wengang Zhou , Jiangcheng Zhu , Houqiang Li

Multi-agent reinforcement learning tasks put a high demand on the volume of training samples. Different from its single-agent counterpart, distributed value-based multi-agent reinforcement learning faces the unique challenges of demanding…

Machine Learning · Computer Science 2021-12-06 Siyang Wu , Tonghan Wang , Chenghao Li , Yang Hu , Chongjie Zhang

In fully cooperative multi-agent reinforcement learning (MARL) settings, the environments are highly stochastic due to the partial observability of each agent and the continuously changing policies of the other agents. To address the above…

Multiagent Systems · Computer Science 2021-12-23 Wei-Fang Sun , Cheng-Kuang Lee , Chun-Yi Lee

Despite substantial progress in applying neural networks (NN) to multi-agent reinforcement learning (MARL) areas, they still largely suffer from a lack of transparency and interoperability. However, its implicit cooperative mechanism is not…

Artificial Intelligence · Computer Science 2025-07-29 Zhonghan Ge , Yuanyang Zhu , Chunlin Chen

Recently, deep multiagent reinforcement learning (MARL) has become a highly active research area as many real-world problems can be inherently viewed as multiagent systems. A particularly interesting and widely applicable class of problems…

Multiagent Systems · Computer Science 2020-02-11 Yaodong Yang , Jianye Hao , Guangyong Chen , Hongyao Tang , Yingfeng Chen , Yujing Hu , Changjie Fan , Zhongyu Wei

Deploying teams of unmanned aerial vehicles (UAVs) to harvest data from distributed Internet of Things (IoT) devices requires efficient trajectory planning and coordination algorithms. Multi-agent reinforcement learning (MARL) has emerged…

Machine Learning · Computer Science 2023-10-10 Jichao Chen , Omid Esrafilian , Harald Bayerlein , David Gesbert , Marco Caccamo

Value function decomposition is becoming a popular rule of thumb for scaling up multi-agent reinforcement learning (MARL) in cooperative games. For such a decomposition rule to hold, the assumption of the individual-global max (IGM)…

Machine Learning · Computer Science 2022-02-17 Zehao Dou , Jakub Grudzien Kuba , Yaodong Yang

This paper concerns imitation learning (IL) (i.e, the problem of learning to mimic expert behaviors from demonstrations) in cooperative multi-agent systems. The learning problem under consideration poses several challenges, characterized by…

Machine Learning · Computer Science 2023-10-11 The Viet Bui , Tien Mai , Thanh Hong Nguyen

Multi-agent reinforcement learning (MARL), despite its popularity and empirical success, suffers from the curse of dimensionality. This paper builds the mathematical framework to approximate cooperative MARL by a mean-field control (MFC)…

Machine Learning · Computer Science 2021-10-04 Haotian Gu , Xin Guo , Xiaoli Wei , Renyuan Xu

Q-learning is a powerful tool for network control and policy optimization in wireless networks, but it struggles with large state spaces. Recent advancements, like multi-environment mixed Q-learning (MEMQ), improves performance and reduces…

Signal Processing · Electrical Eng. & Systems 2024-12-31 Talha Bozkus , Urbashi Mitra

Multi-agent reinforcement learning methods such as VDN, QMIX, and QTRAN that adopt centralized training with decentralized execution (CTDE) framework have shown promising results in cooperation and competition. However, in some multi-agent…

Multiagent Systems · Computer Science 2022-03-29 Jiajun Chai , Weifan Li , Yuanheng Zhu , Dongbin Zhao , Zhe Ma , Kewu Sun , Jishiyu Ding

Multi-Agent Reinforcement Learning (MARL) has emerged as a powerfulparadigm for cooperative decision-making in connected autonomous vehicles(CAVs); however, existing approaches often fail to guarantee stability, optimality,and…

General Mathematics · Mathematics 2025-11-25 Mazyar Taghavi , Javad Vahidi

In multi-agent reinforcement learning, centralized training with decentralized execution (CTDE) methods typically assume that agents make decisions based on their local observations independently, which may not lead to a correlated joint…

Multiagent Systems · Computer Science 2024-12-16 Zhiyuan Li , Wenshuai Zhao , Lijun Wu , Joni Pajarinen

Multi-agent reinforcement learning (MARL) has witnessed significant progress with the development of value function factorization methods. It allows optimizing a joint action-value function through the maximization of factorized per-agent…

Multiagent Systems · Computer Science 2023-05-05 Hanhan Zhou , Tian Lan , Vaneet Aggarwal