中文
相关论文

相关论文: NQMIX: Non-monotonic Value Function Factorization …

200 篇论文

Reinforcement learning encounters major challenges in multi-agent settings, such as scalability and non-stationarity. Recently, value function factorization learning emerges as a promising way to address these challenges in collaborative…

机器学习 · 计算机科学 2020-07-21 Tonghan Wang , Jianhao Wang , Chongyi Zheng , Chongjie Zhang

We explore deep reinforcement learning methods for multi-agent domains. We begin by analyzing the difficulty of traditional algorithms in the multi-agent case: Q-learning is challenged by an inherent non-stationarity of the environment,…

机器学习 · 计算机科学 2020-03-17 Ryan Lowe , Yi Wu , Aviv Tamar , Jean Harb , Pieter Abbeel , Igor Mordatch

Value decomposition (VD) has become one of the most prominent solutions in cooperative multi-agent reinforcement learning. Most existing methods generally explore how to factorize the joint value and minimize the discrepancies between agent…

多智能体系统 · 计算机科学 2025-02-06 Siying Wang , Yang Zhou , Zhitong Zhao , Ruoning Zhang , Jinliang Shao , Wenyu Chen , Yuhua Cheng

Reinforcement learning has gathered much attention in recent years due to its rapid development and rich applications, especially on control systems and robotics. When tackling real-world applications with reinforcement learning method, the…

机器学习 · 计算机科学 2025-10-02 Andy Wu , Chun-Cheng Lin , Rung-Tzuo Liaw , Yuehua Huang , Chihjung Kuo , Chia Tong Weng

In fully cooperative multi-agent reinforcement learning (MARL) settings, environments are highly stochastic due to the partial observability of each agent and the continuously changing policies of other agents. To address the above issues,…

多智能体系统 · 计算机科学 2023-06-06 Wei-Fang Sun , Cheng-Kuang Lee , Simon See , Chun-Yi Lee

This paper introduces four new algorithms that can be used for tackling multi-agent reinforcement learning (MARL) problems occurring in cooperative settings. All algorithms are based on the Deep Quality-Value (DQV) family of algorithms, a…

机器学习 · 计算机科学 2020-12-23 Pascal Leroy , Damien Ernst , Pierre Geurts , Gilles Louppe , Jonathan Pisane , Matthia Sabatelli

Training for multi-agent reinforcement learning(MARL) is a time-consuming process caused by distribution shift of each agent. One drawback is that strategy of each agent in MARL is independent but actually in cooperation. Thus, a vertical…

人工智能 · 计算机科学 2024-03-06 Ke Zhang , DanDan Zhu , Qiuhan Xu , Hao Zhou , Ce Zheng

Current value-based multi-agent reinforcement learning methods optimize individual Q values to guide individuals' behaviours via centralized training with decentralized execution (CTDE). However, such expected, i.e., risk-neutral, Q value…

机器学习 · 计算机科学 2021-03-23 Wei Qiu , Xinrun Wang , Runsheng Yu , Xu He , Rundong Wang , Bo An , Svetlana Obraztsova , Zinovi Rabinovich

In multi-agent reinforcement learning, centralized training with decentralized execution (CTDE) methods typically assume that agents make decisions based on their local observations independently, which may not lead to a correlated joint…

多智能体系统 · 计算机科学 2024-12-16 Zhiyuan Li , Wenshuai Zhao , Lijun Wu , Joni Pajarinen

Deep reinforcement learning for multi-agent cooperation and competition has been a hot topic recently. This paper focuses on cooperative multi-agent problem based on actor-critic methods under local observations settings. Multi agent deep…

人工智能 · 计算机科学 2017-10-04 Xiangxiang Chu , Hangjun Ye

Value decomposition is widely used in cooperative multi-agent reinforcement learning, however, its implicit credit assignment mechanism is not yet fully understood due to black-box networks. In this work, we study an interpretable value…

多智能体系统 · 计算机科学 2024-01-30 Zichuan Liu , Yuanyang Zhu , Chunlin Chen

Reinforcement learning in multi-agent scenarios is important for real-world applications but presents challenges beyond those seen in single-agent settings. We present an actor-critic algorithm that trains decentralized policies in…

机器学习 · 计算机科学 2019-05-29 Shariq Iqbal , Fei Sha

Value functions are central to Dynamic Programming and Reinforcement Learning but their exact estimation suffers from the curse of dimensionality, challenging the development of practical value-function (VF) estimation algorithms. Several…

人工智能 · 计算机科学 2021-04-20 Sergio Rozada , Victor Tenorio , Antonio G. Marques

Effective coordination and cooperation among agents are crucial for accomplishing individual or shared objectives in multi-agent systems. In many real-world multi-agent systems, agents possess varying abilities and constraints, making it…

多智能体系统 · 计算机科学 2023-10-20 Yasin Findik , Paul Robinette , Kshitij Jerath , S. Reza Ahmadzadeh

Centralized training is widely utilized in the field of multi-agent reinforcement learning (MARL) to assure the stability of training process. Once a joint policy is obtained, it is critical to design a value function factorization method…

人工智能 · 计算机科学 2023-11-02 Rizhong Wang , Huiping Li , Di Cui , Demin Xu

Despite substantial progress in applying neural networks (NN) to multi-agent reinforcement learning (MARL) areas, they still largely suffer from a lack of transparency and interoperability. However, its implicit cooperative mechanism is not…

人工智能 · 计算机科学 2025-07-29 Zhonghan Ge , Yuanyang Zhu , Chunlin Chen

Shared feature spaces for actor-critic methods aims to capture generalized latent representations to be used by the policy and value function with the hopes for a more stable and sample-efficient optimization. However, such a paradigm…

机器学习 · 计算机科学 2021-06-25 Dom Huh

Many complex multi-agent systems such as robot swarms control and autonomous vehicle coordination can be modeled as Multi-Agent Reinforcement Learning (MARL) tasks. QMIX, a widely popular MARL algorithm, has been used as a baseline for the…

机器学习 · 计算机科学 2023-06-09 Jian Hu , Siyang Jiang , Seth Austin Harding , Haibin Wu , Shih-wei Liao

Cooperative problems under continuous control have always been the focus of multi-agent reinforcement learning. Existing algorithms suffer from the problem of uneven learning degree with the increase of the number of agents. In this paper,…

多智能体系统 · 计算机科学 2021-07-05 Kai Liu , Yuyang Zhao , Gang Wang , Bei Peng

Cooperative multi-agent systems can be naturally used to model many real world problems, such as network packet routing and the coordination of autonomous vehicles. There is a great need for new reinforcement learning methods that can…

人工智能 · 计算机科学 2024-12-12 Jakob Foerster , Gregory Farquhar , Triantafyllos Afouras , Nantas Nardelli , Shimon Whiteson