中文
相关论文

相关论文: Understanding Value Decomposition Algorithms in De…

200 篇论文

Existing value-factorized based Multi-Agent deep Reinforce-ment Learning (MARL) approaches are well-performing invarious multi-agent cooperative environment under thecen-tralized training and decentralized execution(CTDE) scheme,where all…

人工智能 · 计算机科学 2019-11-19 Runsheng Yu , Zhenyu Shi , Xinrun Wang , Rundong Wang , Buhong Liu , Xinwen Hou , Hanjiang Lai , Bo An

In Cooperative Multi-Agent Reinforcement Learning (MARL) and under the setting of Centralized Training with Decentralized Execution (CTDE), agents observe and interact with their environment locally and independently. With local observation…

机器学习 · 计算机科学 2021-02-24 Jian Hu , Seth Austin Harding , Haibin Wu , Siyue Hu , Shih-wei Liao

Stochastic dynamic teams and games are rich models for decentralized systems and challenging testing grounds for multi-agent learning. Previous work that guaranteed team optimality assumed stateless dynamics, or an explicit coordination…

最优化与控制 · 数学 2024-03-28 Bora Yongacoglu , Gürdal Arslan , Serdar Yüksel

Cooperative games are those in which both agents share the same payoff structure. Value-based reinforcement-learning algorithms, such as variants of Q-learning, have been applied to learning cooperative games, but they only apply when the…

机器学习 · 计算机科学 2017-05-25 Leonid Peshkin , Kee-Eung Kim , Nicolas Meuleau , Leslie Pack Kaelbling

Cooperative games are those in which both agents share the same payoff structure. Value-based reinforcement-learning algorithms, such as variants of Q-learning, have been applied to learning cooperative games, but they only apply when the…

人工智能 · 计算机科学 2014-08-08 Leonid Peshkin , Kee-Eung Kim , Nicolas Meuleau , Leslie Pack Kaelbling

We provide a formal definition of depth-limited games together with an accessible and rigorous explanation of the underlying concepts, both of which were previously missing in imperfect-information games. The definition works for an…

人工智能 · 计算机科学 2022-03-25 Vojtěch Kovařík , Dominik Seitz , Viliam Lisý , Jan Rudolf , Shuo Sun , Karel Ha

In cooperative multi-agent reinforcement learning (MARL), combining value decomposition with actor-critic enables agents to learn stochastic policies, which are more suitable for the partially observable environment. Given the goal of…

机器学习 · 计算机科学 2023-02-13 Jiangxing Wang , Deheng Ye , Zongqing Lu

Due to the representation limitation of the joint Q value function, multi-agent reinforcement learning methods with linear value decomposition (LVD) or monotonic value decomposition (MVD) suffer from relative overgeneralization. As a…

多智能体系统 · 计算机科学 2022-11-23 Lipeng Wan , Zeyang Liu , Xingyu Chen , Xuguang Lan , Nanning Zheng

Valuation problems, such as feature interpretation, data valuation and model valuation for ensembles, become increasingly more important in many machine learning applications. Such problems are commonly solved by well-known game-theoretic…

机器学习 · 计算机科学 2022-05-13 Yatao Bian , Yu Rong , Tingyang Xu , Jiaxiang Wu , Andreas Krause , Junzhou Huang

This paper introduces the deep coordination graph (DCG) for collaborative multi-agent reinforcement learning. DCG strikes a flexible trade-off between representational capacity and generalization by factoring the joint value function of all…

机器学习 · 计算机科学 2020-06-24 Wendelin Böhmer , Vitaly Kurin , Shimon Whiteson

Multi-agent reinforcement learning (MARL) requires agents to explore within a vast joint action space to find joint actions that lead to coordination. Existing value-based MARL algorithms commonly rely on random exploration, such as…

多智能体系统 · 计算机科学 2025-02-10 Lukas Schäfer , Oliver Slumbers , Stephen McAleer , Yali Du , Stefano V. Albrecht , David Mguni

In this paper, we propose a maximum mutual information (MMI) framework for multi-agent reinforcement learning (MARL) to enable multiple agents to learn coordinated behaviors by regularizing the accumulated return with the mutual information…

多智能体系统 · 计算机科学 2020-06-05 Woojun Kim , Whiyoung Jung , Myungsik Cho , Youngchul Sung

Due to the representation limitation of the joint Q value function, multi-agent reinforcement learning methods with linear value decomposition (LVD) or monotonic value decomposition (MVD) suffer from relative overgeneralization. As a…

多智能体系统 · 计算机科学 2026-03-05 Lipeng Wan , Zeyang Liu , Xingyu Chen , Han Wang , Xuguang Lan

This paper presents deep meta coordination graphs (DMCG) for learning cooperative policies in multi-agent reinforcement learning (MARL). Coordination graph formulations encode local interactions and accordingly factorize the joint value…

机器学习 · 计算机科学 2026-02-11 Nikunj Gupta , James Zachary Hare , Jesse Milzman , Rajgopal Kannan , Viktor Prasanna

Adaptive mesh refinement (AMR) is necessary for efficient finite element simulations of complex physical phenomenon, as it allocates limited computational budget based on the need for higher or lower resolution, which varies over space and…

Decomposition, i.e. independently analyzing possible subgames, has proven to be an essential principle for effective decision-making in perfect information games. However, in imperfect information games, decomposition has proven to be…

计算机科学与博弈论 · 计算机科学 2014-04-22 Neil Burch , Michael Johanson , Michael Bowling

In cooperative multiagent reinforcement learning (MARL), centralized training with decentralized execution (CTDE) has recently attracted more attention due to the physical demand. However, the most dilemma therein is the inconsistency…

多智能体系统 · 计算机科学 2025-08-06 Xiaoliang Hu , Pengcheng Guo , Yadong Li , Guanyu Li , Zhen Cui , Jian Yang

Multi-agent reinforcement learning tasks put a high demand on the volume of training samples. Different from its single-agent counterpart, distributed value-based multi-agent reinforcement learning faces the unique challenges of demanding…

机器学习 · 计算机科学 2021-12-06 Siyang Wu , Tonghan Wang , Chenghao Li , Yang Hu , Chongjie Zhang

In multi-agent cooperative tasks, the presence of heterogeneous agents is familiar. Compared to cooperation among homogeneous agents, collaboration requires considering the best-suited sub-tasks for each agent. However, the operation of…

多智能体系统 · 计算机科学 2024-08-15 Songchen Fu , Shaojing Zhao , Ta Li , YongHong Yan

Cooperative multi-agent reinforcement learning is a powerful tool to solve many real-world cooperative tasks, but restrictions of real-world applications may require training the agents in a fully decentralized manner. Due to the lack of…

多智能体系统 · 计算机科学 2024-01-11 Jiechuan Jiang , Kefan Su , Zongqing Lu