中文
相关论文

相关论文: On Centralized Critics in Multi-Agent Reinforcemen…

200 篇论文

Decentralized learning has shown great promise for cooperative multi-agent reinforcement learning (MARL). However, non-stationarity remains a significant challenge in fully decentralized learning. In the paper, we tackle the…

机器学习 · 计算机科学 2023-02-08 Kefan Su , Siyuan Zhou , Jiechuan Jiang , Chuang Gan , Xiangjun Wang , Zongqing Lu

Deep reinforcement learning (DRL) is a booming area of artificial intelligence. Many practical applications of DRL naturally involve more than one collaborative learners, making it important to study DRL in a multi-agent context. Previous…

机器学习 · 计算机科学 2019-10-22 Gang Chen

In edge computing systems, autonomous agents must make fast local decisions while competing for shared resources. Existing MARL methods often resume to centralized critics or frequent communication, which fail under limited observability…

机器学习 · 计算机科学 2025-10-24 Andrea Fox , Francesco De Pellegrini , Eitan Altman

Agent faults pose a significant threat to the performance of multi-agent reinforcement learning (MARL) algorithms, introducing two key challenges. First, agents often struggle to extract critical information from the chaotic state space…

机器学习 · 计算机科学 2024-12-03 Yuchen Shi , Huaxin Pei , Liang Feng , Yi Zhang , Danya Yao

Many advances in cooperative multi-agent reinforcement learning (MARL) are based on two common design principles: value decomposition and parameter sharing. A typical MARL algorithm of this fashion decomposes a centralized Q-function into…

人工智能 · 计算机科学 2022-08-09 Wei Fu , Chao Yu , Zelai Xu , Jiaqi Yang , Yi Wu

Both generative adversarial networks (GAN) in unsupervised learning and actor-critic methods in reinforcement learning (RL) have gained a reputation for being difficult to optimize. Practitioners in both fields have amassed a large number…

机器学习 · 计算机科学 2017-01-19 David Pfau , Oriol Vinyals

Many reality tasks such as robot coordination can be naturally modelled as multi-agent cooperative system where the rewards are sparse. This paper focuses on learning decentralized policies for such tasks using sub-optimal demonstration. To…

人工智能 · 计算机科学 2021-08-20 Peixi Peng , Junliang Xing

Cooperative multi-agent reinforcement learning (MARL) benchmarks commonly emphasize aggregate outcomes such as return, success rate, or completion time. While essential, these metrics often fail to reveal how agents coordinate, particularly…

多智能体系统 · 计算机科学 2026-05-08 Maria Ana Cardei , Matthew Landers , Afsaneh Doryab

Entropy regularization is a popular method in reinforcement learning (RL). Although it has many advantages, it alters the RL objective of the original Markov Decision Process (MDP). Though divergence regularization has been proposed to…

机器学习 · 计算机科学 2022-06-22 Kefan Su , Zongqing Lu

The widespread adoption of electric vehicles (EVs) poses several challenges to power distribution networks and smart grid infrastructure due to the possibility of significantly increasing electricity demands, especially during peak hours.…

人工智能 · 计算机科学 2024-04-22 Amin Shojaeighadikolaei , Zsolt Talata , Morteza Hashemi

The creation and destruction of agents in cooperative multi-agent reinforcement learning (MARL) is a critically under-explored area of research. Current MARL algorithms often assume that the number of agents within a group remains fixed…

Multiagent Reinforcement Learning (MARL) poses significant challenges due to the exponential growth of state and action spaces and the non-stationary nature of multiagent environments. This results in notable sample inefficiency and hinders…

多智能体系统 · 计算机科学 2025-02-27 Nikhilesh Prabhakar , Ranveer Singh , Harsha Kokel , Sriraam Natarajan , Prasad Tadepalli

We study reinforcement learning (RL) in a setting with a network of agents whose states and actions interact in a local manner where the objective is to find localized policies such that the (discounted) global reward is maximized. A…

最优化与控制 · 数学 2021-11-02 Guannan Qu , Adam Wierman , Na Li

Multi-Agent Reinforcement Learning (MARL) has been widely applied in many fields such as smart traffic and unmanned aerial vehicles. However, most MARL algorithms are vulnerable to adversarial perturbations on agent states. Robustness…

机器学习 · 计算机科学 2023-11-09 Ziyuan Zhou , Guanjun Liu

Collaborative multi-agent reinforcement learning (MARL) has been widely used in many practical applications, where each agent makes a decision based on its own observation. Most mainstream methods treat each local observation as an entirety…

机器学习 · 计算机科学 2022-06-23 Shuang Luo , Yinchuan Li , Jiahui Li , Kun Kuang , Furui Liu , Yunfeng Shao , Chao Wu

Recent approaches have utilized self-supervised auxiliary tasks as representation learning to improve the performance and sample efficiency of vision-based reinforcement learning algorithms in single-agent settings. However, in multi-agent…

机器学习 · 计算机科学 2023-06-06 Haolin Song , Mingxiao Feng , Wengang Zhou , Houqiang Li

We show that offline actor-critic reinforcement learning can scale to large models - such as transformers - and follows similar scaling laws as supervised learning. We find that offline actor-critic algorithms can outperform strong,…

Autonomous control of multi-stage industrial processes requires both local specialization and global coordination. Reinforcement learning (RL) offers a promising approach, but its industrial adoption remains limited due to challenges such…

机器学习 · 计算机科学 2025-10-24 Tom Maus , Asma Atamna , Tobias Glasmachers

A central problem in the theory of multi-agent reinforcement learning (MARL) is to understand what structural conditions and algorithmic principles lead to sample-efficient learning guarantees, and how these considerations change as we move…

机器学习 · 计算机科学 2023-05-02 Dylan J. Foster , Dean P. Foster , Noah Golowich , Alexander Rakhlin

Multi-Agent Reinforcement Learning (MARL) has emerged as a powerfulparadigm for cooperative decision-making in connected autonomous vehicles(CAVs); however, existing approaches often fail to guarantee stability, optimality,and…

综合数学 · 数学 2025-11-25 Mazyar Taghavi , Javad Vahidi