中文
相关论文

相关论文: On Improving Model-Free Algorithms for Decentraliz…

200 篇论文

To overcome the sim-to-real gap in reinforcement learning (RL), learned policies must maintain robustness against environmental uncertainties. While robust RL has been widely studied in single-agent regimes, in multi-agent environments, the…

机器学习 · 计算机科学 2024-05-10 Laixi Shi , Eric Mazumdar , Yuejie Chi , Adam Wierman

Multi-agent reinforcement learning (MARL) provides a framework for problems involving multiple interacting agents. Despite apparent similarity to the single-agent case, multi-agent problems are often harder to train and analyze…

机器学习 · 计算机科学 2024-04-04 Michał Zawalski , Błażej Osiński , Henryk Michalewski , Piotr Miłoś

The cooperative Multi-A gent R einforcement Learning (MARL) with permutation invariant agents framework has achieved tremendous empirical successes in real-world applications. Unfortunately, the theoretical understanding of this MARL…

机器学习 · 计算机科学 2022-10-18 Fengzhuo Zhang , Boyi Liu , Kaixin Wang , Vincent Y. F. Tan , Zhuoran Yang , Zhaoran Wang

Multi-agent reinforcement learning (MARL) methods typically require that agents enjoy global state observability, preventing development of decentralized algorithms and limiting scalability. Recent work has shown that, under assumptions on…

机器学习 · 计算机科学 2025-05-30 Wesley A Suttle , Vipul K Sharma , Brian M Sadler

In cooperative multi-agent reinforcement learning (MARL), combining value decomposition with actor-critic enables agents to learn stochastic policies, which are more suitable for the partially observable environment. Given the goal of…

机器学习 · 计算机科学 2023-02-13 Jiangxing Wang , Deheng Ye , Zongqing Lu

Multi-agent reinforcement learning (MARL) has become a significant research topic due to its ability to facilitate learning in complex environments. In multi-agent tasks, the state-action value, commonly referred to as the Q-value, can vary…

人工智能 · 计算机科学 2024-06-13 Zhenglong Luo , Zhiyong Chen , James Welsh

We investigate model-free multi-agent reinforcement learning (MARL) in environments where off-beat actions are prevalent, i.e., all actions have pre-set execution durations. During execution durations, the environment changes are influenced…

多智能体系统 · 计算机科学 2022-06-22 Wei Qiu , Weixun Wang , Rundong Wang , Bo An , Yujing Hu , Svetlana Obraztsova , Zinovi Rabinovich , Jianye Hao , Yingfeng Chen , Changjie Fan

This work designs and analyzes a novel set of algorithms for multi-agent reinforcement learning (MARL) based on the principle of information-directed sampling (IDS). These algorithms draw inspiration from foundational concepts in…

信息论 · 计算机科学 2024-05-01 Qiaosheng Zhang , Chenjia Bai , Shuyue Hu , Zhen Wang , Xuelong Li

This paper develops an efficient multi-agent deep reinforcement learning algorithm for cooperative controls in powergrids. Specifically, we consider the decentralized inverter-based secondary voltage control problem in distributed…

系统与控制 · 电气工程与系统科学 2021-08-03 Dong Chen , Kaian Chen. Zhaojian Li , Tianshu Chu , Rui Yao , Feng Qiu , Kaixiang Lin

Multi-agent Reinforcement Learning (MARL) is emerging as a key framework for various sequential decision-making and control tasks. Unlike their single-agent counterparts, multi-agent systems necessitate successful cooperation among the…

多智能体系统 · 计算机科学 2026-03-13 Jahir Sadik Monon , Deeparghya Dutta Barua , Md. Mosaddek Khan

Multi-Agent Reinforcement Learning (MARL) -- where multiple agents learn to interact in a shared dynamic environment -- permeates across a wide range of critical applications. While there has been substantial progress on understanding the…

计算机科学与博弈论 · 计算机科学 2022-10-05 Shicong Cen , Yuejie Chi , Simon S. Du , Lin Xiao

Multi-agent reinforcement learning has made substantial empirical progresses in solving games with a large number of players. However, theoretically, the best known sample complexity for finding a Nash equilibrium in general-sum games…

机器学习 · 计算机科学 2022-04-01 Ziang Song , Song Mei , Yu Bai

Multi-agent reinforcement learning (MARL) algorithms have made promising progress in recent years by leveraging the centralized training and decentralized execution (CTDE) paradigm. However, existing MARL algorithms still suffer from the…

机器学习 · 计算机科学 2021-10-20 Xiao Ma , Wu-Jun Li

Recent Multi-Agent Reinforcement Learning (MARL) literature has been largely focused on Centralized Training with Decentralized Execution (CTDE) paradigm. CTDE has been a dominant approach for both cooperative and mixed environments due to…

机器学习 · 计算机科学 2022-05-31 Vladimir Egorov , Aleksei Shpilman

This paper considers multi-agent reinforcement learning (MARL) in networked system control. Specifically, each agent learns a decentralized control policy based on local observations and messages from connected neighbors. We formulate such…

机器学习 · 计算机科学 2020-04-27 Tianshu Chu , Sandeep Chinchali , Sachin Katti

This paper proposes a novel distributed approach for solving a cooperative Constrained Multi-agent Reinforcement Learning (CMARL) problem, where agents seek to minimize a global objective function subject to shared constraints. Unlike…

系统与控制 · 电气工程与系统科学 2026-05-08 Ali Kahe , Hamed Kebriaei

Multi-Agent Reinforcement Learning (MARL) comprises an area of growing interest in the field of machine learning. Despite notable advances, there are still problems that require investigation. The lazy agent pathology is a famous problem in…

机器学习 · 计算机科学 2023-11-07 Rafael Pina , Varuna De Silva , Corentin Artaud

As a data-driven approach, multi-agent reinforcement learning (MARL) has made remarkable advances in solving cooperative residential load scheduling problems. However, centralized training, the most common paradigm for MARL, limits…

多智能体系统 · 计算机科学 2025-03-05 Zhaoming Qin , Nanqing Dong , Di Liu , Zhefan Wang , Junwei Cao

We study a multi-agent reinforcement learning dynamics, and analyze its asymptotic behavior in infinite-horizon discounted Markov potential games. We focus on the independent and decentralized setting, where players do not know the game…

机器学习 · 计算机科学 2025-04-02 Chinmay Maheshwari , Manxi Wu , Druv Pai , Shankar Sastry

In this paper, we study the problem of reinforcement learning in multi-agent systems where communication among agents is limited. We develop a decentralized actor-critic learning framework in which each agent performs several local updates…

机器学习 · 计算机科学 2025-10-23 Xiaoxing Ren , Nicola Bastianello , Thomas Parisini , Andreas A. Malikopoulos