中文
相关论文

相关论文: A Recipe for Stable Offline Multi-agent Reinforcem…

200 篇论文

Offline multi-agent reinforcement learning (MARL) leverages static datasets of experience to learn optimal multi-agent control. However, learning from static data presents several unique challenges to overcome. In this paper, we focus on…

机器学习 · 计算机科学 2024-07-02 Callum Rhys Tilbury , Claude Formanek , Louise Beyers , Jonathan P. Shock , Arnu Pretorius

Designing reinforcement learning (RL) agents is typically a difficult process that requires numerous design iterations. Learning can fail for a multitude of reasons, and standard RL methods provide too few tools to provide insight into the…

机器学习 · 计算机科学 2022-10-24 James MacGlashan , Evan Archer , Alisa Devlic , Takuma Seno , Craig Sherstan , Peter R. Wurman , Peter Stone

Multi-Agent Reinforcement Learning (MARL) is useful in many problems that require the cooperation and coordination of multiple agents. Learning optimal policies using reinforcement learning in a multi-agent setting can be very difficult as…

机器学习 · 计算机科学 2022-05-31 Rafael Pina , Varuna De Silva , Joosep Hook , Ahmet Kondoz

The distributed Volt/Var control (VVC) methods have been widely studied for active distribution networks(ADNs), which is based on perfect model and real-time P2P communication. However, the model is always incomplete with significant…

系统与控制 · 电气工程与系统科学 2021-04-08 Haotian Liu , Wenchuan Wu

The study of vision-and-language navigation (VLN) has typically relied on expert trajectories, which may not always be available in real-world situations due to the significant effort required to collect them. On the other hand, existing…

计算机视觉与模式识别 · 计算机科学 2024-03-28 Valay Bundele , Mahesh Bhupati , Biplab Banerjee , Aditya Grover

Value-based methods of multi-agent reinforcement learning (MARL), especially the value decomposition methods, have been demonstrated on a range of challenging cooperative tasks. However, current methods pay little attention to the…

机器学习 · 计算机科学 2021-02-12 Xiaoteng Ma , Yiqin Yang , Chenghao Li , Yiwen Lu , Qianchuan Zhao , Yang Jun

Offline reinforcement learning (RL) seeks to learn optimal policies from static datasets without further environment interaction. A key challenge is the distribution shift between the learned and behavior policies, leading to…

机器学习 · 计算机科学 2025-08-11 Haohui Chen , Zhiyong Chen

Mapping deep neural networks (DNNs) to hardware is critical for optimizing latency, energy consumption, and resource utilization, making it a cornerstone of high-performance accelerator design. Due to the vast and complex mapping space,…

Offline reinforcement learning (RL) enables policy learning from fixed datasets without further environment interaction, making it particularly valuable in high-risk or costly domains. Extreme $Q$-Learning (XQL) is a recent offline RL…

机器学习 · 计算机科学 2026-04-15 Xinming Gao , Shangzhe Li , Yujin Cai , Wenwu Yu

Multi-agent reinforcement learning (MARL) in real-world use cases may need to adapt to external natural language instructions that interrupt ongoing behavior and conflict with long-horizon objectives. However, conditioning rewards on…

人工智能 · 计算机科学 2026-05-14 Wo Wei Lin , Ethan Rathbun , Enrico Marchesini Xiang Zhi Tan

Multi-agent reinforcement learning (MARL) algorithms often suffer from an exponential sample complexity dependence on the number of agents, a phenomenon known as \emph{the curse of multiagents}. In this paper, we address this challenge by…

机器学习 · 计算机科学 2022-02-01 Weichao Mao , Lin F. Yang , Kaiqing Zhang , Tamer Başar

We show that the popular reinforcement learning (RL) strategy of estimating the state-action value (Q-function) by minimizing the mean squared Bellman error leads to a regression problem with confounding, the inputs and output noise being…

机器学习 · 计算机科学 2022-12-01 Yutian Chen , Liyuan Xu , Caglar Gulcehre , Tom Le Paine , Arthur Gretton , Nando de Freitas , Arnaud Doucet

Centralised training with decentralised execution (CT-DE) serves as the foundation of many leading multi-agent reinforcement learning (MARL) algorithms. Despite its popularity, it suffers from a critical drawback due to its reliance on…

多智能体系统 · 计算机科学 2023-06-23 Taher Jafferjee , Juliusz Ziomek , Tianpei Yang , Zipeng Dai , Jianhong Wang , Matthew Taylor , Kun Shao , Jun Wang , David Mguni

Effectively leveraging large, previously collected datasets in reinforcement learning (RL) is a key challenge for large-scale real-world applications. Offline RL algorithms promise to learn effective policies from previously-collected,…

机器学习 · 计算机科学 2020-08-20 Aviral Kumar , Aurick Zhou , George Tucker , Sergey Levine

The offline reinforcement learning (RL) paradigm provides a general recipe to convert static behavior datasets into policies that can perform better than the policy that collected the data. While policy constraints, conservatism, and other…

人工智能 · 计算机科学 2023-10-19 Jianlan Luo , Perry Dong , Jeffrey Wu , Aviral Kumar , Xinyang Geng , Sergey Levine

We propose a novel approach to address one aspect of the non-stationarity problem in multi-agent reinforcement learning (RL), where the other agents may alter their policies due to environment changes during execution. This violates the…

机器学习 · 计算机科学 2019-12-03 Yixiang Wang , Feng Wu

Multi-agent reinforcement learning (MARL) has shown promise for large-scale network control, yet existing methods face two major limitations. First, they typically rely on assumptions leading to decay properties of local agent interactions,…

机器学习 · 计算机科学 2025-11-18 Vidur Sinha , Muhammed Ustaomeroglu , Guannan Qu

Adaptive mesh refinement (AMR) is necessary for efficient finite element simulations of complex physical phenomenon, as it allocates limited computational budget based on the need for higher or lower resolution, which varies over space and…

While agents trained by Reinforcement Learning (RL) can solve increasingly challenging tasks directly from visual observations, generalizing learned skills to novel environments remains very challenging. Extensive use of data augmentation…

机器学习 · 计算机科学 2021-12-10 Nicklas Hansen , Hao Su , Xiaolong Wang

The deployment of multi-agent systems in dynamic, adversarial environments like robotic soccer necessitates real-time decision-making, sophisticated cooperation, and scalable algorithms to avoid the curse of dimensionality. While…

机器人学 · 计算机科学 2025-12-04 Aya Taourirte , Md Sohag Mia