中文
相关论文

相关论文: Partial Action Replacement: Tackling Distribution …

200 篇论文

Multi-Agent Reinforcement Learning (MARL) has gained significant interest in recent years, enabling sequential decision-making across multiple agents in various domains. However, most existing explanation methods focus on centralized MARL,…

人工智能 · 计算机科学 2025-11-14 Kayla Boggess , Sarit Kraus , Lu Feng

Off-policy reinforcement learning holds the promise of sample-efficient learning of decision-making policies by leveraging past experience. However, in the offline RL setting -- where a fixed collection of interactions are provided and no…

机器学习 · 计算机科学 2021-01-15 Seyed Kamyar Seyed Ghasemipour , Dale Schuurmans , Shixiang Shane Gu

In real-world environments, autonomous agents rely on their egocentric observations. They must learn adaptive strategies to interact with others who possess mixed motivations, discernible only through visible cues. Several Multi-Agent…

多智能体系统 · 计算机科学 2023-12-15 Violet Xiang , Logan Cross , Jan-Philipp Fränken , Nick Haber

Safety and scalability are two critical challenges faced by practical Multi-Agent Systems (MAS). However, existing Multi-Agent Reinforcement Learning (MARL) algorithms that rely solely on reward shaping are ineffective in ensuring safety,…

多智能体系统 · 计算机科学 2025-04-02 Haikuo Du , Fandi Gou , Yunze Cai

One of the fundamental challenges for offline reinforcement learning (RL) is ensuring robustness to data distribution. Whether the data originates from a near-optimal policy or not, we anticipate that an algorithm should demonstrate its…

机器学习 · 计算机科学 2023-10-18 Xiaohan Hu , Yi Ma , Chenjun Xiao , Yan Zheng , Jianye Hao

We introduce hybrid execution in multi-agent reinforcement learning (MARL), a new paradigm in which agents aim to successfully complete cooperative tasks with arbitrary communication levels at execution time by taking advantage of…

This study proposes the use of a social learning method to estimate a global state within a multi-agent off-policy actor-critic algorithm for reinforcement learning (RL) operating in a partially observable environment. We assume that the…

机器学习 · 计算机科学 2024-07-09 Ainur Zhaikhan , Ali H. Sayed

Reinforcement learning with offline data suffers from Q-value extrapolation errors. To address this issue, we first demonstrate that linear extrapolation of the Q-function beyond the data range is particularly problematic. To mitigate this,…

Imitation Learning (IL) has proven highly effective for robotic and control tasks where manually designing reward functions or explicit controllers is infeasible. However, standard IL methods implicitly assume that the environment dynamics…

机器学习 · 计算机科学 2025-11-12 Rishabh Agrawal , Yusuf Alvi , Rahul Jain , Ashutosh Nayyar

Offline reinforcement learning (RL) suffers from the distribution shift between the offline dataset and the online environment. In multi-agent RL (MARL), this distribution shift may arise from the nonstationary opponents in the online…

机器学习 · 计算机科学 2025-02-25 Tao Li , Juan Guevara , Xinhong Xie , Quanyan Zhu

Offline reinforcement learning leverages previously-collected offline datasets to learn optimal policies with no necessity to access the real environment. Such a paradigm is also desirable for multi-agent reinforcement learning (MARL)…

机器学习 · 计算机科学 2022-06-13 Linghui Meng , Muning Wen , Yaodong Yang , Chenyang Le , Xiyun Li , Weinan Zhang , Ying Wen , Haifeng Zhang , Jun Wang , Bo Xu

Model-based offline reinforcement learning trains policies using pre-collected datasets and learned environment models, eliminating the need for direct real-world environment interaction. However, this paradigm is inherently challenged by…

机器学习 · 计算机科学 2025-10-28 Wang Luo , Haoran Li , Zicheng Zhang , Congying Han , Chi Zhou , Jiayu Lv , Tiande Guo

Offline reinforcement learning (RL) seeks to learn optimal policies from static datasets without interacting with the environment. A common challenge is handling multi-modal action distributions, where multiple behaviours are represented in…

机器学习 · 计算机科学 2025-03-20 Mianchu Wang , Yue Jin , Giovanni Montana

Flocking control is a significant problem in multi-agent systems such as multi-agent unmanned aerial vehicles and multi-agent autonomous underwater vehicles, which enhances the cooperativity and safety of agents. In contrast to traditional…

机器学习 · 计算机科学 2022-09-20 Yunbo Qiu , Yuzhu Zhan , Yue Jin , Jian Wang , Xudong Zhang

This work studies the application of Multi-Agent Reinforcement Learning (MARL) to decentralized control of unmanned aerial vehicles to relay a critical data package to a known position. For this purpose, a family of deterministic games is…

系统与控制 · 电气工程与系统科学 2026-05-11 Mika Persson , Jonas Lidman , Jacob Ljungberg , Samuel Sandelius , Adam Andersson

Training multiple agents to coordinate is an essential problem with applications in robotics, game theory, economics, and social sciences. However, most existing Multi-Agent Reinforcement Learning (MARL) methods are online and thus…

机器学习 · 计算机科学 2024-01-19 Paul Barde , Jakob Foerster , Derek Nowrouzezahrai , Amy Zhang

Many advances in cooperative multi-agent reinforcement learning (MARL) are based on two common design principles: value decomposition and parameter sharing. A typical MARL algorithm of this fashion decomposes a centralized Q-function into…

人工智能 · 计算机科学 2022-08-09 Wei Fu , Chao Yu , Zelai Xu , Jiaqi Yang , Yi Wu

Offline reinforcement learning (RL) looks at learning how to optimally solve tasks using a fixed dataset of interactions from the environment. Many off-policy algorithms developed for online learning struggle in the offline setting as they…

机器学习 · 计算机科学 2025-03-18 Natinael Solomon Neggatu , Jeremie Houssineau , Giovanni Montana

Reinforcement learning in partially observable domains is challenging due to the lack of observable state information. Thankfully, learning offline in a simulator with such state information is often possible. In particular, we propose a…

机器人学 · 计算机科学 2022-11-11 Hai Nguyen , Andrea Baisero , Dian Wang , Christopher Amato , Robert Platt

We posit a new mechanism for cooperation in multi-agent reinforcement learning (MARL) based upon any nonlinear function of the team's long-term state-action occupancy measure, i.e., a \emph{general utility}. This subsumes the cumulative…

机器学习 · 统计学 2021-06-25 Junyu Zhang , Amrit Singh Bedi , Mengdi Wang , Alec Koppel