中文
相关论文

相关论文: Offline-to-Online Multi-Agent Reinforcement Learni…

200 篇论文

Offline reinforcement learning (RL) defines the task of learning from a static logged dataset without continually interacting with the environment. The distribution shift between the learned policy and the behavior policy makes it necessary…

机器学习 · 计算机科学 2024-02-22 Jiafei Lyu , Xiaoteng Ma , Xiu Li , Zongqing Lu

We study the offline meta-reinforcement learning (OMRL) problem, a paradigm which enables reinforcement learning (RL) algorithms to quickly adapt to unseen tasks without any interactions with the environments, making RL truly practical in…

机器学习 · 计算机科学 2021-05-07 Lanqing Li , Rui Yang , Dijun Luo

Offline-to-online reinforcement learning (RL) is a training paradigm that combines pre-training on a pre-collected dataset with fine-tuning in an online environment. However, the incorporation of online fine-tuning can intensify the…

机器学习 · 计算机科学 2023-10-31 Shenzhi Wang , Qisen Yang , Jiawei Gao , Matthieu Gaetan Lin , Hao Chen , Liwei Wu , Ning Jia , Shiji Song , Gao Huang

Post-training algorithms based on deep reinforcement learning can push the limits of robotic models for specific objectives, such as generalizability, accuracy, and robustness. However, Intervention-requiring Failures (IR Failures) (e.g., a…

机器人学 · 计算机科学 2026-01-13 Huanyu Li , Kun Lei , Sheng Zang , Kaizhe Hu , Yongyuan Liang , Bo An , Xiaoli Li , Huazhe Xu

Training practical agents usually involve offline and online reinforcement learning (RL) to balance the policy's performance and interaction costs. In particular, online fine-tuning has become a commonly used method to correct the erroneous…

机器学习 · 计算机科学 2023-06-07 Qisen Yang , Shenzhi Wang , Matthieu Gaetan Lin , Shiji Song , Gao Huang

Multi-objective optimization of the textile manufacturing process is an increasing challenge because of the growing complexity involved in the development of the textile industry. The use of intelligent techniques has been often discussed…

人工智能 · 计算机科学 2020-12-03 Zhenglei He , Kim Phuc Tran , Sebastien Thomassey , Xianyi Zeng , Jie Xu , Changhai Yi

Offline reinforcement learning (RL) holds promise as a means to learn high-reward policies from a static dataset, without the need for further environment interactions. However, a key challenge in offline RL lies in effectively stitching…

机器学习 · 计算机科学 2023-09-14 Siddarth Venkatraman , Shivesh Khaitan , Ravi Tej Akella , John Dolan , Jeff Schneider , Glen Berseth

We discuss the problem of decentralized multi-agent reinforcement learning (MARL) in this work. In our setting, the global state, action, and reward are assumed to be fully observable, while the local policy is protected as privacy by each…

多智能体系统 · 计算机科学 2021-11-02 Kuo Li , Qing-Shan Jia

Value decomposition is a core approach for cooperative multi-agent reinforcement learning (MARL). However, existing methods still rely on a single optimal action and struggle to adapt when the underlying value function shifts during…

人工智能 · 计算机科学 2026-05-21 Yonghyeon Jo , Sunwoo Lee , Seungyul Han

Many advances that have improved the robustness and efficiency of deep reinforcement learning (RL) algorithms can, in one way or another, be understood as introducing additional objectives or constraints in the policy optimization step.…

Intraday surgical scheduling is a multi-objective decision problem under uncertainty-balancing elective throughput, urgent and emergency demand, delays, sequence-dependent setups, and overtime. We formulate the problem as a cooperative…

机器学习 · 计算机科学 2025-12-05 Kailiang Liu , Ying Chen , Ralf Borndörfer , Thorsten Koch

How should we learn visual representations for embodied agents that must see and move? The status quo is tabula rasa in vivo, i.e. learning visual representations from scratch while also learning to move, potentially augmented with…

计算机视觉与模式识别 · 计算机科学 2022-04-29 Karmesh Yadav , Ram Ramrakhya , Arjun Majumdar , Vincent-Pierre Berges , Sachit Kuhar , Dhruv Batra , Alexei Baevski , Oleksandr Maksymets

We present the extension of the Remember and Forget for Experience Replay (ReF-ER) algorithm to Multi-Agent Reinforcement Learning (MARL). ReF-ER was shown to outperform state of the art algorithms for continuous control in problems ranging…

机器学习 · 计算机科学 2022-09-05 Pascal Weber , Daniel Wälchli , Mustafa Zeqiri , Petros Koumoutsakos

Reinforcement learning (RL) is a powerful paradigm for learning to make sequences of decisions. However, RL has yet to be fully leveraged in robotics, principally due to its lack of scalability. Offline RL offers a promising avenue by…

机器学习 · 计算机科学 2025-10-10 Nicolas Espinosa-Dice , Kiante Brantley , Wen Sun

Multi-agent reinforcement learning (MARL) algorithms have made promising progress in recent years by leveraging the centralized training and decentralized execution (CTDE) paradigm. However, existing MARL algorithms still suffer from the…

机器学习 · 计算机科学 2021-10-20 Xiao Ma , Wu-Jun Li

Offline reinforcement learning (offline RL), which aims to find an optimal policy from a previously collected static dataset, bears algorithmic difficulties due to function approximation errors from out-of-distribution (OOD) data points. To…

机器学习 · 计算机科学 2021-10-06 Gaon An , Seungyong Moon , Jang-Hyun Kim , Hyun Oh Song

Offline Reinforcement Learning (RL) aims at learning an optimal control from a fixed dataset, without interactions with the system. An agent in this setting should avoid selecting actions whose consequences cannot be predicted from the…

Offline reinforcement learning (RL) seeks to learn optimal policies from static datasets without interacting with the environment. A common challenge is handling multi-modal action distributions, where multiple behaviours are represented in…

机器学习 · 计算机科学 2025-03-20 Mianchu Wang , Yue Jin , Giovanni Montana

We propose a new framework for multi-agent reinforcement learning (MARL), where the agents cooperate in a time-evolving network with latent community structures and mixed memberships. Unlike traditional neighbor-based or fixed interaction…

机器学习 · 计算机科学 2025-05-16 Zhaoyang Shi

Offline reinforcement learning endeavors to leverage offline datasets to craft effective agent policy without online interaction, which imposes proper conservative constraints with the support of behavior policies to tackle the…

机器学习 · 计算机科学 2024-11-12 Yunpeng Qing , Shunyu liu , Jingyuan Cong , Kaixuan Chen , Yihe Zhou , Mingli Song