中文
相关论文

相关论文: Video-Enhanced Offline Reinforcement Learning: A M…

200 篇论文

Offline Reinforcement Learning (RL) via Supervised Learning is a simple and effective way to learn robotic skills from a dataset collected by policies of different expertise levels. It is as simple as supervised learning and Behavior…

机器学习 · 统计学 2022-10-25 Alexandre Piche , Rafael Pardinas , David Vazquez , Igor Mordatch , Chris Pal

Leveraging offline data is a promising way to improve the sample efficiency of online reinforcement learning (RL). This paper expands the pool of usable data for offline-to-online RL by leveraging abundant non-curated data that is…

Offline Reinforcement Learning (ORL) enablesus to separately study the two interlinked processes of reinforcement learning: collecting informative experience and inferring optimal behaviour. The second step has been widely studied in the…

In safe offline reinforcement learning (RL), the objective is to develop a policy that maximizes cumulative rewards while strictly adhering to safety constraints, utilizing only offline data. Traditional methods often face difficulties in…

机器学习 · 计算机科学 2026-02-11 Prajwal Koirala , Zhanhong Jiang , Soumik Sarkar , Cody Fleming

In offline reinforcement learning (RL), the goal is to learn a highly rewarding policy based solely on a dataset of historical interactions with the environment. The ability to train RL policies offline can greatly expand the applicability…

机器学习 · 计算机科学 2021-03-03 Rahul Kidambi , Aravind Rajeswaran , Praneeth Netrapalli , Thorsten Joachims

Offline reinforcement learning (RL) aims to optimize the return given a fixed dataset of agent trajectories without additional interactions with the environment. While algorithm development has progressed rapidly, significant theoretical…

机器学习 · 计算机科学 2025-08-12 Fengdi Che

Meta-reinforcement learning (RL) methods can meta-train policies that adapt to new tasks with orders of magnitude less data than standard RL, but meta-training itself is costly and time-consuming. If we can meta-train on offline data, then…

机器学习 · 计算机科学 2022-07-08 Vitchyr H. Pong , Ashvin Nair , Laura Smith , Catherine Huang , Sergey Levine

Reinforcement learning is a powerful framework for robots to acquire skills from experience, but often requires a substantial amount of online data collection. As a result, it is difficult to collect sufficiently diverse experiences that…

机器学习 · 计算机科学 2021-11-08 Karl Schmeckpeper , Oleh Rybkin , Kostas Daniilidis , Sergey Levine , Chelsea Finn

Precise robot manipulation is critical for fine-grained applications such as chemical and biological experiments, where even small errors (e.g., reagent spillage) can invalidate an entire task. Existing approaches often rely on…

机器人学 · 计算机科学 2026-02-13 Xiangyu Chen , Chuhao Zhou , Yuxi Liu , Jianfei Yang

Offline-to-online reinforcement learning (RL), a framework that trains a policy with offline RL and then further fine-tunes it with online RL, has been considered a promising recipe for data-driven decision-making. While sensible, this…

机器学习 · 计算机科学 2024-08-28 Junsu Kim , Seohong Park , Sergey Levine

Offline reinforcement learning (RL) enables policy learning from static data but often suffers from poor coverage of the state-action space and distributional shift problems. This problem can be addressed by allowing limited online…

机器学习 · 计算机科学 2026-02-03 Soumyadeep Roy , Shashwat Kushwaha , Ambedkar Dukkipati

Online reinforcement learning (RL) methods are often data-inefficient or unreliable, making them difficult to train on real robotic hardware, especially quadruped robots. Learning robotic tasks from pre-collected data is a promising…

机器人学 · 计算机科学 2024-10-28 Hongyin Zhang , Shuyu Yang , Donglin Wang

Reinforcement learning is considered as a promising direction for driving policy learning. However, training autonomous driving vehicle with reinforcement learning in real environment involves non-affordable trial-and-error. It is more…

人工智能 · 计算机科学 2017-09-27 Xinlei Pan , Yurong You , Ziyan Wang , Cewu Lu

Offline reinforcement learning has emerged as a promising technology by enhancing its practicality through the use of pre-collected large datasets. Despite its practical benefits, most algorithm development research in offline reinforcement…

机器学习 · 计算机科学 2024-10-23 Dongsu Lee , Chanin Eom , Minhae Kwon

Online reinforcement learning in complex tasks is time-consuming, as massive interaction steps are needed to learn the optimal Q-function.Vision-language action (VLA) policies represent a promising direction for solving diverse tasks;…

机器学习 · 计算机科学 2025-09-26 Xiefeng Wu , Jing Zhao , Shu Zhang , Mingyu Hu

Autonomous driving policy learning with reinforcement learning (RL) is fundamentally limited by low sample efficiency, weak generalization, and a dependence on unsafe online trial-and-error interactions. Although safe RL introduces explicit…

机器人学 · 计算机科学 2026-03-31 Yansong Qu , Zilin Huang , Zihao Sheng , Jiancong Chen , Yue Leng , Samuel Labi , Sikai Chen

Offline reinforcement learning (RL), also known as batch RL, offers the prospect of policy optimization from large pre-recorded datasets without online environment interaction. It addresses challenges with regard to the cost of data…

Conventional reinforcement learning (RL) needs an environment to collect fresh data, which is impractical when online interactions are costly. Offline RL provides an alternative solution by directly learning from the previously collected…

机器学习 · 计算机科学 2023-03-15 Han Zheng , Xufang Luo , Pengfei Wei , Xuan Song , Dongsheng Li , Jing Jiang

We consider the hybrid reinforcement learning setting where the agent has access to both offline data and online interactive access. While Reinforcement Learning (RL) research typically assumes offline data contains complete action, reward…

机器学习 · 计算机科学 2024-06-12 Yuda Song , J. Andrew Bagnell , Aarti Singh

Offline reinforcement learning (RL) provides a framework for learning decision-making from offline data and therefore constitutes a promising approach for real-world applications as automated driving. Self-driving vehicles (SDV) learn a…

机器人学 · 计算机科学 2022-06-29 Christopher Diehl , Timo Sievernich , Martin Krüger , Frank Hoffmann , Torsten Bertram