English
Related papers

Related papers: Robotic Offline RL from Internet Videos via Value-…

200 papers

Vision-language-action (VLA) models can learn to perform diverse manipulation skills "out of the box," but achieving the precision and speed that real-world tasks demand requires further fine-tuning -- for example, via reinforcement…

Machine Learning · Computer Science 2026-05-04 Charles Xu , Jost Tobias Springenberg , Michael Equi , Ali Amin , Adnan Esmail , Sergey Levine , Liyiming Ke

Offline Reinforcement Learning (RL) aims to learn a near-optimal policy from a fixed dataset of transitions collected by another policy. This problem has attracted a lot of attention recently, but most existing methods with strong…

Machine Learning · Computer Science 2023-05-23 Germano Gabbianelli , Gergely Neu , Nneka Okolo , Matteo Papini

Offline reinforcement learning (RL) can be used to improve future performance by leveraging historical data. There exist many different algorithms for offline RL, and it is well recognized that these algorithms, and their hyperparameter…

Machine Learning · Computer Science 2023-01-18 Allen Nie , Yannis Flet-Berliac , Deon R. Jordan , William Steenbergen , Emma Brunskill

Recently, offline reinforcement learning (RL) has become a popular RL paradigm. In offline RL, data providers share pre-collected datasets -- either as individual transitions or sequences of transitions forming trajectories -- to enable the…

Cryptography and Security · Computer Science 2025-12-17 Chen Gong , Zheng Liu , Kecen Li , Tianhao Wang

Deep reinforcement learning (RL) algorithms can learn complex robotic skills from raw sensory inputs, but have yet to achieve the kind of broad generalization and applicability demonstrated by deep learning methods in supervised domains. We…

Robotics · Computer Science 2018-12-04 Frederik Ebert , Chelsea Finn , Sudeep Dasari , Annie Xie , Alex Lee , Sergey Levine

Offline reinforcement learning (RL) enables the agent to effectively learn from logged data, which significantly extends the applicability of RL algorithms in real-world scenarios where exploration can be expensive or unsafe. Previous works…

Machine Learning · Computer Science 2022-12-05 Yiqin Yang , Hao Hu , Wenzhe Li , Siyuan Li , Jun Yang , Qianchuan Zhao , Chongjie Zhang

Offline preference-based reinforcement learning (RL), which focuses on optimizing policies using human preferences between pairs of trajectory segments selected from an offline dataset, has emerged as a practical avenue for RL applications.…

Machine Learning · Computer Science 2024-07-08 Chen-Xiao Gao , Shengjun Fang , Chenjun Xiao , Yang Yu , Zongzhang Zhang

In this work, we present a novel Reinforcement Learning (RL) algorithm for the off-road trajectory tracking problem. Off-road environments involve varying terrain types and elevations, and it is difficult to model the interaction dynamics…

Robotics · Computer Science 2021-10-07 Akhil Nagariya , Dileep Kalathil , Srikanth Saripalli

Imitation by observation is an approach for learning from expert demonstrations that lack action information, such as videos. Recent approaches to this problem can be placed into two broad categories: training dynamics models that aim to…

Machine Learning · Computer Science 2019-05-21 Ashley D. Edwards , Charles L. Isbell

Pretraining is a common technique in deep learning for increasing performance and reducing training time, with promising experimental results in deep reinforcement learning (RL). However, pretraining requires a relevant dataset for…

Machine Learning · Computer Science 2021-10-07 Saurav Kadavath , Samuel Paradis , Brian Yao

Visual Robot Manipulation (VRM) aims to enable a robot to follow natural language instructions based on robot states and visual observations, and therefore requires costly multi-modal data. To compensate for the deficiency of robot data,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Dejie Yang , Zijing Zhao , Yang Liu

Reinforcement learning (RL) with diverse offline datasets can have the advantage of leveraging the relation of multiple tasks and the common skills learned across those tasks, hence allowing us to deal with real-world complex problems…

Machine Learning · Computer Science 2024-08-29 Minjong Yoo , Sangwoo Cho , Honguk Woo

Offline reinforcement learning (RL) aims to learn an optimal policy from a static dataset, making it particularly valuable in scenarios where data collection is costly, such as robotics. A major challenge in offline RL is distributional…

Machine Learning · Computer Science 2025-07-16 Motoki Omura , Yusuke Mukuta , Kazuki Ota , Takayuki Osa , Tatsuya Harada

Simulation-based reinforcement learning (RL) has significantly advanced humanoid locomotion tasks, yet direct real-world RL from scratch or adapting from pretrained policies remains rare, limiting the full potential of humanoid robots.…

Robotics · Computer Science 2025-08-27 Kaizhe Hu , Haochen Shi , Yao He , Weizhuo Wang , C. Karen Liu , Shuran Song

Offline reinforcement learning (RL) has emerged as a promising framework for addressing robot social navigation challenges. However, inherent uncertainties in pedestrian behavior and limited environmental interaction during training often…

Robotics · Computer Science 2025-10-02 Run Su , Hao Fu , Shuai Zhou , Yingao Fu

Offline-to-online reinforcement learning (O2O RL) aims to obtain a continually improving policy as it interacts with the environment, while ensuring the initial policy behaviour is satisficing. This satisficing behaviour is necessary for…

Robotics · Computer Science 2025-01-24 Bryan Chan , Anson Leung , James Bergstra

Several approaches have been proposed to improve the sample efficiency of online reinforcement learning (RL) by leveraging demonstrations collected offline. The offline data can be used directly as transitions to optimize RL objectives, or…

Robotics · Computer Science 2026-03-31 Dwait Bhatt , Shih-Chieh Chou , Nikolay Atanasov

Offline reinforcement learning (RL) aims to learn policies without online explorations. To enlarge the training data, model-based offline RL learns a dynamics model which is utilized as a virtual environment to generate simulation data and…

Machine Learning · Computer Science 2025-07-11 Ziqi Zhao , Zhaochun Ren , Liu Yang , Yunsen Liang , Fajie Yuan , Pengjie Ren , Zhumin Chen , jun Ma , Xin Xin

Offline reinforcement learning (RL), also known as batch RL, offers the prospect of policy optimization from large pre-recorded datasets without online environment interaction. It addresses challenges with regard to the cost of data…

Reinforcement learning (RL) has shown significant promise for sequential portfolio optimization tasks, such as stock trading, where the objective is to maximize cumulative returns while minimizing risks using historical data. However,…

Machine Learning · Computer Science 2025-05-20 Haochen Yuan , Minting Pan , Yunbo Wang , Siyu Gao , Philip S. Yu , Xiaokang Yang