English
Related papers

Related papers: Cross-Embodiment Offline Reinforcement Learning fo…

200 papers

This paper focuses on transferring control policies between robot manipulators with different morphology. While reinforcement learning (RL) methods have shown successful results in robot manipulation tasks, transferring a trained policy…

Robotics · Computer Science 2024-06-05 Tianyu Wang , Dwait Bhatt , Xiaolong Wang , Nikolay Atanasov

Leveraging many sources of offline robot data requires grappling with the heterogeneity of such data. In this paper, we focus on one particular aspect of heterogeneity: learning from offline data collected at different control frequencies.…

Machine Learning · Computer Science 2022-07-27 Kaylee Burns , Tianhe Yu , Chelsea Finn , Karol Hausman

Recently, Offline Reinforcement Learning (RL) has achieved remarkable progress with the emergence of various algorithms and datasets. However, these methods usually focus on algorithmic advancements, ignoring that many low-level…

Machine Learning · Computer Science 2023-06-02 Bingyi Kang , Xiao Ma , Yirui Wang , Yang Yue , Shuicheng Yan

Several approaches have been proposed to improve the sample efficiency of online reinforcement learning (RL) by leveraging demonstrations collected offline. The offline data can be used directly as transitions to optimize RL objectives, or…

Robotics · Computer Science 2026-03-31 Dwait Bhatt , Shih-Chieh Chou , Nikolay Atanasov

Cross-embodiment learning seeks to build generalist robots that operate across diverse morphologies, but differences in action spaces and kinematics hinder data sharing and policy transfer. This raises a central question: Is there any…

Robotics · Computer Science 2025-11-11 Zihao He , Bo Ai , Tongzhou Mu , Yulin Liu , Weikang Wan , Jiawei Fu , Yilun Du , Henrik I. Christensen , Hao Su

Reinforcement Learning (RL) is notoriously data-inefficient, which makes training on a real robot difficult. While model-based RL algorithms (world models) improve data-efficiency to some extent, they still require hours or days of…

Machine Learning · Computer Science 2023-10-25 Yunhai Feng , Nicklas Hansen , Ziyan Xiong , Chandramouli Rajagopalan , Xiaolong Wang

Large, high-capacity models trained on diverse datasets have shown remarkable successes on efficiently tackling downstream applications. In domains from NLP to Computer Vision, this has led to a consolidation of pretrained models, with…

Robotics · Computer Science 2025-05-15 Embodiment Collaboration , Abby O'Neill , Abdul Rehman , Abhinav Gupta , Abhiram Maddukuri , Abhishek Gupta , Abhishek Padalkar , Abraham Lee , Acorn Pooley , Agrim Gupta , Ajay Mandlekar , Ajinkya Jain , Albert Tung , Alex Bewley , Alex Herzog , Alex Irpan , Alexander Khazatsky , Anant Rai , Anchit Gupta , Andrew Wang , Andrey Kolobov , Anikait Singh , Animesh Garg , Aniruddha Kembhavi , Annie Xie , Anthony Brohan , Antonin Raffin , Archit Sharma , Arefeh Yavary , Arhan Jain , Ashwin Balakrishna , Ayzaan Wahid , Ben Burgess-Limerick , Beomjoon Kim , Bernhard Schölkopf , Blake Wulfe , Brian Ichter , Cewu Lu , Charles Xu , Charlotte Le , Chelsea Finn , Chen Wang , Chenfeng Xu , Cheng Chi , Chenguang Huang , Christine Chan , Christopher Agia , Chuer Pan , Chuyuan Fu , Coline Devin , Danfei Xu , Daniel Morton , Danny Driess , Daphne Chen , Deepak Pathak , Dhruv Shah , Dieter Büchler , Dinesh Jayaraman , Dmitry Kalashnikov , Dorsa Sadigh , Edward Johns , Ethan Foster , Fangchen Liu , Federico Ceola , Fei Xia , Feiyu Zhao , Felipe Vieira Frujeri , Freek Stulp , Gaoyue Zhou , Gaurav S. Sukhatme , Gautam Salhotra , Ge Yan , Gilbert Feng , Giulio Schiavi , Glen Berseth , Gregory Kahn , Guangwen Yang , Guanzhi Wang , Hao Su , Hao-Shu Fang , Haochen Shi , Henghui Bao , Heni Ben Amor , Henrik I Christensen , Hiroki Furuta , Homanga Bharadhwaj , Homer Walke , Hongjie Fang , Huy Ha , Igor Mordatch , Ilija Radosavovic , Isabel Leal , Jacky Liang , Jad Abou-Chakra , Jaehyung Kim , Jaimyn Drake , Jan Peters , Jan Schneider , Jasmine Hsu , Jay Vakil , Jeannette Bohg , Jeffrey Bingham , Jeffrey Wu , Jensen Gao , Jiaheng Hu , Jiajun Wu , Jialin Wu , Jiankai Sun , Jianlan Luo , Jiayuan Gu , Jie Tan , Jihoon Oh , Jimmy Wu , Jingpei Lu , Jingyun Yang , Jitendra Malik , João Silvério , Joey Hejna , Jonathan Booher , Jonathan Tompson , Jonathan Yang , Jordi Salvador , Joseph J. Lim , Junhyek Han , Kaiyuan Wang , Kanishka Rao , Karl Pertsch , Karol Hausman , Keegan Go , Keerthana Gopalakrishnan , Ken Goldberg , Kendra Byrne , Kenneth Oslund , Kento Kawaharazuka , Kevin Black , Kevin Lin , Kevin Zhang , Kiana Ehsani , Kiran Lekkala , Kirsty Ellis , Krishan Rana , Krishnan Srinivasan , Kuan Fang , Kunal Pratap Singh , Kuo-Hao Zeng , Kyle Hatch , Kyle Hsu , Laurent Itti , Lawrence Yunliang Chen , Lerrel Pinto , Li Fei-Fei , Liam Tan , Linxi "Jim" Fan , Lionel Ott , Lisa Lee , Luca Weihs , Magnum Chen , Marion Lepert , Marius Memmel , Masayoshi Tomizuka , Masha Itkina , Mateo Guaman Castro , Max Spero , Maximilian Du , Michael Ahn , Michael C. Yip , Mingtong Zhang , Mingyu Ding , Minho Heo , Mohan Kumar Srirama , Mohit Sharma , Moo Jin Kim , Muhammad Zubair Irshad , Naoaki Kanazawa , Nicklas Hansen , Nicolas Heess , Nikhil J Joshi , Niko Suenderhauf , Ning Liu , Norman Di Palo , Nur Muhammad Mahi Shafiullah , Oier Mees , Oliver Kroemer , Osbert Bastani , Pannag R Sanketi , Patrick "Tree" Miller , Patrick Yin , Paul Wohlhart , Peng Xu , Peter David Fagan , Peter Mitrano , Pierre Sermanet , Pieter Abbeel , Priya Sundaresan , Qiuyu Chen , Quan Vuong , Rafael Rafailov , Ran Tian , Ria Doshi , Roberto Martín-Martín , Rohan Baijal , Rosario Scalise , Rose Hendrix , Roy Lin , Runjia Qian , Ruohan Zhang , Russell Mendonca , Rutav Shah , Ryan Hoque , Ryan Julian , Samuel Bustamante , Sean Kirmani , Sergey Levine , Shan Lin , Sherry Moore , Shikhar Bahl , Shivin Dass , Shubham Sonawani , Shubham Tulsiani , Shuran Song , Sichun Xu , Siddhant Haldar , Siddharth Karamcheti , Simeon Adebola , Simon Guist , Soroush Nasiriany , Stefan Schaal , Stefan Welker , Stephen Tian , Subramanian Ramamoorthy , Sudeep Dasari , Suneel Belkhale , Sungjae Park , Suraj Nair , Suvir Mirchandani , Takayuki Osa , Tanmay Gupta , Tatsuya Harada , Tatsuya Matsushima , Ted Xiao , Thomas Kollar , Tianhe Yu , Tianli Ding , Todor Davchev , Tony Z. Zhao , Travis Armstrong , Trevor Darrell , Trinity Chung , Vidhi Jain , Vikash Kumar , Vincent Vanhoucke , Vitor Guizilini , Wei Zhan , Wenxuan Zhou , Wolfram Burgard , Xi Chen , Xiangyu Chen , Xiaolong Wang , Xinghao Zhu , Xinyang Geng , Xiyuan Liu , Xu Liangwei , Xuanlin Li , Yansong Pang , Yao Lu , Yecheng Jason Ma , Yejin Kim , Yevgen Chebotar , Yifan Zhou , Yifeng Zhu , Yilin Wu , Ying Xu , Yixuan Wang , Yonatan Bisk , Yongqiang Dou , Yoonyoung Cho , Youngwoon Lee , Yuchen Cui , Yue Cao , Yueh-Hua Wu , Yujin Tang , Yuke Zhu , Yunchu Zhang , Yunfan Jiang , Yunshuang Li , Yunzhu Li , Yusuke Iwasawa , Yutaka Matsuo , Zehan Ma , Zhuo Xu , Zichen Jeff Cui , Zichen Zhang , Zipeng Fu , Zipeng Lin

Robust reinforcement learning (RL) aims to learn policies that remain effective despite uncertainties in its environment, which frequently arise in real-world applications due to variations in environment dynamics. The robust RL methods…

Machine Learning · Computer Science 2025-05-30 Linh Le Pham Van , Minh Hoang Nguyen , Hung Le , Hung The Tran , Sunil Gupta

Offline reinforcement learning (RL) refers to the problem of learning policies from a static dataset of environment interactions. Offline RL enables extensive use and re-use of historical datasets, while also alleviating safety concerns…

Machine Learning · Computer Science 2020-12-22 Rafael Rafailov , Tianhe Yu , Aravind Rajeswaran , Chelsea Finn

Offline reinforcement learning, which learns solely from datasets without environmental interaction, has gained attention. This approach, similar to traditional online deep reinforcement learning, is particularly promising for robot control…

Robotics · Computer Science 2025-07-21 Shingo Ayabe , Takuto Otomo , Hiroshi Kera , Kazuhiko Kawamoto

Offline reinforcement learning (offline RL) offers a promising framework for developing control strategies in chemical process systems using historical data, without the risks or costs of online experimentation. This work investigates the…

Systems and Control · Electrical Eng. & Systems 2025-07-31 Alex Durkin , Jasper Stolte , Matthew Jones , Raghuraman Pitchumani , Bei Li , Christian Michler , Mehmet Mercangöz

Future robotic systems operating in real-world environments will require on-board embodied intelligence without continuous cloud connection, balancing capabilities with constraints on computational power and memory. This work presents an…

Robotics · Computer Science 2025-09-03 Liam Boyle , Nicolas Baumann , Paviththiren Sivasothilingam , Michele Magno , Luca Benini

Offline Reinforcement Learning (RL) aims to turn large datasets into powerful decision-making engines without any online interactions with the environment. This great promise has motivated a large amount of research that hopes to replicate…

Machine Learning · Computer Science 2020-12-01 Louis Monier , Jakub Kmec , Alexandre Laterre , Thomas Pierrot , Valentin Courgeau , Olivier Sigaud , Karim Beguir

Offline reinforcement learning (RL) offers a powerful paradigm for data-driven control. Compared to model-free approaches, offline model-based RL (MBRL) explicitly learns a world model from a static dataset and uses it as a surrogate…

Machine Learning · Computer Science 2026-02-02 Jiayu Chen , Le Xu , Aravind Venugopal , Jeff Schneider

In offline model-based reinforcement learning (offline MBRL), we learn a dynamic model from historically collected data, and subsequently utilize the learned model and fixed datasets for policy learning, without further interacting with the…

Machine Learning · Computer Science 2022-10-13 Shentao Yang , Shujian Zhang , Yihao Feng , Mingyuan Zhou

Pretraining reinforcement learning (RL) models on offline datasets is a promising way to improve their training efficiency in online tasks, but challenging due to the inherent mismatch in dynamics and behaviors across various tasks. We…

Machine Learning · Computer Science 2024-06-06 Minting Pan , Yitao Zheng , Yunbo Wang , Xiaokang Yang

Offline reinforcement learning enables sample-efficient policy acquisition without risky online interaction, yet policies trained on static datasets remain brittle under action-space perturbations such as actuator faults. This study…

Robotics · Computer Science 2026-03-02 Shingo Ayabe , Hiroshi Kera , Kazuhiko Kawamoto

Humanoid robots are envisioned as embodied intelligent agents capable of performing a wide range of human-level loco-manipulation tasks, particularly in scenarios requiring strenuous and repetitive labor. However, learning these skills is…

Robotics · Computer Science 2024-12-20 Junjia Liu , Zhuo Li , Minghao Yu , Zhipeng Dong , Sylvain Calinon , Darwin Caldwell , Fei Chen

Reinforcement learning (RL) has shown promise for decision-making tasks in real-world applications. One practical framework involves training parameterized policy models from an offline dataset and subsequently deploying them in an online…

Machine Learning · Computer Science 2023-03-14 Ziniu Li , Ke Xu , Liu Liu , Lanqing Li , Deheng Ye , Peilin Zhao

Imitation learning has proven effective for training robots to perform complex tasks from expert human demonstrations. However, it remains limited by its reliance on high-quality, task-specific data, restricting adaptability to the diverse…