English
Related papers

Related papers: Robot Policy Transfer with Online Demonstrations: …

200 papers

Random delays weaken the temporal correspondence between actions and subsequent state feedback, making it difficult for agents to identify the true propagation process of action effects. In cross-task scenarios, changes in task objectives…

Machine Learning · Computer Science 2026-05-13 Chenran Zhao , Dianxi Shi , Yaowen Zhang , Chunping Qiu , Shaowu Yang

Learning control policies in simulation enables rapid, safe, and cost-effective development of advanced robotic capabilities. However, transferring these policies to the real world remains difficult due to the sim-to-real gap, where…

Robotics · Computer Science 2026-01-16 Jiahe Pan , Jiaxu Xing , Rudolf Reiter , Yifan Zhai , Elie Aljalbout , Davide Scaramuzza

Reinforcement learning (RL) is widely used in autonomous driving tasks and training RL models typically involves in a multi-step process: pre-training RL models on simulators, uploading the pre-trained model to real-life robots, and…

Machine Learning · Computer Science 2019-10-15 Xinle Liang , Yang Liu , Tianjian Chen , Ming Liu , Qiang Yang

Robots could learn their own state and world representation from perception and experience without supervision. This desirable goal is the main focus of our field of interest, state representation learning (SRL). Indeed, a compact…

Machine Learning · Computer Science 2021-09-28 Astrid Merckling , Alexandre Coninx , Loic Cressot , Stéphane Doncieux , Nicolas Perrin-Gilbert

Reinforcement learning (RL) algorithms have proven transformative in a range of domains. To tackle real-world domains, these systems often use neural networks to learn policies directly from pixels or other high-dimensional sensory input.…

Machine Learning · Computer Science 2025-10-02 Nishil Patel , Sebastian Lee , Stefano Sarao Mannelli , Sebastian Goldt , Andrew Saxe

Efficiently training control policies for robots is a major challenge that can greatly benefit from utilizing knowledge gained from training similar systems through cross-embodiment knowledge transfer. In this work, we focus on accelerating…

Robotics · Computer Science 2026-02-18 Welf Rehberg , Mihir Kulkarni , Philipp Weiss , Kostas Alexis

Domain randomization has emerged as a fundamental technique in reinforcement learning (RL) to facilitate the transfer of policies from simulation to real-world robotic applications. Many existing domain randomization approaches have been…

Recent advances in hierarchical robot systems leverage a high-level planner to propose task plans and a low-level policy to generate robot actions. This design allows training the planner on action-free or even non-robot data sources (e.g.,…

Robotics · Computer Science 2026-02-13 Yitian Zheng , Zhangchen Ye , Weijun Dong , Shengjie Wang , Yuyang Liu , Chongjie Zhang , Chuan Wen , Yang Gao

This paper addresses the problem of designing control policies for agents with unknown stochastic dynamics and control objectives specified using Linear Temporal Logic (LTL). Recent Deep Reinforcement Learning (DRL) algorithms have aimed to…

Robotics · Computer Science 2025-04-23 Jun Wang , Hosein Hasanbeig , Kaiyuan Tan , Zihe Sun , Yiannis Kantaros

The process of developing control functions for embedded systems is resource-, time-, and data-intensive, often resulting in sub-optimal cost and solutions approaches. Reinforcement Learning (RL) has great potential for autonomously…

Machine Learning · Computer Science 2025-03-06 Mario Picerno , Lucas Koch , Kevin Badalian , Marius Wegener , Joschka Schaub , Charles Robert Koch , Jakob Andert

Designing agents that acquire knowledge autonomously and use it to solve new tasks efficiently is an important challenge in reinforcement learning. Knowledge acquired during an unsupervised pre-training phase is often transferred by…

Recent advances in behavior cloning (BC) have enabled impressive visuomotor control policies. However, these approaches are limited by the quality of human demonstrations, the manual effort required for data collection, and the diminishing…

Robotics · Computer Science 2025-09-29 Lars Ankile , Zhenyu Jiang , Rocky Duan , Guanya Shi , Pieter Abbeel , Anusha Nagabandi

The goal of offline reinforcement learning is to learn a policy from a fixed dataset, without further interactions with the environment. This setting will be an increasingly more important paradigm for real-world applications of…

Robotics · Computer Science 2020-11-17 Wenxuan Zhou , Sujay Bajracharya , David Held

Autonomous robots require high degrees of cognitive and motoric intelligence to come into our everyday life. In non-structured environments and in the presence of uncertainties, such degrees of intelligence are not easy to obtain.…

Learning from Demonstration is increasingly used for transferring operator manipulation skills to robots. In practice, it is important to cater for limited data and imperfect human demonstrations, as well as underlying safety constraints.…

Robotics · Computer Science 2020-04-03 Ya-Yen Tsai , Bo Xiao , Edward Johns , Guang-Zhong Yang

Most current methods for learning from demonstrations assume that those demonstrations alone are sufficient to learn the underlying task. This is often untrue, especially if extra safety specifications exist which were not present in the…

Machine Learning · Computer Science 2020-05-26 Craig Innes , Subramanian Ramamoorthy

Existing learning from demonstration algorithms usually assume access to expert demonstrations. However, this assumption is limiting in many real-world applications since the collected demonstrations may be suboptimal or even consist of…

Robotics · Computer Science 2022-03-03 Zhangjie Cao , Zihan Wang , Dorsa Sadigh

In collaborative human-robot order picking systems, human pickers and Autonomous Mobile Robots (AMRs) travel independently through a warehouse and meet at pick locations where pickers load items onto the AMRs. In this paper, we consider an…

We introduce an offline reinforcement learning (RL) algorithm that explicitly clones a behavior policy to constrain value learning. In offline RL, it is often important to prevent a policy from selecting unobserved actions, since the…

Machine Learning · Computer Science 2022-06-03 Wonjoon Goo , Scott Niekum

One of the key challenges in applying reinforcement learning to complex robotic control tasks is the need to gather large amounts of experience in order to find an effective policy for the task at hand. Model-based reinforcement learning…

Machine Learning · Computer Science 2016-08-12 Justin Fu , Sergey Levine , Pieter Abbeel