English
Related papers

Related papers: Reward Learning from Suboptimal Demonstrations wit…

200 papers

Learning from Demonstration (LfD) is a framework that allows lay users to easily program robots. However, the efficiency of robot learning and the robot's ability to generalize to task variations hinges upon the quality and quantity of the…

Learning-from-demonstrations is an emerging paradigm to obtain effective robot control policies for complex tasks via reinforcement learning without the need to explicitly design reward functions. However, it is susceptible to imperfections…

Robotics · Computer Science 2021-02-16 Aniruddh G. Puranic , Jyotirmoy V. Deshmukh , Stefanos Nikolaidis

Reinforcement learning (RL) is a central problem in artificial intelligence. This problem consists of defining artificial agents that can learn optimal behaviour by interacting with an environment -- where the optimal behaviour is defined…

Humans generally teach their fellow collaborators to perform tasks through a small number of demonstrations. The learnt task is corrected or extended to meet specific task goals by means of coaching. Adopting a similar framework for…

The current work on reinforcement learning (RL) from demonstrations often assumes the demonstrations are samples from an optimal policy, an unrealistic assumption in practice. When demonstrations are generated by sub-optimal policies or…

Machine Learning · Computer Science 2022-05-24 Yu Wang , Fang Liu

Model-based reinforcement learning (RL) has proven to be a data efficient approach for learning control tasks but is difficult to utilize in domains with complex observations such as images. In this paper, we present a method for learning…

Machine Learning · Computer Science 2019-06-25 Marvin Zhang , Sharad Vikram , Laura Smith , Pieter Abbeel , Matthew J. Johnson , Sergey Levine

Learning near-optimal behaviour from an expert's demonstrations typically relies on the assumption that the learner knows the features that the true reward function depends on. In this paper, we study the problem of learning from…

Machine Learning · Computer Science 2019-03-28 Luis Haug , Sebastian Tschiatschek , Adish Singla

Learning from demonstration (LfD) is commonly considered to be a natural and intuitive way to allow novice users to teach motor skills to robots. However, it is important to acknowledge that the effectiveness of LfD is heavily dependent on…

Robotics · Computer Science 2021-05-14 Marina Y. Aoyama , Matthew Howard

We present a novel Learning from Demonstration (LfD) method, Deformable Manipulation from Demonstrations (DMfD), to solve deformable manipulation tasks using states or images as inputs, given expert demonstrations. Our method uses…

Robotics · Computer Science 2022-07-22 Gautam Salhotra , I-Chun Arthur Liu , Marcus Dominguez-Kuhne , Gaurav S. Sukhatme

The combination of deep neural network models and reinforcement learning algorithms can make it possible to learn policies for robotic behaviors that directly read in raw sensory inputs, such as camera images, effectively subsuming both…

Machine Learning · Computer Science 2019-05-17 Avi Singh , Larry Yang , Kristian Hartikainen , Chelsea Finn , Sergey Levine

Learning from Demonstration (LfD) enables robots to acquire versatile skills by learning motion policies from human demonstrations. It endows users with an intuitive interface to transfer new skills to robots without the need for…

Robotics · Computer Science 2023-10-27 Jianyong Sun , Jens Kober , Michael Gienger , Jihong Zhu

Teaching robots novel skills with demonstrations via human-in-the-loop data collection techniques like kinesthetic teaching or teleoperation puts a heavy burden on human supervisors. In contrast to this paradigm, it is often significantly…

Robotics · Computer Science 2024-04-24 Daniel Yang , Davin Tjia , Jacob Berg , Dima Damen , Pulkit Agrawal , Abhishek Gupta

Learning from Demonstration (LfD) approaches empower end-users to teach robots novel tasks via demonstrations of the desired behaviors, democratizing access to robotics. However, current LfD frameworks are not capable of fast adaptation to…

Machine Learning · Computer Science 2025-05-29 Letian Chen , Sravan Jayanthi , Rohan Paleja , Daniel Martin , Viacheslav Zakharov , Matthew Gombolay

Learning from Demonstration (LfD) is a popular approach for robots to acquire new skills, but most LfD methods suffer from imperfections in human demonstrations. Prior work typically treats these suboptimalities as random noise. In this…

Robotics · Computer Science 2025-12-18 Shijie Fang , Hang Yu , Qidi Fang , Reuben M. Aronson , Elaine S. Short

Deep reinforcement learning (DRL) provides a new way to generate robot control policy. However, the process of training control policy requires lengthy exploration, resulting in a low sample efficiency of reinforcement learning (RL) in…

Machine Learning · Computer Science 2022-12-08 Chao Li

Cinematic camera control demands a balance of precision and artistry - qualities that are difficult to encode through handcrafted reward functions. While reinforcement learning (RL) has been applied to robotic filmmaking, its reliance on…

Robotics · Computer Science 2025-09-03 Philip Lorimer , Alan Hunter , Wenbin Li

In this work, we develop an open-source surgical simulation environment that includes a realistic model obtained by MRI-scanning a physical phantom, for the purpose of training and evaluating a Learning from Demonstration (LfD) algorithm…

Robotics · Computer Science 2025-02-03 Haoying Zhou , Yiwei Jiang , Shang Gao , Shiyue Wang , Peter Kazanzides , Gregory S. Fischer

Learning from demonstration (LfD) is a technique that allows expert teachers to teach task-oriented skills to robotic systems. However, the most effective way of guiding novice teachers to approach expert-level demonstrations quantitatively…

Robotics · Computer Science 2025-05-16 Endong Sun , Yuqing Zhu , Matthew Howard

Reinforcement learning offers the promise of automating the acquisition of complex behavioral skills. However, compared to commonly used and well-understood supervised learning methods, reinforcement learning algorithms can be brittle,…

Machine Learning · Computer Science 2020-01-01 Aviral Kumar , Xue Bin Peng , Sergey Levine

In complex environments with high dimension, training a reinforcement learning (RL) model from scratch often suffers from lengthy and tedious collection of agent-environment interactions. Instead, leveraging expert demonstration to guide RL…

Machine Learning · Computer Science 2021-09-28 Zhaorun Chen , Binhao Chen , Shenghan Xie , Liang Gong , Chengliang Liu , Zhengfeng Zhang , Junping Zhang