English
Related papers

Related papers: Ergodic imitation: Learning from what to do and wh…

200 papers

Learning from Demonstration (LfD) is a widely used technique for skill acquisition in robotics. However, demonstrations of the same skill may exhibit significant variances, or learning systems may attempt to acquire different means of the…

Robotics · Computer Science 2024-10-28 Yigit Yildirim , Emre Ugur

Multi-task learning ideally allows robots to acquire a diverse repertoire of useful skills. However, many multi-task reinforcement learning efforts assume the robot can collect data from all tasks at all times. In reality, the tasks that…

Machine Learning · Computer Science 2022-04-07 Annie Xie , Chelsea Finn

Reinforcement learning solely from an agent's self-generated data is often believed to be infeasible for learning on real robots, due to the amount of data needed. However, if done right, agents learning from real data can be surprisingly…

Recent evidence has shown that, contrary to expectations, it is difficult for users, especially novices, to teach robots tasks through LfD. This paper introduces a framework that leverages MT algorithms to train novices to become better…

Robotics · Computer Science 2024-09-25 Yuqing Zhu , Endong Sun , Matthew Howard

Learning from demonstration (LfD) has succeeded in tasks featuring a long time horizon. However, when the problem complexity also includes human-in-the-loop perturbations, state-of-the-art approaches do not guarantee the successful…

Robotics · Computer Science 2024-12-10 Yanwei Wang , Nadia Figueroa , Shen Li , Ankit Shah , Julie Shah

Learning from demonstration (LfD) is useful in settings where hand-coding behaviour or a reward function is impractical. It has succeeded in a wide range of problems but typically relies on manually generated demonstrations or specially…

Modular robots can be reconfigured to create a variety of designs from a small set of components. But constructing a robot's hardware on its own is not enough -- each robot needs a controller. One could create controllers for some designs…

Robotics · Computer Science 2022-11-01 Julian Whitman , Howie Choset

Recent years have witnessed many successful trials in the robot learning field. For contact-rich robotic tasks, it is challenging to learn coordinated motor skills by reinforcement learning. Imitation learning solves this problem by using a…

Robotics · Computer Science 2023-11-02 Linqi Ye , Jiayi Li , Yi Cheng , Xianhao Wang , Bin Liang , Yan Peng

In Imitation Learning (IL), utilizing suboptimal and heterogeneous demonstrations presents a substantial challenge due to the varied nature of real-world data. However, standard IL algorithms consider these datasets as homogeneous, thereby…

Machine Learning · Computer Science 2024-12-16 Mark Beliaev , Ramtin Pedarsani

Learning from demonstration (LfD) is the process of building behavioral models of a task from demonstrations provided by an expert. These models can be used e.g. for system control by generalizing the expert demonstrations to previously…

Machine Learning · Statistics 2017-08-07 Adrian Šošić , Abdelhak M. Zoubir , Heinz Koeppl

Specifying tasks for robotic systems traditionally requires coding expertise, deep domain knowledge, and significant time investment. While learning from demonstration offers a promising alternative, existing methods often struggle with…

Robotics · Computer Science 2024-09-12 Mattijs Baert , Sam Leroux , Pieter Simoens

Imitation learning is a popular approach for training visual navigation policies. However, collecting expert demonstrations for legged robots is challenging as these robots can be hard to control, move slowly, and cannot operate…

Artificial Intelligence · Computer Science 2020-03-05 Xinlei Pan , Tingnan Zhang , Brian Ichter , Aleksandra Faust , Jie Tan , Sehoon Ha

Robots can rapidly acquire new skills from demonstrations. However, during generalisation of skills or transitioning across fundamentally different skills, it is unclear whether the robot has the necessary knowledge to perform the task.…

Machine Learning · Statistics 2018-08-08 Nutan Chen , Alexej Klushyn , Alexandros Paraschos , Djalel Benbouzid , Patrick van der Smagt

Imitation learning (IL) aims to learn an optimal policy from demonstrations. However, such demonstrations are often imperfect since collecting optimal ones is costly. To effectively learn from imperfect demonstrations, we propose a novel…

Machine Learning · Computer Science 2019-01-31 Yueh-Hua Wu , Nontawat Charoenphakdee , Han Bao , Voot Tangkaratt , Masashi Sugiyama

When a person is not satisfied with how a robot performs a task, they can intervene to correct it. Reward learning methods enable the robot to adapt its reward function online based on such human input, but they rely on handcrafted…

Robotics · Computer Science 2021-01-13 Andreea Bobu , Marius Wiggert , Claire Tomlin , Anca D. Dragan

Teaching robots novel skills with demonstrations via human-in-the-loop data collection techniques like kinesthetic teaching or teleoperation puts a heavy burden on human supervisors. In contrast to this paradigm, it is often significantly…

Robotics · Computer Science 2024-04-24 Daniel Yang , Davin Tjia , Jacob Berg , Dima Damen , Pulkit Agrawal , Abhishek Gupta

Reinforcement learning (RL) often necessitates a meticulous Markov Decision Process (MDP) design tailored to each task. This work aims to address this challenge by proposing a systematic approach to behavior synthesis and control for…

Robotics · Computer Science 2024-10-18 Jean-Pierre Sleiman , Mayank Mittal , Marco Hutter

Learning from Demonstration (LfD) has emerged as a crucial method for robots to acquire new skills. However, when given suboptimal task trajectory demonstrations with shape characteristics reflecting human preferences but subpar dynamic…

Robotics · Computer Science 2025-04-21 Chenlin Ming , Zitong Wang , Boxuan Zhang , Zhanxiang Cao , Xiaoming Duan , Jianping He

In this paper, we present a robotic model-based reinforcement learning method that combines ideas from model identification and model predictive control. We use a feature-based representation of the dynamics that allows the dynamics model…

Machine Learning · Computer Science 2016-03-16 Christopher Xie , Sachin Patil , Teodor Moldovan , Sergey Levine , Pieter Abbeel

When demonstrating a task, human tutors pedagogically modify their behavior by either "showing" the task rather than just "doing" it (exaggerating on relevant parts of the demonstration) or by giving demonstrations that best disambiguate…

Machine Learning · Computer Science 2023-09-28 Hugo Caselles-Dupré , Mohamed Chetouani , Olivier Sigaud