English
Related papers

Related papers: DART: Noise Injection for Robust Imitation Learnin…

200 papers

While modern policy optimization methods can do complex manipulation from sensory data, they struggle on problems with extended time horizons and multiple sub-goals. On the other hand, task and motion planning (TAMP) methods scale to long…

Robotics · Computer Science 2021-12-08 Michael James McDonald , Dylan Hadfield-Menell

Generalist robot policies that can perform many tasks typically require extensive expert data or simulations for training. In this work, we propose a novel Data-Efficient multitask DAgger framework that distills a single multitask policy…

Machine Learning · Computer Science 2025-10-01 Haotian Fu , Ran Gong , Xiaohan Zhang , Maria Vittoria Minniti , Jigarkumar Patel , Karl Schmeckpeper

A common failure mode for policies trained with imitation is compounding execution errors at test time. When the learned policy encounters states that are not present in the expert demonstrations, the policy fails, leading to degenerate…

Robotics · Computer Science 2024-06-06 Xiaoyu Zhang , Matthew Chang , Pranav Kumar , Saurabh Gupta

Collecting human demonstrations via teleoperation is a common approach for teaching robots task-specific skills. However, when only a limited number of demonstrations are available, policies are prone to entering out-of-distribution (OOD)…

Robotics · Computer Science 2026-04-07 Rui Yan , Zaitian Gongye , Lars Paulsen , Xuxin Cheng , Xiaolong Wang

Humans can leverage hierarchical structures to split a task into sub-tasks and solve problems efficiently. Both imitation and reinforcement learning or a combination of them with hierarchical structures have been proven to be an efficient…

Robotics · Computer Science 2020-12-15 Yaru Niu , Yijun Gu

Imitation learning is an efficient method for teaching robots a variety of tasks. Diffusion Policy, which uses a conditional denoising diffusion process to generate actions, has demonstrated superior performance, particularly in learning…

Robotics · Computer Science 2025-08-14 Zhuoqun Chen , Xiu Yuan , Tongzhou Mu , Hao Su

Interactive imitation learning makes an agent's control policy robust by stepwise supervisions from an expert. The recent algorithms mostly employ expert-agent switching systems to reduce the expert's burden by limitedly selecting the…

Robotics · Computer Science 2026-04-23 Taisuke Kobayashi

Corrective interventions while a robot is learning to automate a task provide an intuitive method for a human supervisor to assist the robot and convey information about desired behavior. However, these interventions can impose significant…

This paper proposes a simple strategy for sim-to-real in Deep-Reinforcement Learning (DRL) -- called Roll-Drop -- that uses dropout during simulation to account for observation noise during deployment without explicitly modelling its…

In this paper, the application of imitation learning in caregiving robotics is explored, aiming at addressing the increasing demand for automated assistance in caring for the elderly and disabled. Leveraging advancements in deep learning…

Robotics · Computer Science 2024-07-30 Andrii Tytarenko

Recent advances in robot learning have enabled robots to become increasingly better at mastering a predefined set of tasks. On the other hand, as humans, we have the ability to learn a growing set of tasks over our lifetime. Continual robot…

Robotics · Computer Science 2021-12-21 Muhammad Burhan Hafez , Stefan Wermter

Evaluating deep reinforcement learning (DRL) agents against targeted behavior attacks is critical for assessing their robustness. These attacks aim to manipulate the victim into specific behaviors that align with the attacker's objectives,…

Machine Learning · Computer Science 2024-12-17 Fengshuo Bai , Runze Liu , Yali Du , Ying Wen , Yaodong Yang

Behavioural cloning is an imitation learning technique that teaches an agent how to behave via expert demonstrations. Recent approaches use self-supervision of fully-observable unlabelled snapshots of the states to decode state pairs into…

Machine Learning · Computer Science 2023-04-24 Juarez Monteiro , Nathan Gavenski , Felipe Meneguzzi , Rodrigo C. Barros

We study the problem of sample efficient reinforcement learning, where prior data such as demonstrations are provided for initialization in lieu of a dense reward signal. A natural approach is to incorporate an imitation learning objective,…

Machine Learning · Computer Science 2025-06-10 Perry Dong , Alec M. Lessing , Annie S. Chen , Chelsea Finn

Imitation Learning is a promising paradigm for learning complex robot manipulation skills by reproducing behavior from human demonstrations. However, manipulation tasks often contain bottleneck regions that require a sequence of precise…

Robotics · Computer Science 2020-12-15 Ajay Mandlekar , Danfei Xu , Roberto Martín-Martín , Yuke Zhu , Li Fei-Fei , Silvio Savarese

Robot planning is the process of selecting a sequence of actions that optimize for a task specific objective. The optimal solutions to such tasks are heavily influenced by the implicit structure in the environment, i.e. the configuration of…

Imitation Learning (IL) is a promising paradigm for teaching robots to perform novel tasks using demonstrations. Most existing approaches for IL utilize neural networks (NN), however, these methods suffer from several well-known…

Robotics · Computer Science 2024-04-08 Jimmy Xin , Linus Zheng , Kia Rahmani , Jiayi Wei , Jarrett Holtz , Isil Dillig , Joydeep Biswas

Behavioural cloning uses a dataset of demonstrations to learn a behavioural policy. To overcome various learning and policy adaptation problems, we propose to use latent space to index a demonstration dataset, instantly access similar…

Artificial Intelligence · Computer Science 2023-06-16 Federico Malato , Florian Leopold , Ville Hautamaki , Andrew Melnik

Imitation learning (IL) is a paradigm for learning sequential decision making policies from experts, leveraging offline demonstrations, interactive annotations, or both. Recent advances show that when annotation cost is tallied per…

Machine Learning · Statistics 2026-01-14 Yichen Li , Chicheng Zhang

Supervised imitation-based approaches are often favored over off-policy reinforcement learning approaches for learning policies offline, since their straightforward optimization objective makes them computationally efficient and stable to…

Machine Learning · Computer Science 2025-12-30 Adam Jelley , Trevor McInroe , Sam Devlin , Amos Storkey