English
Related papers

Related papers: Planning for Sample Efficient Imitation Learning

200 papers

Visual imitation learning provides an effective framework to learn skills from demonstrations. However, the quality of the provided demonstrations usually significantly affects the ability of an agent to acquire desired skills. Therefore,…

Robotics · Computer Science 2023-03-02 Ray Chen Zheng , Kaizhe Hu , Zhecheng Yuan , Boyuan Chen , Huazhe Xu

Imitation learning is a widely used approach for training agents to replicate expert behavior in complex decision-making tasks. However, existing methods often struggle with compounding errors and limited generalization, due to the inherent…

Machine Learning · Computer Science 2025-04-21 Haldun Balim , Yang Hu , Yuyang Zhang , Na Li

Amidst the wide popularity of imitation learning algorithms in robotics, their properties regarding hyperparameter sensitivity, ease of training, data efficiency, and performance have not been well-studied in high-precision…

Robotics · Computer Science 2024-08-27 Michael Drolet , Simon Stepputtis , Siva Kailas , Ajinkya Jain , Jan Peters , Stefan Schaal , Heni Ben Amor

Imitation learning holds tremendous promise in learning policies efficiently for complex decision making problems. Current state-of-the-art algorithms often use inverse reinforcement learning (IRL), where given a set of expert…

Robotics · Computer Science 2023-02-22 Siddhant Haldar , Vaibhav Mathur , Denis Yarats , Lerrel Pinto

Offline Imitation Learning (IL) methods such as Behavior Cloning are effective at acquiring complex robotic manipulation skills. However, existing IL-trained policies are confined to executing the task at the same speed as shown in…

Complex planning and scheduling problems have long been solved using various optimization or heuristic approaches. In recent years, imitation learning that aims to learn from expert demonstrations has been proposed as a viable alternative…

Machine Learning · Computer Science 2024-05-24 Qian Shao , Pradeep Varakantham , Shih-Fen Cheng

In many settings, it is desirable to learn decision-making and control policies through learning or bootstrapping from expert demonstrations. The most common approaches under this Imitation Learning (IL) framework are Behavioural Cloning…

Machine Learning · Computer Science 2019-11-07 Seyed Kamyar Seyed Ghasemipour , Richard Zemel , Shixiang Gu

Imitation learning offers a promising path for robots to learn general-purpose behaviors, but traditionally has exhibited limited scalability due to high data supervision requirements and brittle generalization. Inspired by recent advances…

Machine Learning · Computer Science 2022-11-16 Soroush Nasiriany , Tian Gao , Ajay Mandlekar , Yuke Zhu

We study the problem of offline Imitation Learning (IL) where an agent aims to learn an optimal expert behavior policy without additional online environment interactions. Instead, the agent is provided with a supplementary offline dataset…

Machine Learning · Computer Science 2022-07-21 Haoran Xu , Xianyuan Zhan , Honglei Yin , Huiling Qin

Imitation learning has enabled robots to perform complex, long-horizon tasks in challenging dexterous manipulation settings. As new methods are developed, they must be rigorously evaluated and compared against corresponding baselines…

Learning from demonstrations has made great progress over the past few years. However, it is generally data hungry and task specific. In other words, it requires a large amount of data to train a decent model on a particular task, and the…

Machine Learning · Computer Science 2021-03-29 Pin Wang , Hanhan Li , Ching-Yao Chan

Imitation learning has been applied to a range of robotic tasks, but can struggle when robots encounter edge cases that are not represented in the training data (i.e., distribution shift). Interactive fleet learning (IFL) mitigates…

Robotics · Computer Science 2023-10-23 Gaurav Datta , Ryan Hoque , Anrui Gu , Eugen Solowjow , Ken Goldberg

The inverse reinforcement learning approach to imitation learning is a double-edged sword. On the one hand, it can enable learning from a smaller number of expert demonstrations with more robustness to error compounding than behavioral…

Machine Learning · Computer Science 2024-06-06 Juntao Ren , Gokul Swamy , Zhiwei Steven Wu , J. Andrew Bagnell , Sanjiban Choudhury

We study the problem of smooth imitation learning for online sequence prediction, where the goal is to train a policy that can smoothly imitate demonstrated behavior in a dynamic and continuous environment in response to online, sequential…

Machine Learning · Computer Science 2016-06-06 Hoang M. Le , Andrew Kang , Yisong Yue , Peter Carr

Imitation learning learns a policy from demonstrations without requiring hand-designed reward functions. In many robotic tasks, such as autonomous racing, imitated policies must model complex environment dynamics and human decision-making.…

Machine Learning · Computer Science 2024-07-12 Catherine Weaver , Chen Tang , Ce Hao , Kenta Kawamoto , Masayoshi Tomizuka , Wei Zhan

The notion that cooperation can aid a group of agents to solve problems more efficiently than if those agents worked in isolation is prevalent, despite the little quantitative groundwork to support it. Here we consider a primordial form of…

Adaptation and Self-Organizing Systems · Physics 2014-10-22 José F. Fontanari

Despite remarkable successes in solving various complex decision-making tasks, training an imitation learning (IL) algorithm with deep neural networks (DNNs) suffers from the high computation burden. In this work, we propose quantum…

Quantum Physics · Physics 2023-04-06 Zhihao Cheng , Kaining Zhang , Li Shen , Dacheng Tao

Adversarial Imitation Learning alternates between learning a discriminator -- which tells apart expert's demonstrations from generated ones -- and a generator's policy to produce trajectories that can fool this discriminator. This…

Machine Learning · Computer Science 2021-04-19 Paul Barde , Julien Roy , Wonseok Jeon , Joelle Pineau , Christopher Pal , Derek Nowrouzezahrai

Imitation learning (IL) and reinforcement learning (RL) each offer distinct advantages for robotics policy learning: IL provides stable learning from demonstrations, and RL promotes generalization through exploration. While existing robot…

Imitation learning, which enables robots to learn behaviors from demonstrations by human, has emerged as a promising solution for generating robot motions in such environments. The imitation learning-based robot motion generation method,…

Robotics · Computer Science 2025-03-17 Hyeonjun Park , Daegyu Lim , Seungyeon Kim , Sumin Park