English
Related papers

Related papers: Imitation Learning from Imperfect Demonstration

200 papers

Learning-based approaches, such as reinforcement learning (RL) and imitation learning (IL), have indicated superiority over rule-based approaches in complex urban autonomous driving environments, showing great potential to make intelligent…

Robotics · Computer Science 2022-05-31 Haochen Liu , Zhiyu Huang , Jingda Wu , Chen Lv

Imitation learning (IL) enables robots to acquire skills quickly by transferring expert knowledge, which is widely adopted in reinforcement learning (RL) to initialize exploration. However, in long-horizon motion planning tasks, a…

Robotics · Computer Science 2021-03-30 Sha Luo , Hamidreza Kasaei , Lambert Schomaker

Large Language Models (LLMs) have showcased their In-Context Learning (ICL) capabilities, enabling few-shot learning without the need for gradient updates. Despite its advantages, the effectiveness of ICL heavily depends on the choice of…

Computation and Language · Computer Science 2024-06-19 Vinay M. S. , Minh-Hao Van , Xintao Wu

Existing imitation learning (IL) methods such as inverse reinforcement learning (IRL) usually have a double-loop training process, alternating between learning a reward function and a policy and tend to suffer long training time and high…

Machine Learning · Computer Science 2022-06-13 Siwei Chen , Xiao Ma , Zhongwen Xu

We study offline imitation learning (IL) when part of the decision-relevant state is observed only through noisy measurements and the distribution may change between training and deployment. Such settings induce spurious state-action…

Machine Learning · Computer Science 2026-02-02 Shi Bo , AmirEmad Ghassami

Imitation learning (IL) can generate computationally efficient sensorimotor policies from demonstrations provided by computationally expensive model-based sensing and control algorithms. However, commonly employed IL methods are often…

Robotics · Computer Science 2022-10-20 Andrea Tagliabue , Jonathan P. How

Imitation Learning (IL) is a promising paradigm for teaching robots to perform novel tasks using demonstrations. Most existing approaches for IL utilize neural networks (NN), however, these methods suffer from several well-known…

Robotics · Computer Science 2024-04-08 Jimmy Xin , Linus Zheng , Kia Rahmani , Jiayi Wei , Jarrett Holtz , Isil Dillig , Joydeep Biswas

Inverse Reinforcement Learning (IRL) learns an optimal policy, given some expert demonstrations, thus avoiding the need for the tedious process of specifying a suitable reward function. However, current methods are constrained by at least…

Machine Learning · Computer Science 2023-11-16 Pierre Le Pelletier de Woillemont , Rémi Labory , Vincent Corruble

Imitation learning is an effective approach for autonomous systems to acquire control policies when an explicit reward function is unavailable, using supervision provided as demonstrations from an expert, typically a human operator.…

Machine Learning · Computer Science 2018-06-20 YuXuan Liu , Abhishek Gupta , Pieter Abbeel , Sergey Levine

Recent advancements in machine learning provide methods to train autonomous agents capable of handling the increasing complexity of sequential decision-making in robotics. Imitation Learning (IL) is a prominent approach, where agents learn…

Robotics · Computer Science 2025-05-01 Jonas Werner , Kun Chu , Cornelius Weber , Stefan Wermter

Current reinforcement learning (RL) algorithms can be brittle and difficult to use, especially when learning goal-reaching behaviors from sparse rewards. Although supervised imitation learning provides a simple and stable alternative, it…

Machine Learning · Computer Science 2020-10-06 Dibya Ghosh , Abhishek Gupta , Ashwin Reddy , Justin Fu , Coline Devin , Benjamin Eysenbach , Sergey Levine

Inverse reinforcement learning (IRL) addresses the problem of recovering a task description given a demonstration of the optimal policy used to solve such a task. The optimal policy is usually provided by an expert or teacher, making IRL…

Machine Learning · Computer Science 2012-02-09 Héctor Ratia , Luis Montesano , Ruben Martinez-Cantin

Adversarial imitation learning (AIL) is a popular method that has recently achieved much success. However, the performance of AIL is still unsatisfactory on the more challenging tasks. We find that one of the major reasons is due to the low…

Machine Learning · Computer Science 2023-07-07 Jialei Huang , Zhaoheng Yin , Yingdong Hu , Yang Gao

Despite the numerous breakthroughs achieved with Reinforcement Learning (RL), solving environments with sparse rewards remains a challenging task that requires sophisticated exploration. Learning from Demonstrations (LfD) remedies this…

Machine Learning · Computer Science 2022-03-22 Georgiy Pshikhachev , Dmitry Ivanov , Vladimir Egorov , Aleksei Shpilman

Imitation learning is the task of replicating expert policy from demonstrations, without access to a reward function. This task becomes particularly challenging when the expert exhibits a mixture of behaviors. Prior work has introduced…

Machine Learning · Computer Science 2022-05-10 Arash Vahabpour , Tianyi Wang , Qiujing Lu , Omead Pooladzandi , Vwani Roychowdhury

Interactive Imitation Learning (IIL) typically relies on extensive human involvement for both offline demonstration and online interaction. Prior work primarily focuses on reducing human effort in passive monitoring rather than active…

Robotics · Computer Science 2026-03-16 Chengjie Zhang , Chao Tang , Wenlong Dong , Dehao Huang , Aoxiang Gu , Hong Zhang

Imitation Learning (IL), also referred to as Learning from Demonstration (LfD), holds significant promise for capturing expert motor skills through efficient imitation, facilitating adept navigation of complex scenarios. A persistent…

Robotics · Computer Science 2024-04-01 Yingbai Hu , Fares J. Abu-Dakka , Fei Chen , Xiao Luo , Zheng Li , Alois Knoll , Weiping Ding

Imitation learning is well-suited for robotic tasks where it is difficult to directly program the behavior or specify a cost for optimal control. In this work, we propose a method for learning the reward function (and the corresponding…

Machine Learning · Computer Science 2021-01-01 Tianwei Ni , Harshit Sikchi , Yufei Wang , Tejus Gupta , Lisa Lee , Benjamin Eysenbach

Imitation from observation is a computational technique that teaches an agent on how to mimic the behavior of an expert by observing only the sequence of states from the expert demonstrations. Recent approaches learn the inverse dynamics of…

Artificial Intelligence · Computer Science 2020-04-29 Juarez Monteiro , Nathan Gavenski , Roger Granada , Felipe Meneguzzi , Rodrigo Barros

Class-Incremental Learning (CIL) trains a model to continually recognize new classes from non-stationary data while retaining learned knowledge. A major challenge of CIL arises when applying to real-world data characterized by non-uniform…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jiangpeng He , Fengqing Zhu