English
Related papers

Related papers: A Model-Based Approach to Imitation Learning throu…

200 papers

Imitation learning is the task of replicating expert policy from demonstrations, without access to a reward function. This task becomes particularly challenging when the expert exhibits a mixture of behaviors. Prior work has introduced…

Machine Learning · Computer Science 2022-05-10 Arash Vahabpour , Tianyi Wang , Qiujing Lu , Omead Pooladzandi , Vwani Roychowdhury

Imitation learning aims to extract knowledge from human experts' demonstrations or artificially created agents in order to replicate their behaviors. Its success has been demonstrated in areas such as video games, autonomous driving,…

Machine Learning · Computer Science 2022-10-24 Boyuan Zheng , Sunny Verma , Jianlong Zhou , Ivor Tsang , Fang Chen

Imitation learning seeks to circumvent the difficulty in designing proper reward functions for training agents by utilizing expert behavior. With environments modeled as Markov Decision Processes (MDP), most of the existing imitation…

Machine Learning · Computer Science 2021-05-24 Dripta S. Raychaudhuri , Sujoy Paul , Jeroen van Baar , Amit K. Roy-Chowdhury

Imitation learning aims to mimic the behavior of experts without explicit reward signals. Passive imitation learning methods which use static expert datasets typically suffer from compounding error, low sample efficiency, and high…

Machine Learning · Computer Science 2023-03-06 Xu-Hui Liu , Feng Xu , Xinyu Zhang , Tianyuan Liu , Shengyi Jiang , Ruifeng Chen , Zongzhang Zhang , Yang Yu

Imitation learning has traditionally been applied to learn a single task from demonstrations thereof. The requirement of structured and isolated demonstrations limits the scalability of imitation learning approaches as they are difficult to…

Robotics · Computer Science 2017-11-27 Karol Hausman , Yevgen Chebotar , Stefan Schaal , Gaurav Sukhatme , Joseph Lim

As robots and other intelligent agents move from simple environments and problems to more complex, unstructured settings, manually programming their behavior has become increasingly challenging and expensive. Often, it is easier for a…

Robotics · Computer Science 2018-11-19 Takayuki Osa , Joni Pajarinen , Gerhard Neumann , J. Andrew Bagnell , Pieter Abbeel , Jan Peters

Behavioural cloning is an imitation learning technique that teaches an agent how to behave via expert demonstrations. Recent approaches use self-supervision of fully-observable unlabelled snapshots of the states to decode state pairs into…

Machine Learning · Computer Science 2023-04-24 Juarez Monteiro , Nathan Gavenski , Felipe Meneguzzi , Rodrigo C. Barros

Imitation learning has achieved great success in many sequential decision-making tasks, in which a neural agent is learned by imitating collected human demonstrations. However, existing algorithms typically require a large number of…

Machine Learning · Computer Science 2023-06-14 Tianxiang Zhao , Wenchao Yu , Suhang Wang , Lu Wang , Xiang Zhang , Yuncong Chen , Yanchi Liu , Wei Cheng , Haifeng Chen

Behavioral cloning is an imitation learning technique that teaches an agent how to behave through expert demonstrations. Recent approaches use self-supervision of fully-observable unlabeled snapshots of the states to decode state-pairs into…

Machine Learning · Computer Science 2020-08-14 Nathan Gavenski , Juarez Monteiro , Roger Granada , Felipe Meneguzzi , Rodrigo C. Barros

One of the common ways children learn is by mimicking adults. Imitation learning focuses on learning policies with suitable performance from demonstrations generated by an expert, with an unspecified performance measure, and unobserved…

Machine Learning · Computer Science 2022-08-15 Junzhe Zhang , Daniel Kumor , Elias Bareinboim

Differential replication through copying refers to the process of replicating the decision behavior of a machine learning model using another model that possesses enhanced features and attributes. This process is relevant when external…

Machine Learning · Computer Science 2023-02-08 Nahuel Statuto , Irene Unceta , Jordi Nin , Oriol Pujol

Imitation learning is an effective approach for autonomous systems to acquire control policies when an explicit reward function is unavailable, using supervision provided as demonstrations from an expert, typically a human operator.…

Machine Learning · Computer Science 2018-06-20 YuXuan Liu , Abhishek Gupta , Pieter Abbeel , Sergey Levine

Imitation learning field requires expert data to train agents in a task. Most often, this learning approach suffers from the absence of available data, which results in techniques being tested on its dataset. Creating datasets is a…

Machine Learning · Computer Science 2024-03-04 Nathan Gavenski , Michael Luck , Odinaldo Rodrigues

Imitation learning for robotic tasks has relied primarily on policies trained only on successful demonstrations, although failures are unavoidable during human data collection. Many existing approaches for exploiting failure data require…

Robotics · Computer Science 2026-05-21 Kana Miyamoto , Kanata Suzuki , Tetsuya Ogata

Imitation learning enables agents to reuse and adapt the hard-won expertise of others, offering a solution to several key challenges in learning behavior. Although it is easy to observe behavior in the real-world, the underlying actions may…

Machine Learning · Computer Science 2021-07-09 Andrew Jaegle , Yury Sulsky , Arun Ahuja , Jake Bruce , Rob Fergus , Greg Wayne

Compounding error, where small prediction mistakes accumulate over time, presents a major challenge in learning-based control. For example, this issue often limits the performance of model-based reinforcement learning and imitation…

Systems and Control · Electrical Eng. & Systems 2025-04-03 Anne Somalwar , Bruce D. Lee , George J. Pappas , Nikolai Matni

While robot learning has demonstrated promising results for enabling robots to automatically acquire new skills, a critical challenge in deploying learning-based systems is scale: acquiring enough data for the robot to effectively…

Complex planning and scheduling problems have long been solved using various optimization or heuristic approaches. In recent years, imitation learning that aims to learn from expert demonstrations has been proposed as a viable alternative…

Machine Learning · Computer Science 2024-05-24 Qian Shao , Pradeep Varakantham , Shih-Fen Cheng

Imitation learning trains policies to map from input observations to the actions that an expert would choose. In this setting, distribution shift frequently exacerbates the effect of misattributing expert actions to nuisance correlates…

Machine Learning · Computer Science 2020-10-29 Chuan Wen , Jierui Lin , Trevor Darrell , Dinesh Jayaraman , Yang Gao

A promising way to improve the sample efficiency of reinforcement learning is model-based methods, in which many explorations and evaluations can happen in the learned models to save real-world samples. However, when the learned model has a…

Machine Learning · Computer Science 2022-09-14 Haoxin Lin , Yihao Sun , Jiaji Zhang , Yang Yu