English
Related papers

Related papers: HG-DAgger: Interactive Imitation Learning with Hum…

200 papers

Imitation learning aims to extract knowledge from human experts' demonstrations or artificially created agents in order to replicate their behaviors. Its success has been demonstrated in areas such as video games, autonomous driving,…

Machine Learning · Computer Science 2022-10-24 Boyuan Zheng , Sunny Verma , Jianlong Zhou , Ivor Tsang , Fang Chen

Imitation learning (IL) is a simple and powerful way to use high-quality human driving data, which can be collected at scale, to produce human-like behavior. However, policies based on imitation learning alone often fail to sufficiently…

Imitation learning (IL) enables agents to mimic expert behaviors. Most previous IL techniques focus on precisely imitating one policy through mass demonstrations. However, in many applications, what humans require is the ability to perform…

Machine Learning · Computer Science 2023-10-10 Xiong-Hui Chen , Junyin Ye , Hang Zhao , Yi-Chen Li , Haoran Shi , Yu-Yan Xu , Zhihao Ye , Si-Hang Yang , Anqi Huang , Kai Xu , Zongzhang Zhang , Yang Yu

We study interactive imitation learning, where a learner interactively queries a demonstrating expert for action annotations, aiming to learn a policy that has performance competitive with the expert, using as few annotations as possible.…

Machine Learning · Computer Science 2024-07-18 Yichen Li , Chicheng Zhang

Policies for partially observed Markov decision processes can be efficiently learned by imitating policies for the corresponding fully observed Markov decision processes. Unfortunately, existing approaches for this kind of imitation…

Machine Learning · Computer Science 2021-07-02 Andrew Warrington , J. Wilder Lavington , Adam Ścibior , Mark Schmidt , Frank Wood

The decision and planning system for autonomous driving in urban environments is hard to design. Most current methods manually design the driving policy, which can be expensive to develop and maintain at scale. Instead, with imitation…

Robotics · Computer Science 2019-10-15 Jianyu Chen , Bodi Yuan , Masayoshi Tomizuka

On-policy imitation learning algorithms such as DAgger evolve a robot control policy by executing it, measuring performance (loss), obtaining corrective feedback from a supervisor, and generating the next policy. As the loss between…

Robotics · Computer Science 2019-07-10 Jonathan N. Lee , Michael Laskey , Ajay Kumar Tanwani , Anil Aswani , Ken Goldberg

Many research directions in machine learning, particularly in deep learning, involve complex, multi-stage experiments, commonly involving state-mutating operations acting on models along multiple paths of execution. Although machine…

Software Engineering · Computer Science 2020-06-16 Michela Paganini , Jessica Zosa Forde

Imitation learning is the problem of recovering an expert policy without access to a reward signal. Behavior cloning and GAIL are two widely used methods for performing imitation learning. Behavior cloning converges in a few iterations but…

Machine Learning · Computer Science 2020-11-11 Rohit Jena , Changliu Liu , Katia Sycara

Behavioural cloning is an imitation learning technique that teaches an agent how to behave via expert demonstrations. Recent approaches use self-supervision of fully-observable unlabelled snapshots of the states to decode state pairs into…

Machine Learning · Computer Science 2023-04-24 Juarez Monteiro , Nathan Gavenski , Felipe Meneguzzi , Rodrigo C. Barros

Diffusion policies trained via offline behavioral cloning have recently gained traction in robotic motion generation. While effective, these policies typically require a large number of trainable parameters. This model size affords powerful…

Robotics · Computer Science 2025-04-29 Xiatao Sun , Shuo Yang , Yinxing Chen , Francis Fan , Yiyan Liang , Daniel Rakita

Imitation learning is the task of replicating expert policy from demonstrations, without access to a reward function. This task becomes particularly challenging when the expert exhibits a mixture of behaviors. Prior work has introduced…

Machine Learning · Computer Science 2022-05-10 Arash Vahabpour , Tianyi Wang , Qiujing Lu , Omead Pooladzandi , Vwani Roychowdhury

Complex planning and scheduling problems have long been solved using various optimization or heuristic approaches. In recent years, imitation learning that aims to learn from expert demonstrations has been proposed as a viable alternative…

Machine Learning · Computer Science 2024-05-24 Qian Shao , Pradeep Varakantham , Shih-Fen Cheng

Developing autonomous vehicles that can navigate complex environments with human-level safety and efficiency is a central goal in self-driving research. A common approach to achieving this is imitation learning, where agents are trained to…

Robotics · Computer Science 2025-03-19 Clémence Grislain , Risto Vuorio , Cong Lu , Shimon Whiteson

Imitation learning enables autonomous agents to learn from human examples, without the need for a reward signal. Still, if the provided dataset does not encapsulate the task correctly, or when the task is too complex to be modeled, such…

Artificial Intelligence · Computer Science 2024-06-10 Federico Malato , Ville Hautamaki

Imitation learning is an effective alternative approach to learn a policy when the reward function is sparse. In this paper, we consider a challenging setting where an agent and an expert use different actions from each other. We assume…

Machine Learning · Computer Science 2019-08-27 Konrad Zolna , Negar Rostamzadeh , Yoshua Bengio , Sungjin Ahn , Pedro O. Pinheiro

Imitation learning field requires expert data to train agents in a task. Most often, this learning approach suffers from the absence of available data, which results in techniques being tested on its dataset. Creating datasets is a…

Machine Learning · Computer Science 2024-03-04 Nathan Gavenski , Michael Luck , Odinaldo Rodrigues

Imitation learning is a promising approach for training autonomous vehicles (AV) to navigate complex traffic environments by mimicking expert driver behaviors. While existing imitation learning frameworks focus on leveraging expert…

Robotics · Computer Science 2025-09-25 Yasin Sonmez , Hanna Krasowski , Murat Arcak

When cast into the Deep Reinforcement Learning framework, many robotics tasks require solving a long horizon and sparse reward problem, where learning algorithms struggle. In such context, Imitation Learning (IL) can be a powerful approach…

Artificial Intelligence · Computer Science 2023-04-14 Alexandre Chenu , Nicolas Perrin-Gilbert , Olivier Sigaud

Imitation learning aims to extract high-performance policies from logged demonstrations of expert behavior. It is common to frame imitation learning as a supervised learning problem in which one fits a function approximator to the…

Machine Learning · Computer Science 2022-05-24 Mengjiao Yang , Dale Schuurmans , Pieter Abbeel , Ofir Nachum