English
Related papers

Related papers: Easy-IIL: Reducing Human Operational Burden in Int…

200 papers

Imitation learning is a class of promising policy learning algorithms that is free from many practical issues with reinforcement learning, such as the reward design issue and the exploration hardness. However, the current imitation…

Machine Learning · Computer Science 2022-10-19 Zhao-Heng Yin , Weirui Ye , Qifeng Chen , Yang Gao

Humans are able to understand and perform complex tasks by strategically structuring the tasks into incremental steps or subgoals. For a robot attempting to learn to perform a sequential task with critical subgoal states, such states can…

Human-Computer Interaction · Computer Science 2018-06-25 Xinlei Pan , Eshed Ohn-Bar , Nicholas Rhinehart , Yan Xu , Yilin Shen , Kris M. Kitani

Imitation learning has been applied to a range of robotic tasks, but can struggle when robots encounter edge cases that are not represented in the training data (i.e., distribution shift). Interactive fleet learning (IFL) mitigates…

Robotics · Computer Science 2023-10-23 Gaurav Datta , Ryan Hoque , Anrui Gu , Eugen Solowjow , Ken Goldberg

Imitation learning (IL) aims to learn an optimal policy from demonstrations. However, such demonstrations are often imperfect since collecting optimal ones is costly. To effectively learn from imperfect demonstrations, we propose a novel…

Machine Learning · Computer Science 2019-01-31 Yueh-Hua Wu , Nontawat Charoenphakdee , Han Bao , Voot Tangkaratt , Masashi Sugiyama

In Imitation Learning (IL), utilizing suboptimal and heterogeneous demonstrations presents a substantial challenge due to the varied nature of real-world data. However, standard IL algorithms consider these datasets as homogeneous, thereby…

Machine Learning · Computer Science 2024-12-16 Mark Beliaev , Ramtin Pedarsani

Acquiring complex behaviors is essential for artificially intelligent agents, yet learning these behaviors in high-dimensional settings poses a significant challenge due to the vast search space. Traditional reinforcement learning (RL)…

Machine Learning · Computer Science 2025-04-22 Mert Albaba , Sammy Christen , Thomas Langarek , Christoph Gebhardt , Otmar Hilliges , Michael J. Black

In this paper, we study offline-to-online Imitation Learning (IL) that pretrains an imitation policy from static demonstration data, followed by fast finetuning with minimal environmental interaction. We find the na\"ive combination of…

Machine Learning · Computer Science 2024-05-31 Sheng Yue , Xingyuan Hua , Ju Ren , Sen Lin , Junshan Zhang , Yaoxue Zhang

Imitation learning (IL) is a general learning paradigm for tackling sequential decision-making problems. Interactive imitation learning, where learners can interactively query for expert demonstrations, has been shown to achieve provably…

Machine Learning · Computer Science 2022-09-27 Yichen Li , Chicheng Zhang

Offline Imitation Learning (IL) with imperfect demonstrations has garnered increasing attention owing to the scarcity of expert data in many real-world domains. A fundamental problem in this scenario is how to extract positive behaviors…

Machine Learning · Computer Science 2024-05-31 Sheng Yue , Jiani Liu , Xingyuan Hua , Ju Ren , Sen Lin , Junshan Zhang , Yaoxue Zhang

We tackle a common scenario in imitation learning (IL), where agents try to recover the optimal policy from expert demonstrations without further access to the expert or environment reward signals. Except the simple Behavior Cloning (BC)…

Machine Learning · Computer Science 2021-04-16 Minghuan Liu , Tairan He , Minkai Xu , Weinan Zhang

Learning to solve complex manipulation tasks from visual observations is a dominant challenge for real-world robot learning. Although deep reinforcement learning algorithms have recently demonstrated impressive results in this context, they…

Robotics · Computer Science 2022-01-20 Eugenio Chisari , Tim Welschehold , Joschka Boedecker , Wolfram Burgard , Abhinav Valada

In this paper, we present \textbf{C}ont\textbf{E}xtual \textbf{I}mitation \textbf{L}earning~(CEIL), a general and broadly applicable algorithm for imitation learning (IL). Inspired by the formulation of hindsight information matching, we…

Machine Learning · Computer Science 2023-10-27 Jinxin Liu , Li He , Yachen Kang , Zifeng Zhuang , Donglin Wang , Huazhe Xu

Imitation learning has shown success in many tasks by learning from expert demonstrations. However, most existing work relies on large-scale demonstrations from technical professionals and close monitoring of the training process. These are…

Artificial Intelligence · Computer Science 2026-02-05 Feiyu Gavin Zhu , Jean Oh , Reid Simmons

Offline imitation learning (IL) is a powerful method to solve decision-making problems from expert demonstrations without reward labels. Existing offline IL methods suffer from severe performance degeneration under limited expert data.…

Machine Learning · Computer Science 2023-01-11 Wenjia Zhang , Haoran Xu , Haoyi Niu , Peng Cheng , Ming Li , Heming Zhang , Guyue Zhou , Xianyuan Zhan

Learning-based approaches, such as reinforcement learning (RL) and imitation learning (IL), have indicated superiority over rule-based approaches in complex urban autonomous driving environments, showing great potential to make intelligent…

Robotics · Computer Science 2022-05-31 Haochen Liu , Zhiyu Huang , Jingda Wu , Chen Lv

Imitation learning has been a trend recently, yet training a generalist agent across multiple tasks still requires large-scale expert demonstrations, which are costly and labor-intensive to collect. To address the challenge of limited…

Robotics · Computer Science 2025-09-25 Yifan Ye , Jun Cen , Jing Chen , Zhihe Lu

Imitation learning (IL) is a framework that learns to imitate expert behavior from demonstrations. Recently, IL shows promising results on high dimensional and control tasks. However, IL typically suffers from sample inefficiency in terms…

Machine Learning · Computer Science 2021-11-24 Lihua Zhang

This paper studies offline Imitation Learning (IL) where an agent learns to imitate an expert demonstrator without additional online environment interactions. Instead, the learner is presented with a static offline dataset of…

Machine Learning · Computer Science 2022-02-01 Jonathan D. Chang , Masatoshi Uehara , Dhruv Sreenivas , Rahul Kidambi , Wen Sun

Imitation learning learns a policy from expert trajectories. While the expert data is believed to be crucial for imitation quality, it was found that a kind of imitation learning approach, adversarial imitation learning (AIL), can have…

Machine Learning · Computer Science 2026-05-05 Tian Xu , Ziniu Li , Yang Yu , Zhi-Quan Luo

Although robotic imitation learning (RIL) is promising for embodied intelligent robots, existing RIL approaches rely on computationally intensive multi-model trajectory predictions, resulting in slow execution and limited real-time…

Robotics · Computer Science 2024-12-31 Jun Xie , Zhicheng Wang , Jianwei Tan , Huanxu Lin , Xiaoguang Ma