English
Related papers

Related papers: Sample-Efficient Expert Query Control in Active Im…

200 papers

We consider imitation learning with access only to expert demonstrations, whose real-world application is often limited by covariate shift due to compounding errors during execution. We investigate the effectiveness of the Continuity-based…

Robotics · Computer Science 2024-10-22 Abhay Deshpande , Liyiming Ke , Quinn Pfeifer , Abhishek Gupta , Siddhartha S. Srinivasa

In this paper, we focus on single-demonstration imitation learning (IL), a practical approach for real-world applications where acquiring multiple expert demonstrations is costly or infeasible and the ground truth reward function is not…

Machine Learning · Computer Science 2024-07-09 Chia-Cheng Chiang , Li-Cheng Lan , Wei-Fang Sun , Chien Feng , Cho-Jui Hsieh , Chun-Yi Lee

Recent advances in deep reinforcement learning (RL) have demonstrated its potential to learn complex robotic manipulation tasks. However, RL still requires the robot to collect a large amount of real-world experience. To address this…

Robotics · Computer Science 2020-03-12 Bohan Wu , Feng Xu , Zhanpeng He , Abhi Gupta , Peter K. Allen

Imitation Learning (IL) algorithms offer an efficient way to train an agent by mimicking an expert's behavior without requiring a reward function. IL algorithms often necessitate access to state and action information from expert…

Machine Learning · Computer Science 2025-09-25 Returaj Burnwal , Hriday Mehta , Nirav Pravinbhai Bhatt , Balaraman Ravindran

In standard passive imitation learning, the goal is to learn a target policy by passively observing full execution trajectories of it. Unfortunately, generating such trajectories can require substantial expert effort and be impractical in…

Machine Learning · Computer Science 2012-10-19 Kshitij Judah , Alan Fern , Thomas G. Dietterich

Active learning is to design label-efficient algorithms by sampling the most representative samples to be labeled by an oracle. In this paper, we propose a state relabeling adversarial active learning model (SRAAL), that leverages both the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Beichen Zhang , Liang Li , Shijie Yang , Shuhui Wang , Zheng-Jun Zha , Qingming Huang

There has recently been a surge in research in batch Deep Reinforcement Learning (DRL), which aims for learning a high-performing policy from a given dataset without additional interactions with the environment. We propose a new algorithm,…

Machine Learning · Computer Science 2020-11-03 Xinyue Chen , Zijian Zhou , Zheng Wang , Che Wang , Yanqiu Wu , Keith Ross

Offline reinforcement learning (RL) tasks require the agent to learn from a pre-collected dataset with no further interactions with the environment. Despite the potential to surpass the behavioral policies, RL-based methods are generally…

Machine Learning · Computer Science 2022-01-13 Minghuan Liu , Hanye Zhao , Zhengyu Yang , Jian Shen , Weinan Zhang , Li Zhao , Tie-Yan Liu

Imitation learning (IL) has shown great success in learning complex robot manipulation tasks. However, there remains a need for practical safety methods to justify widespread deployment. In particular, it is important to certify that a…

We study Imitation Learning (IL) from Observations alone (ILFO) in large-scale MDPs. While most IL algorithms rely on an expert to directly provide actions to the learner, in this setting the expert only supplies sequences of observations.…

Machine Learning · Computer Science 2019-06-12 Wen Sun , Anirudh Vemula , Byron Boots , J. Andrew Bagnell

Behavior cloning provides strong imitation learning guarantees when training and test environments share the same dynamics. However, in many deployment settings the test environment's transitions differ from training, and classical offline…

Machine Learning · Computer Science 2026-05-19 Surbhi Goel , Jonathan Pei , James Wang

In robotic manipulation, acquiring samples is extremely expensive because it often requires interacting with the real world. Traditional image-level data augmentation has shown the potential to improve sample efficiency in various machine…

Robotics · Computer Science 2022-11-02 Mingxi Jia , Dian Wang , Guanang Su , David Klee , Xupeng Zhu , Robin Walters , Robert Platt

Spurious correlations in real-world datasets cause machine learning models to rely on irrelevant patterns, undermining reliability, generalization, and fairness. Active learning offers a promising way to address this failure mode by…

Machine Learning · Computer Science 2026-05-21 Kin Whye Chew , Jingxian Wang

We study interactive imitation learning, where a learner interactively queries a demonstrating expert for action annotations, aiming to learn a policy that has performance competitive with the expert, using as few annotations as possible.…

Machine Learning · Computer Science 2024-07-18 Yichen Li , Chicheng Zhang

Adversarial Imitation Learning (AIL) allows the agent to reproduce expert behavior with low-dimensional states and actions. However, challenges arise in handling visual states due to their less distinguishable representation compared to…

Machine Learning · Computer Science 2024-01-23 Yunke Wang , Linwei Tao , Bo Du , Yutian Lin , Chang Xu

Enabling robots to effectively imitate expert skills in longhorizon tasks such as locomotion, manipulation, and more, poses a long-standing challenge. Existing imitation learning (IL) approaches for robots still grapple with sub-optimal…

Robotics · Computer Science 2023-09-29 Zixuan Chen , Ze Ji , Shuyang Liu , Jing Huo , Yiyu Chen , Yang Gao

We focus on offline imitation learning (IL), which aims to mimic an expert's behavior using demonstrations without any interaction with the environment. One of the main challenges in offline IL is the limited support of expert…

Machine Learning · Computer Science 2024-10-14 Huy Hoang , Tien Mai , Pradeep Varakantham

Adversarial Imitation Learning (AIL) is a dominant framework in imitation learning that infers rewards from expert demonstrations to guide policy optimization. Although providing more expert demonstrations typically leads to improved…

Machine Learning · Computer Science 2026-04-30 Pengcheng Li , Qiang Fang , Tong Zhao , Yixing Lan , Xin Xu

In this paper, we consider cross-domain imitation learning (CDIL) in which an agent in a target domain learns a policy to perform well in the target domain by observing expert demonstrations in a source domain without accessing any reward…

Machine Learning · Computer Science 2020-09-28 Sungho Choi , Seungyul Han , Woojun Kim , Youngchul Sung

Adversarial imitation learning (AIL), a prominent approach in imitation learning, has achieved significant practical success powered by neural network approximation. However, existing theoretical analyses of AIL are primarily confined to…

Machine Learning · Computer Science 2026-05-05 Tian Xu , Zhilong Zhang , Zexuan Chen , Ruishuo Chen , Yihao Sun , Yang Yu