English
Related papers

Related papers: On Efficient Online Imitation Learning via Classif…

200 papers

Imitation learning (IL) is a framework that learns to imitate expert behavior from demonstrations. Recently, IL shows promising results on high dimensional and control tasks. However, IL typically suffers from sample inefficiency in terms…

Machine Learning · Computer Science 2021-11-24 Lihua Zhang

We study online adversarial imitation learning (AIL), where an agent learns from offline expert demonstrations and interacts with the environment online without access to rewards. Despite strong empirical results, the benefits of online…

Machine Learning · Computer Science 2026-02-03 Shangzhe Li , Dongruo Zhou , Weitong Zhang

When cast into the Deep Reinforcement Learning framework, many robotics tasks require solving a long horizon and sparse reward problem, where learning algorithms struggle. In such context, Imitation Learning (IL) can be a powerful approach…

Artificial Intelligence · Computer Science 2023-04-14 Alexandre Chenu , Nicolas Perrin-Gilbert , Olivier Sigaud

Imitation learning is a primary approach to improve the efficiency of reinforcement learning by exploiting the expert demonstrations. However, in many real scenarios, obtaining expert demonstrations could be extremely expensive or even…

Machine Learning · Computer Science 2023-07-25 Kun-Peng Ning , Hu Xu , Kun Zhu , Sheng-Jun Huang

The goal of imitation learning is to mimic expert behavior from demonstrations, without access to an explicit reward signal. A popular class of approach infers the (unknown) reward function via inverse reinforcement learning (IRL) followed…

Machine Learning · Computer Science 2022-04-19 Carl Qi , Pieter Abbeel , Aditya Grover

Imitation learning (IL) aims to learn an optimal policy from demonstrations. However, such demonstrations are often imperfect since collecting optimal ones is costly. To effectively learn from imperfect demonstrations, we propose a novel…

Machine Learning · Computer Science 2019-01-31 Yueh-Hua Wu , Nontawat Charoenphakdee , Han Bao , Voot Tangkaratt , Masashi Sugiyama

Although reinforcement learning methods offer a powerful framework for automatic skill acquisition, for practical learning-based control problems in domains such as robotics, imitation learning often provides a more convenient and…

Artificial Intelligence · Computer Science 2024-03-20 Jianlan Luo , Perry Dong , Yuexiang Zhai , Yi Ma , Sergey Levine

Imitation Learning (IL) algorithms offer an efficient way to train an agent by mimicking an expert's behavior without requiring a reward function. IL algorithms often necessitate access to state and action information from expert…

Machine Learning · Computer Science 2025-09-25 Returaj Burnwal , Hriday Mehta , Nirav Pravinbhai Bhatt , Balaraman Ravindran

This work addresses the problem of offline safe imitation learning (IL), where the goal is to learn safe and reward-maximizing policies from demonstrations that do not have per-timestep safety cost or reward information. In many real-world…

Machine Learning · Computer Science 2026-02-12 Returaj Burnwal , Nirav Pravinbhai Bhatt , Balaraman Ravindran

Imitation Learning (IL) is an effective learning paradigm exploiting the interactions between agents and environments. It does not require explicit reward signals and instead tries to recover desired policies using expert demonstrations. In…

Machine Learning · Computer Science 2021-12-14 Yang Liu , Yongzhe Chang , Shilei Jiang , Xueqian Wang , Bin Liang , Bo Yuan

Class-incremental learning (CIL) aims to develop a learning system that can continually learn new classes from a data stream without forgetting previously learned classes. When learning classes incrementally, the classifier must be…

Computation and Language · Computer Science 2023-05-29 Minqian Liu , Lifu Huang

A natural goal when designing online learning algorithms for non-stationary environments is to bound the regret of the algorithm in terms of the temporal variation of the input sequence. Intuitively, when the variation is small, it should…

Machine Learning · Computer Science 2021-12-08 Gautam Goel , Babak Hassibi

We address the problem of imitation learning with multi-modal demonstrations. Instead of attempting to learn all modes, we argue that in many tasks it is sufficient to imitate any one of them. We show that the state-of-the-art methods such…

Machine Learning · Computer Science 2020-06-02 Liyiming Ke , Sanjiban Choudhury , Matt Barnes , Wen Sun , Gilwoo Lee , Siddhartha Srinivasa

We study the problem of uncertainty quantification via prediction sets, in an online setting where the data distribution may vary arbitrarily over time. Recent work develops online conformal prediction techniques that leverage regret…

Machine Learning · Computer Science 2023-02-16 Aadyot Bhatnagar , Huan Wang , Caiming Xiong , Yu Bai

Self-healing capability is one of the most critical factors for a resilient distribution system, which requires intelligent agents to automatically perform restorative actions online, including network reconfiguration and reactive power…

Systems and Control · Electrical Eng. & Systems 2021-05-11 Yichen Zhang , Feng Qiu , Tianqi Hong , Zhaoyu Wang , Fangxing Li

Despite the considerable potential of reinforcement learning (RL), robotic control tasks predominantly rely on imitation learning (IL) due to its better sample efficiency. However, it is costly to collect comprehensive expert demonstrations…

Machine Learning · Computer Science 2024-05-22 Hengyuan Hu , Suvir Mirchandani , Dorsa Sadigh

We consider the problem of online learning where the sequence of actions played by the learner must adhere to an unknown safety constraint at every round. The goal is to minimize regret with respect to the best safe action in hindsight…

Machine Learning · Computer Science 2024-03-08 Karthik Sridharan , Seung Won Wilson Yoo

Researchers have demonstrated state-of-the-art performance in sequential decision making problems (e.g., robotics control, sequential prediction) with deep neural network models. One often has access to near-optimal oracles that achieve…

Machine Learning · Computer Science 2017-03-06 Wen Sun , Arun Venkatraman , Geoffrey J. Gordon , Byron Boots , J. Andrew Bagnell

End-to-end vision-based imitation learning has demonstrated promising results in autonomous driving by learning control commands directly from expert demonstrations. However, traditional approaches rely on either regressionbased models,…

Robotics · Computer Science 2025-03-04 Elahe Delavari , Aws Khalil , Jaerock Kwon

In many sequential decision-making problems (e.g., robotics control, game playing, sequential prediction), human or expert data is available containing useful information about the task. However, imitation learning (IL) from a small amount…

Machine Learning · Computer Science 2022-11-04 Divyansh Garg , Shuvam Chakraborty , Chris Cundy , Jiaming Song , Matthieu Geist , Stefano Ermon
‹ Prev 1 3 4 5 6 7 10 Next ›