English
Related papers

Related papers: Agnostic Interactive Imitation Learning: New Theor…

200 papers

Interactive learning is a process in which a machine learning algorithm is provided with meaningful, well-chosen examples as opposed to randomly chosen examples typical in standard supervised learning. In this paper, we propose a new method…

Machine Learning · Computer Science 2016-07-26 Shankar Vembu , Sandra Zilles

Imitation learning often assumes that demonstrations are close to optimal according to some fixed, but unknown, cost function. However, according to satisficing theory, humans often choose acceptable behavior based on their personal (and…

Machine Learning · Computer Science 2025-05-27 Rushit N. Shah , Nikolaos Agadakos , Synthia Sasulski , Ali Farajzadeh , Sanjiban Choudhury , Brian Ziebart

Human beings are able to understand objectives and learn by simply observing others perform a task. Imitation learning methods aim to replicate such capabilities, however, they generally depend on access to a full set of optimal states and…

Machine Learning · Computer Science 2021-03-10 Edoardo Cetin , Oya Celiktutan

We study the problem of imitating an expert demonstrator in a discrete-time, continuous state-and-action control system. We show that, even if the dynamics satisfy a control-theoretic property called exponential stability (i.e. the effects…

Machine Learning · Computer Science 2025-07-29 Max Simchowitz , Daniel Pfrommer , Ali Jadbabaie

In interactive imitation learning (IL), uncertainty quantification offers a way for the learner (i.e. robot) to contend with distribution shifts encountered during deployment by actively seeking additional feedback from an expert (i.e.…

Robotics · Computer Science 2025-05-01 Michelle Zhao , Reid Simmons , Henny Admoni , Aaditya Ramdas , Andrea Bajcsy

Imitation Learning (IL) techniques aim to replicate human behaviors in specific tasks. While IL has gained prominence due to its effectiveness and efficiency, traditional methods often focus on datasets collected from experts to produce a…

Machine Learning · Computer Science 2025-04-28 Mathieu Petitbois , Rémy Portelas , Sylvain Lamprier , Ludovic Denoyer

Active learning (AL) prioritizes the labeling of the most informative data samples. However, the performance of AL heuristics depends on the structure of the underlying classifier model and the data. We propose an imitation learning scheme…

Machine Learning · Computer Science 2022-11-11 Christoffer Loeffler , Christopher Mutschler

Imitation learning targets deriving a mapping from states to actions, a.k.a. policy, from expert demonstrations. Existing methods for imitation learning typically require any actions in the demonstrations to be fully available, which is…

Machine Learning · Computer Science 2019-06-25 Mingfei Sun , Xiaojuan Ma

The goal of learning from demonstrations is to learn a policy for an agent (imitator) by mimicking the behavior in the demonstrations. Prior works on learning from demonstrations assume that the demonstrations are collected by a…

Robotics · Computer Science 2021-10-29 Zhangjie Cao , Yilun Hao , Mengxi Li , Dorsa Sadigh

Despite the widely successful applications, bootstrapping and fine-tuning semantic parsers are still a tedious process with challenges such as costly data annotation and privacy risks. In this paper, we suggest an alternative,…

Computation and Language · Computer Science 2020-10-19 Ziyu Yao , Yiqi Tang , Wen-tau Yih , Huan Sun , Yu Su

Adversarial imitation learning has become a widely used imitation learning framework. The discriminator is often trained by taking expert demonstrations and policy trajectories as examples respectively from two categories (positive vs.…

Machine Learning · Computer Science 2023-02-14 Yunke Wang , Bo Du , Chang Xu

Imitation Learning (IL) is a widely used framework for learning imitative behavior from demonstrations. It is especially appealing for solving complex real-world tasks where handcrafting reward function is difficult, or when the goal is to…

Machine Learning · Computer Science 2024-01-17 Chenran Li , Chen Tang , Haruki Nishimura , Jean Mercat , Masayoshi Tomizuka , Wei Zhan

Despite the considerable potential of reinforcement learning (RL), robotic control tasks predominantly rely on imitation learning (IL) due to its better sample efficiency. However, it is costly to collect comprehensive expert demonstrations…

Machine Learning · Computer Science 2024-05-22 Hengyuan Hu , Suvir Mirchandani , Dorsa Sadigh

Imitation learning algorithms provide state-of-the-art results on many structured prediction tasks by learning near-optimal search policies. Such algorithms assume training-time access to an expert that can provide the optimal action at any…

Machine Learning · Computer Science 2020-05-27 Kianté Brantley , Amr Sharaf , Hal Daumé

Imitation learning methods have demonstrated considerable success in teaching autonomous systems complex tasks through expert demonstrations. However, a limitation of these methods is their lack of interpretability, particularly in…

Machine Learning · Computer Science 2025-07-21 Wenliang Liu , Danyang Li , Erfan Aasi , Daniela Rus , Roberto Tron , Calin Belta

In this paper, we describe a novel approach to imitation learning that infers latent policies directly from state observations. We introduce a method that characterizes the causal effects of latent actions on observations while…

Machine Learning · Computer Science 2019-05-14 Ashley D. Edwards , Himanshu Sahni , Yannick Schroecker , Charles L. Isbell

Existing imitation learning approaches often require that the complete demonstration data, including sequences of actions and states, are available. In this paper, we consider a more realistic and difficult scenario where a reinforcement…

Machine Learning · Computer Science 2019-03-12 Xiaoxiao Guo , Shiyu Chang , Mo Yu , Gerald Tesauro , Murray Campbell

A fundamental problem in control is to learn a model of a system from observations that is useful for controller synthesis. To provide good performance guarantees, existing methods must assume that the real system is in the class of models…

Machine Learning · Computer Science 2012-07-04 Stephane Ross , J. Andrew Bagnell

Demonstration learning aims to guide the prompt prediction via providing answered demonstrations in the few shot settings. Despite achieving promising results, existing work only concatenates the answered examples as demonstrations to the…

Machine Learning · Computer Science 2022-09-02 Sirui Wang , Kaiwen Wei , Hongzhi Zhang , Yuntao Li , Wei Wu

We study Imitation Learning (IL) from Observations alone (ILFO) in large-scale MDPs. While most IL algorithms rely on an expert to directly provide actions to the learner, in this setting the expert only supplies sequences of observations.…

Machine Learning · Computer Science 2019-06-12 Wen Sun , Anirudh Vemula , Byron Boots , J. Andrew Bagnell