English
Related papers

Related papers: MobILE: Model-Based Imitation Learning From Observ…

200 papers

Imitation learning (IL) algorithms typically distill experience into parametric behavior policies to mimic expert demonstrations. However, with limited demonstrations, existing methods often struggle to generate accurate actions,…

Robotics · Computer Science 2025-09-19 Yuying Zhang , Wenyan Yang , Francesco Verdoja , Ville Kyrki , Joni Pajarinen

Imitation from observation is the framework of learning tasks by observing demonstrated state-only trajectories. Recently, adversarial approaches have achieved significant performance improvements over other methods for imitating complex…

Machine Learning · Computer Science 2019-06-19 Faraz Torabi , Sean Geiger , Garrett Warnell , Peter Stone

The problem of generalization in learning from demonstration (LfD) has received considerable attention over the years, particularly within the context of movement primitives, where a number of approaches have emerged. Recently, two…

Machine Learning · Computer Science 2025-03-05 Markus Knauer , Alin Albu-Schäffer , Freek Stulp , João Silvério

Offline imitation learning (IL) is a powerful method to solve decision-making problems from expert demonstrations without reward labels. Existing offline IL methods suffer from severe performance degeneration under limited expert data.…

Machine Learning · Computer Science 2023-01-11 Wenjia Zhang , Haoran Xu , Haoyi Niu , Peng Cheng , Ming Li , Heming Zhang , Guyue Zhou , Xianyuan Zhan

Sidewalk micromobility is a promising solution for last-mile transportation, but current learning-based control methods struggle in complex urban environments. Imitation learning (IL) learns policies from human demonstrations, yet its…

Robotics · Computer Science 2026-03-25 Honglin He , Yukai Ma , Brad Squicciarini , Wayne Wu , Bolei Zhou

Interactions with either environments or expert policies during training are needed for most of the current imitation learning (IL) algorithms. For IL problems with no interactions, a typical approach is Behavior Cloning (BC). However,…

Robotics · Computer Science 2021-04-06 HaoChih Lin , Baopu Li , Xin Zhou , Jiankun Wang , Max Q. -H. Meng

We present an algorithm for Inverse Reinforcement Learning (IRL) from expert state observations only. Our approach decouples reward modelling from policy learning, unlike state-of-the-art adversarial methods which require updating the…

Machine Learning · Computer Science 2022-05-20 Wei-Di Chang , Juan Camilo Gamboa Higuera , Scott Fujimoto , David Meger , Gregory Dudek

Imitation learning enables agents to reuse and adapt the hard-won expertise of others, offering a solution to several key challenges in learning behavior. Although it is easy to observe behavior in the real-world, the underlying actions may…

Machine Learning · Computer Science 2021-07-09 Andrew Jaegle , Yury Sulsky , Arun Ahuja , Jake Bruce , Rob Fergus , Greg Wayne

Sample efficiency is critical in solving real-world reinforcement learning problems, where agent-environment interactions can be costly. Imitation learning from expert advice has proved to be an effective strategy for reducing the number of…

Machine Learning · Computer Science 2018-10-16 Ching-An Cheng , Xinyan Yan , Evangelos A. Theodorou , Byron Boots

Offline Imitation Learning (IL) with imperfect demonstrations has garnered increasing attention owing to the scarcity of expert data in many real-world domains. A fundamental problem in this scenario is how to extract positive behaviors…

Machine Learning · Computer Science 2024-05-31 Sheng Yue , Jiani Liu , Xingyuan Hua , Ju Ren , Sen Lin , Junshan Zhang , Yaoxue Zhang

The budgeted information gathering problem - where a robot with a fixed fuel budget is required to maximize the amount of information gathered from the world - appears in practice across a wide range of applications in autonomous…

Robotics · Computer Science 2016-11-15 Sanjiban Choudhury , Ashish Kapoor , Gireeja Ranade , Debadeepta Dey

Humans often learn how to perform tasks via imitation: they observe others perform a task, and then very quickly infer the appropriate actions to take based on their observations. While extending this paradigm to autonomous agents is a…

Artificial Intelligence · Computer Science 2018-05-15 Faraz Torabi , Garrett Warnell , Peter Stone

In imitation learning from observation IfO, a learning agent seeks to imitate a demonstrating agent using only observations of the demonstrated behavior without access to the control signals generated by the demonstrator. Recent methods…

Machine Learning · Computer Science 2021-04-02 Faraz Torabi , Garrett Warnell , Peter Stone

Imitation learning (IL) algorithms use expert demonstrations to learn a specific task. Most of the existing approaches assume that all expert demonstrations are reliable and trustworthy, but what if there exist some adversarial…

Machine Learning · Computer Science 2021-01-06 Mostafa Hussein , Brendan Crowe , Marek Petrik , Momotaz Begum

We address the problem of imitation learning with multi-modal demonstrations. Instead of attempting to learn all modes, we argue that in many tasks it is sufficient to imitate any one of them. We show that the state-of-the-art methods such…

Machine Learning · Computer Science 2020-06-02 Liyiming Ke , Sanjiban Choudhury , Matt Barnes , Wen Sun , Gilwoo Lee , Siddhartha Srinivasa

Imitation learning (IL) is a general learning paradigm for tackling sequential decision-making problems. Interactive imitation learning, where learners can interactively query for expert demonstrations, has been shown to achieve provably…

Machine Learning · Computer Science 2022-09-27 Yichen Li , Chicheng Zhang

We consider the problem of learning from observation (LfO), in which the agent aims to mimic the expert's behavior from the state-only demonstrations by experts. We additionally assume that the agent cannot interact with the environment but…

Machine Learning · Computer Science 2022-10-19 Geon-Hyeong Kim , Jongmin Lee , Youngsoo Jang , Hongseok Yang , Kee-Eung Kim

Pretraining and finetuning models has become increasingly popular in decision-making. But there are still serious impediments in Imitation Learning from Observation (ILfO) with pretrained models. This study identifies two primary obstacles:…

Machine Learning · Computer Science 2025-04-25 Xingyuan Zhang , Philip Becker-Ehmck , Patrick van der Smagt , Maximilian Karl

Existing imitation learning works mainly assume that the demonstrator who collects demonstrations shares the same dynamics as the imitator. However, the assumption limits the usage of imitation learning, especially when collecting…

Robotics · Computer Science 2022-11-15 Yiwen Qiu , Jialong Wu , Zhangjie Cao , Mingsheng Long

In many real-world imitation learning tasks, the demonstrator and the learner have to act under different observation spaces. This situation brings significant obstacles to existing imitation learning approaches, since most of them learn…

Machine Learning · Computer Science 2022-10-10 Xin-Qiang Cai , Yao-Xiang Ding , Zi-Xuan Chen , Yuan Jiang , Masashi Sugiyama , Zhi-Hua Zhou