English
Related papers

Related papers: State-only Imitation with Transition Dynamics Mism…

200 papers

Semi-supervised imitation learning (SSIL) consists in learning a policy from a small dataset of action-labeled trajectories and a much larger dataset of action-free trajectories. Some SSIL methods learn an inverse dynamics model (IDM) to…

Machine Learning · Computer Science 2026-02-04 Sacha Morin , Moonsub Byeon , Alexia Jolicoeur-Martineau , Sébastien Lachapelle

Acquiring complex behaviors is essential for artificially intelligent agents, yet learning these behaviors in high-dimensional settings poses a significant challenge due to the vast search space. Traditional reinforcement learning (RL)…

Machine Learning · Computer Science 2025-04-22 Mert Albaba , Sammy Christen , Thomas Langarek , Christoph Gebhardt , Otmar Hilliges , Michael J. Black

Effective exploration continues to be a significant challenge that prevents the deployment of reinforcement learning for many physical systems. This is particularly true for systems with continuous and high-dimensional state and action…

Machine Learning · Computer Science 2022-07-21 Trevor Ablett , Bryan Chan , Jonathan Kelly

State-of-the-art imitation learning from observation methods (ILfO) have recently made significant progress, but they still have some limitations: they need action-based supervised optimisation, assume that states have a single optimal…

Machine Learning · Computer Science 2026-01-27 Nathan Gavenski , Matteo Leonetti , Odinaldo Rodrigues

The goal of imitation learning (IL) is to learn a good policy from high-quality demonstrations. However, the quality of demonstrations in reality can be diverse, since it is easier and cheaper to collect demonstrations from a mix of experts…

Machine Learning · Computer Science 2019-09-17 Voot Tangkaratt , Bo Han , Mohammad Emtiyaz Khan , Masashi Sugiyama

Sidewalk micromobility is a promising solution for last-mile transportation, but current learning-based control methods struggle in complex urban environments. Imitation learning (IL) learns policies from human demonstrations, yet its…

Robotics · Computer Science 2026-03-25 Honglin He , Yukai Ma , Brad Squicciarini , Wayne Wu , Bolei Zhou

Reinforcement learning (RL) is currently one of the most prominent methods for optimizing dynamical systems, with breakthrough results across various fields. The framework is based on the concept of a Markov decision process (MDP), leading…

Optimization and Control · Mathematics 2025-11-17 Rene Carmona , Mathieu Lauriere

Offline inverse reinforcement learning (Offline IRL) aims to recover the structure of rewards and environment dynamics that underlie observed actions in a fixed, finite set of demonstrations from an expert agent. Accurate models of…

Machine Learning · Computer Science 2024-03-01 Siliang Zeng , Chenliang Li , Alfredo Garcia , Mingyi Hong

We address the problem of imitation learning with multi-modal demonstrations. Instead of attempting to learn all modes, we argue that in many tasks it is sufficient to imitate any one of them. We show that the state-of-the-art methods such…

Machine Learning · Computer Science 2020-06-02 Liyiming Ke , Sanjiban Choudhury , Matt Barnes , Wen Sun , Gilwoo Lee , Siddhartha Srinivasa

Imitation learning is the problem of recovering an expert policy without access to a reward signal. Behavior cloning and GAIL are two widely used methods for performing imitation learning. Behavior cloning converges in a few iterations but…

Machine Learning · Computer Science 2020-11-11 Rohit Jena , Changliu Liu , Katia Sycara

As we deploy autonomous agents in safety-critical domains, it becomes important to develop an understanding of their internal mechanisms and representations. We outline an approach to imitation learning for reverse-engineering black box…

Artificial Intelligence · Computer Science 2020-06-23 Tom Bewley , Jonathan Lawry , Arthur Richards

Learning from demonstration has proven effective in robotics for acquiring natural behaviors, such as stylistic motions and lifelike agility, particularly when explicitly defining style-oriented reward functions is challenging. Synthesizing…

Robotics · Computer Science 2025-09-24 Kehan Wen , Chenhao Li , Junzhe He , Marco Hutter

Construction robots are challenging the traditional paradigm of labor intensive and repetitive construction tasks. Present concerns regarding construction robots are focused on their abilities in performing complex tasks consisting of…

Robotics · Computer Science 2023-05-25 Kangkang Duan , Zhengbo Zou

In complex reinforcement learning (RL) problems, policies with similar rewards may have substantially different behaviors. It remains a fundamental challenge to optimize rewards while also discovering as many diverse strategies as possible,…

Machine Learning · Computer Science 2023-10-24 Wei Fu , Weihua Du , Jingwei Li , Sunli Chen , Jingzhao Zhang , Yi Wu

Inverse reinforcement learning (IRL) aims to recover the reward function and the associated optimal policy that best fits observed sequences of states and actions implemented by an expert. Many algorithms for IRL have an inherently nested…

Machine Learning · Computer Science 2022-11-02 Siliang Zeng , Chenliang Li , Alfredo Garcia , Mingyi Hong

In sequential decision-making environments, the primary approaches for training agents are Reinforcement Learning (RL) and Imitation Learning (IL). Unlike RL, which relies on modeling a reward function, IL leverages expert demonstrations,…

Artificial Intelligence · Computer Science 2024-12-11 Jonas Nüßlein , Maximilian Zorn , Philipp Altmann , Claudia Linnhoff-Popien

Imitation learning (IL) aims to enable robots to perform tasks autonomously by observing a few human demonstrations. Recently, a variant of IL, called In-Context IL, utilized off-the-shelf large language models (LLMs) as instant policies…

Robotics · Computer Science 2025-06-19 Hanbit Oh , Andrea M. Salcedo-Vázquez , Ixchel G. Ramirez-Alpizar , Yukiyasu Domae

In inverse reinforcement learning (IRL), a learning agent infers a reward function encoding the underlying task using demonstrations from experts. However, many existing IRL techniques make the often unrealistic assumption that the agent…

Machine Learning · Computer Science 2023-01-04 Franck Djeumou , Christian Ellis , Murat Cubuktepe , Craig Lennon , Ufuk Topcu

Representations are at the core of all deep reinforcement learning (RL) methods for both Markov decision processes (MDPs) and partially observable Markov decision processes (POMDPs). Many representation learning methods and theoretical…

Machine Learning · Computer Science 2024-04-23 Tianwei Ni , Benjamin Eysenbach , Erfan Seyedsalehi , Michel Ma , Clement Gehring , Aditya Mahajan , Pierre-Luc Bacon

In real-world sequential decision making tasks like autonomous driving, robotics, and healthcare, learning from observed state-action trajectories is critical for tasks like imitation, classification, and clustering. For example,…

Machine Learning · Computer Science 2025-01-20 Zichang Ge , Changyu Chen , Arunesh Sinha , Pradeep Varakantham