English
Related papers

Related papers: Temporal Logic Imitation: Learning Plan-Satisficin…

200 papers

Imitation learning is an effective and safe technique to train robot policies in the real world because it does not depend on an expensive random exploration process. However, due to the lack of exploration, learning policies that…

Robotics · Computer Science 2021-06-24 Ajay Mandlekar , Danfei Xu , Roberto Martín-Martín , Silvio Savarese , Li Fei-Fei

Imitation learning methods have demonstrated considerable success in teaching autonomous systems complex tasks through expert demonstrations. However, a limitation of these methods is their lack of interpretability, particularly in…

Machine Learning · Computer Science 2025-07-21 Wenliang Liu , Danyang Li , Erfan Aasi , Daniela Rus , Roberto Tron , Calin Belta

In many real-world applications of control system and robotics, linear temporal logic (LTL) is a widely-used task specification language which has a compositional grammar that naturally induces temporally extended behaviours across tasks,…

Artificial Intelligence · Computer Science 2022-12-16 Duo Xu , Faramarz Fekri

Learning robot control policies from demonstrations is a powerful paradigm, yet real-world data is often suboptimal, noisy, or otherwise imperfect, posing significant challenges for imitation and reinforcement learning. In this work, we…

Machine Learning · Computer Science 2026-04-07 Aniruddh G. Puranic , Sebastian Schirmer , John S. Baras , Calin Belta

Current reinforcement learning (RL) algorithms can be brittle and difficult to use, especially when learning goal-reaching behaviors from sparse rewards. Although supervised imitation learning provides a simple and stable alternative, it…

Machine Learning · Computer Science 2020-10-06 Dibya Ghosh , Abhishek Gupta , Ashwin Reddy , Justin Fu , Coline Devin , Benjamin Eysenbach , Sergey Levine

Recent work in visual end-to-end learning for robotics has shown the promise of imitation learning across a variety of tasks. Such approaches are expensive both because they require large amounts of real world training demonstrations and…

Reinforcement learning (RL) is a promising approach. However, success is limited to real-world applications, because ensuring safe exploration and facilitating adequate exploitation is a challenge for controlling robotic systems with…

Robotics · Computer Science 2022-08-29 Mingyu Cai , Cristian-Ioan Vasile

Despite the numerous breakthroughs achieved with Reinforcement Learning (RL), solving environments with sparse rewards remains a challenging task that requires sophisticated exploration. Learning from Demonstrations (LfD) remedies this…

Machine Learning · Computer Science 2022-03-22 Georgiy Pshikhachev , Dmitry Ivanov , Vladimir Egorov , Aleksei Shpilman

We study representation learning for efficient imitation learning over linear systems. In particular, we consider a setting where learning is split into two phases: (a) a pre-training step where a shared $k$-dimensional representation is…

Machine Learning · Computer Science 2023-11-13 Thomas T. Zhang , Katie Kang , Bruce D. Lee , Claire Tomlin , Sergey Levine , Stephen Tu , Nikolai Matni

We study the problem of imitating an expert demonstrator in a discrete-time, continuous state-and-action control system. We show that, even if the dynamics satisfy a control-theoretic property called exponential stability (i.e. the effects…

Machine Learning · Computer Science 2025-07-29 Max Simchowitz , Daniel Pfrommer , Ali Jadbabaie

Learning from demonstration (LfD) is the process of building behavioral models of a task from demonstrations provided by an expert. These models can be used e.g. for system control by generalizing the expert demonstrations to previously…

Machine Learning · Statistics 2017-08-07 Adrian Šošić , Abdelhak M. Zoubir , Heinz Koeppl

Learning from Demonstration (LfD) approaches empower end-users to teach robots novel tasks via demonstrations of the desired behaviors, democratizing access to robotics. However, current LfD frameworks are not capable of fast adaptation to…

Machine Learning · Computer Science 2025-05-29 Letian Chen , Sravan Jayanthi , Rohan Paleja , Daniel Martin , Viacheslav Zakharov , Matthew Gombolay

Behavior cloning of expert demonstrations can speed up learning optimal policies in a more sample-efficient way over reinforcement learning. However, the policy cannot extrapolate well to unseen states outside of the demonstration data,…

Machine Learning · Computer Science 2022-10-19 Jung Yeon Park , Lawson L. S. Wong

We propose a method for efficient training of Q-functions for continuous-state Markov Decision Processes (MDPs) such that the traces of the resulting policies satisfy a given Linear Temporal Logic (LTL) property. LTL, a modal logic, can…

Machine Learning · Computer Science 2019-03-15 Mohammadhosein Hasanbeig , Alessandro Abate , Daniel Kroening

Recent progress in imitation learning has been enabled by policy architectures that scale to complex visuomotor tasks, multimodal distributions, and large datasets. However, these methods often rely on learning from large amount of expert…

Robotics · Computer Science 2025-04-24 Amber Xie , Oleh Rybkin , Dorsa Sadigh , Chelsea Finn

Learning from demonstration (LfD) provides a fast, intuitive and efficient framework to program robot skills, which has gained growing interest both in research and industrial applications. Most complex manipulation tasks are long-term and…

Robotics · Computer Science 2022-03-02 Meng Guo , Mathias Buerger

Seamlessly integrating rules in Learning-from-Demonstrations (LfD) policies is a critical requirement to enable the real-world deployment of AI agents. Recently, Signal Temporal Logic (STL) has been shown to be an effective language for…

Robotics · Computer Science 2025-03-06 Jasmine Jerry Aloor , Jay Patrikar , Parv Kapoor , Jean Oh , Sebastian Scherer

Imitation learning aims to extract high-performance policies from logged demonstrations of expert behavior. It is common to frame imitation learning as a supervised learning problem in which one fits a function approximator to the…

Machine Learning · Computer Science 2022-05-24 Mengjiao Yang , Dale Schuurmans , Pieter Abbeel , Ofir Nachum

Recent work has addressed using formulas in linear temporal logic (LTL) as specifications for agents planning in Markov Decision Processes (MDPs). We consider the inverse problem: inferring an LTL specification from demonstrated behavior…

Systems and Control · Computer Science 2017-11-02 Daniel Kasenberg , Matthias Scheutz

One of the main foci of robotics is nowadays centered in providing a great degree of autonomy to robots. A fundamental step in this direction is to give them the ability to plan in discrete and continuous spaces to find the required motions…

Robotics · Computer Science 2017-10-03 Muhayyuddin , Aliakbar Akbari , Jan Rosell