English
Related papers

Related papers: Learning the optimal state-feedback via supervised…

200 papers

Policy learning for partially observed control tasks requires policies that can remember salient information from past observations. In this paper, we present a method for learning policies with internal memory for high-dimensional,…

Machine Learning · Computer Science 2015-09-24 Marvin Zhang , Zoe McCarthy , Chelsea Finn , Sergey Levine , Pieter Abbeel

In this paper, we propose a novel framework for approximating the explicit MPC law for linear parameter-varying systems using supervised learning. In contrast to most existing approaches, we not only learn the control policy, but also a…

Machine Learning · Computer Science 2019-06-21 Xiaojing Zhang , Monimoy Bujarbaruah , Francesco Borrelli

We focus on developing efficient and reliable policy optimization strategies for robot learning with real-world data. In recent years, policy gradient methods have emerged as a promising paradigm for training control policies in simulation.…

Machine Learning · Computer Science 2023-11-07 Tyler Westenbroek , Jacob Levy , David Fridovich-Keil

Robot planning is the process of selecting a sequence of actions that optimize for a task specific objective. The optimal solutions to such tasks are heavily influenced by the implicit structure in the environment, i.e. the configuration of…

Imitation learning enables autonomous agents to learn from human examples, without the need for a reward signal. Still, if the provided dataset does not encapsulate the task correctly, or when the task is too complex to be modeled, such…

Artificial Intelligence · Computer Science 2024-06-10 Federico Malato , Ville Hautamaki

In this paper we propose an algorithm for the training of neural network control policies for quadrotors. The learned control policy computes control commands directly from sensor inputs and is hence computationally efficient. An imitation…

Robotics · Computer Science 2019-07-01 Stefan Stevsic , Tobias Naegeli , Javier Alonso-Mora , Otmar Hilliges

Reinforcement learning (RL) has made significant strides in various complex domains. However, identifying an effective policy via RL often necessitates extensive exploration. Imitation learning aims to mitigate this issue by using expert…

Machine Learning · Computer Science 2025-08-12 Xuefeng Liu , Takuma Yoneda , Chaoqi Wang , Matthew R. Walter , Yuxin Chen

Current reinforcement learning (RL) algorithms can be brittle and difficult to use, especially when learning goal-reaching behaviors from sparse rewards. Although supervised imitation learning provides a simple and stable alternative, it…

Machine Learning · Computer Science 2020-10-06 Dibya Ghosh , Abhishek Gupta , Ashwin Reddy , Justin Fu , Coline Devin , Benjamin Eysenbach , Sergey Levine

In this paper, we describe a novel approach to imitation learning that infers latent policies directly from state observations. We introduce a method that characterizes the causal effects of latent actions on observations while…

Machine Learning · Computer Science 2019-05-14 Ashley D. Edwards , Himanshu Sahni , Yannick Schroecker , Charles L. Isbell

We consider the stabilization of Vlasov--Poisson plasma dynamics, a central control problem in nuclear fusion. Our focus is the gap between what an ideal controller would use and what experiments can actually observe: while optimal policy…

Machine Learning · Computer Science 2026-05-07 Xiaofan Xia , Qin Li , Wenlong Mou

Existing on-policy imitation learning algorithms, such as DAgger, assume access to a fixed supervisor. However, there are many settings where the supervisor may evolve during policy learning, such as a human performing a novel task or an…

Machine Learning · Computer Science 2020-05-19 Ashwin Balakrishna , Brijen Thananjeyan , Jonathan Lee , Felix Li , Arsh Zahed , Joseph E. Gonzalez , Ken Goldberg

Many existing imitation learning datasets are collected from multiple demonstrators, each with different expertise at different parts of the environment. Yet, standard imitation learning algorithms typically treat all demonstrators as…

Machine Learning · Computer Science 2022-06-14 Mark Beliaev , Andy Shih , Stefano Ermon , Dorsa Sadigh , Ramtin Pedarsani

Imitation learning is well-suited for robotic tasks where it is difficult to directly program the behavior or specify a cost for optimal control. In this work, we propose a method for learning the reward function (and the corresponding…

Machine Learning · Computer Science 2021-01-01 Tianwei Ni , Harshit Sikchi , Yufei Wang , Tejus Gupta , Lisa Lee , Benjamin Eysenbach

Behavioural cloning is an imitation learning technique that teaches an agent how to behave via expert demonstrations. Recent approaches use self-supervision of fully-observable unlabelled snapshots of the states to decode state pairs into…

Machine Learning · Computer Science 2023-04-24 Juarez Monteiro , Nathan Gavenski , Felipe Meneguzzi , Rodrigo C. Barros

Linear dynamical systems that obey stochastic differential equations are canonical models. While optimal control of known systems has a rich literature, the problem is technically hard under model uncertainty and there are hardly any…

Systems and Control · Electrical Eng. & Systems 2023-06-09 Mohamad Kazem Shirani Faradonbeh , Mohamad Sadegh Shirani Faradonbeh

Imitation Learning techniques enable programming the behavior of agents through demonstrations rather than manual engineering. However, they are limited by the quality of available demonstration data. Interactive Imitation Learning…

Robotics · Computer Science 2022-03-09 Snehal Jauhri , Carlos Celemin , Jens Kober

Imitation Learning (IL) can generate computationally efficient policies from demonstrations provided by Model Predictive Control (MPC). However, IL methods often require extensive data-collection and training efforts, limiting changes to…

Robotics · Computer Science 2024-07-09 Andrea Tagliabue , Jonathan P. How

Offline imitation learning (IL) promises the ability to learn performant policies from pre-collected demonstrations without interactions with the environment. However, imitating behaviors fully offline typically requires numerous expert…

Machine Learning · Computer Science 2023-03-07 Lantao Yu , Tianhe Yu , Jiaming Song , Willie Neiswanger , Stefano Ermon

Deep learning techniques have been widely applied, achieving state-of-the-art results in various fields of study. This survey focuses on deep learning solutions that target learning control policies for robotics applications. We carry out…

Robotics · Computer Science 2018-04-10 Lei Tai , Jingwei Zhang , Ming Liu , Joschka Boedecker , Wolfram Burgard

We present a learning algorithm for training a single policy that imitates multiple gaits of a walking robot. To achieve this, we use and extend MPC-Net, which is an Imitation Learning approach guided by Model Predictive Control (MPC). The…

Robotics · Computer Science 2021-12-01 Alexander Reske , Jan Carius , Yuntao Ma , Farbod Farshidian , Marco Hutter