English
Related papers

Related papers: Distributionally Robust Imitation Learning: Layere…

200 papers

Despite the considerable potential of reinforcement learning (RL), robotic control tasks predominantly rely on imitation learning (IL) due to its better sample efficiency. However, it is costly to collect comprehensive expert demonstrations…

Machine Learning · Computer Science 2024-05-22 Hengyuan Hu , Suvir Mirchandani , Dorsa Sadigh

This work proposes a control-informed reinforcement learning (CIRL) framework that integrates proportional-integral-derivative (PID) control components into the architecture of deep reinforcement learning (RL) policies. The proposed…

Systems and Control · Electrical Eng. & Systems 2024-08-28 Maximilian Bloor , Akhil Ahmed , Niki Kotecha , Mehmet Mercangöz , Calvin Tsay , Ehecactl Antonio Del Rio Chanona

We study offline imitation learning (IL) when part of the decision-relevant state is observed only through noisy measurements and the distribution may change between training and deployment. Such settings induce spurious state-action…

Machine Learning · Computer Science 2026-02-02 Shi Bo , AmirEmad Ghassami

The goal of this work is to enable a team of quadrotors to learn how to accurately track a desired trajectory while holding a given formation. We solve this problem in a distributed manner, where each vehicle has only access to the…

Robotics · Computer Science 2016-09-27 Andreas Hock , Angela P. Schoellig

This paper proposes a novel inverse reinforcement learning framework using a diffusion-based adaptive lookahead planner (IRL-DAL) for autonomous vehicles. Training begins with imitation from an expert finite state machine (FSM) controller…

Robotics · Computer Science 2026-02-02 Seyed Ahmad Hosseini Miangoleh , Amin Jalal Aghdasian , Farzaneh Abdollahi

We propose Taylor Series Imitation Learning (TaSIL), a simple augmentation to standard behavior cloning losses in the context of continuous control. TaSIL penalizes deviations in the higher-order Taylor series terms between the learned and…

Machine Learning · Computer Science 2023-01-18 Daniel Pfrommer , Thomas T. C. K. Zhang , Stephen Tu , Nikolai Matni

Learning-based approaches, such as reinforcement learning (RL) and imitation learning (IL), have indicated superiority over rule-based approaches in complex urban autonomous driving environments, showing great potential to make intelligent…

Robotics · Computer Science 2022-05-31 Haochen Liu , Zhiyu Huang , Jingda Wu , Chen Lv

Growing demands in today's industry results in increasingly stringent performance and throughput specifications. For accurate positioning of high-precision motion systems, feedforward control plays a crucial role. Nonetheless, conventional…

Systems and Control · Electrical Eng. & Systems 2023-03-28 Anantha Sai Hariharan Vinjarapu , Yorick Broens , Hans Butler , Roland Tóth

In recent years, imitation learning (IL) has been widely used in industry as the core of autonomous vehicle (AV) planning modules. However, previous IL works show sample inefficiency and low generalisation in safety-critical scenarios, on…

Robotics · Computer Science 2023-04-04 Yurui Du , Flavia Sofia Acerbo , Jens Kober , Tong Duy Son

Current imitation learning approaches, predominantly based on deep neural networks (DNNs), offer efficient mechanisms for learning driving policies from real-world datasets. However, they suffer from inherent limitations in interpretability…

Machine Learning · Computer Science 2025-12-22 Iman Sharifi , Mustafa Yildirim , Saber Fallah

In interactive imitation learning (IL), uncertainty quantification offers a way for the learner (i.e. robot) to contend with distribution shifts encountered during deployment by actively seeking additional feedback from an expert (i.e.…

Robotics · Computer Science 2025-05-01 Michelle Zhao , Reid Simmons , Henny Admoni , Aaditya Ramdas , Andrea Bajcsy

Iterative Learning Control (ILC) is a technique for adaptive feed-forward control of electro-mechanical plant that either performs programmed periodic behavior or rejects quasi-periodic disturbances. For example, ILC can suppress…

Accelerator Physics · Physics 2023-04-19 Shane Koscielniak

Robust waypoint prediction is crucial for mobile robots operating in open-world, safety-critical settings. While Imitation Learning (IL) methods have demonstrated great success in practice, they are susceptible to distribution shifts: the…

Autonomous car racing is a challenging task in the robotic control area. Traditional modular methods require accurate mapping, localization and planning, which makes them computationally inefficient and sensitive to environmental changes.…

Robotics · Computer Science 2021-07-20 Peide Cai , Hengli Wang , Huaiyang Huang , Yuxuan Liu , Ming Liu

Imitation Learning (IL) can generate computationally efficient policies from demonstrations provided by Model Predictive Control (MPC). However, IL methods often require extensive data-collection and training efforts, limiting changes to…

Robotics · Computer Science 2024-07-09 Andrea Tagliabue , Jonathan P. How

Imitation Learning (IL) is a sample efficient paradigm for robot learning using expert demonstrations. However, policies learned through IL suffer from state distribution shift at test time, due to compounding errors in action prediction…

Robotics · Computer Science 2023-11-07 Suneel Belkhale , Yuchen Cui , Dorsa Sadigh

Out-of-training-distribution (OOD) scenarios are a common challenge of learning agents at deployment, typically leading to arbitrary deductions and poorly-informed decisions. In principle, detection of and adaptation to OOD scenes can…

Machine Learning · Computer Science 2020-09-03 Angelos Filos , Panagiotis Tigas , Rowan McAllister , Nicholas Rhinehart , Sergey Levine , Yarin Gal

Imitation learning (IL) from a state-based reinforcement learning (RL) policy is a common approach to overcome the curse of dimensionality in complex and high-dimensional observation spaces prevalent in robotics. This paper addresses the…

Machine Learning · Computer Science 2026-05-28 Meraj Mammadov , Pedro Zuidberg Dos Martires , Johannes Andreas Stork

Automatic laparoscope motion control is fundamentally important for surgeons to efficiently perform operations. However, its traditional control methods based on tool tracking without considering information hidden in surgical scenes are…

Robotics · Computer Science 2022-04-08 Bin Li , Ruofeng Wei , Jiaqi Xu , Bo Lu , Chi-Hang Yee , Chi-Fai Ng , Pheng-Ann Heng , Qi Dou , Yun-Hui Liu

Output reference tracking can be improved by iteratively learning from past data to inform the design of feedforward control inputs for subsequent tracking attempts. This process is called iterative learning control (ILC). This article…

Systems and Control · Electrical Eng. & Systems 2021-08-18 Isaac A Spiegel , Nard Strijbosch , Tom Oomen , Kira Barton