English
Related papers

Related papers: Safety-Aware Imitation Learning via MPC-Guided Dis…

200 papers

Guaranteeing safety in human-centric applications is critical in robot learning as the learned policies may demonstrate unsafe behaviors in formerly unseen scenarios. We present a framework to locally repair an erroneous policy network to…

Imitation learning considerably simplifies policy synthesis compared to alternative approaches by exploiting access to expert demonstrations. For such imitation policies, errors away from the training samples are particularly critical. Even…

Machine Learning · Computer Science 2024-03-19 Kaustubh Sridhar , Souradeep Dutta , Dinesh Jayaraman , James Weimer , Insup Lee

Deep reinforcement learning (RL) has been endowed with high expectations in tackling challenging manipulation tasks in an autonomous and self-directed fashion. Despite the significant strides made in the development of reinforcement…

Robotics · Computer Science 2023-04-27 Zhenshan Bing , Aleksandr Mavrichev , Sicong Shen , Xiangtong Yao , Kejia Chen , Kai Huang , Alois Knoll

Implementing obstacle avoidance in dynamic environments is a challenging problem for robots. Model predictive control (MPC) is a popular strategy for dealing with this type of problem, and recent work mainly uses control barrier function…

Robotics · Computer Science 2024-04-10 Zetao Lu , Kaijun Feng , Jun Xu , Haoyao Chen , Yunjiang Lou

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

While imitation learning is often used in robotics, the approach frequently suffers from data mismatch and compounding errors. DAgger is an iterative algorithm that addresses these issues by aggregating training data from both the expert…

Machine Learning · Computer Science 2019-07-23 Kunal Menda , Katherine Driggs-Campbell , Mykel J. Kochenderfer

Model predictive control (MPC) is a powerful strategy for planning and control in autonomous mobile robot navigation. However, ensuring safety in real-world deployments remains challenging due to the presence of disturbances and measurement…

Robotics · Computer Science 2025-08-12 Dennis Benders , Johannes Köhler , Robert Babuška , Javier Alonso-Mora , Laura Ferranti

Interactive imitation learning makes an agent's control policy robust by stepwise supervisions from an expert. The recent algorithms mostly employ expert-agent switching systems to reduce the expert's burden by limitedly selecting the…

Robotics · Computer Science 2026-04-23 Taisuke Kobayashi

When faced with accomplishing a task, human experts exhibit intentional behavior. Their unique intents shape their plans and decisions, resulting in experts demonstrating diverse behaviors to accomplish the same task. Due to the…

Machine Learning · Computer Science 2024-04-29 Sangwon Seo , Vaibhav Unhelkar

Imitation learning (IL) can generate computationally efficient sensorimotor policies from demonstrations provided by computationally expensive model-based sensing and control algorithms. However, commonly employed IL methods are often…

Robotics · Computer Science 2022-10-20 Andrea Tagliabue , Jonathan P. How

Imitation learning is the task of replicating expert policy from demonstrations, without access to a reward function. This task becomes particularly challenging when the expert exhibits a mixture of behaviors. Prior work has introduced…

Machine Learning · Computer Science 2022-05-10 Arash Vahabpour , Tianyi Wang , Qiujing Lu , Omead Pooladzandi , Vwani Roychowdhury

We present foundations for using Model Predictive Control (MPC) as a differentiable policy class for reinforcement learning in continuous state and action spaces. This provides one way of leveraging and combining the advantages of…

Machine Learning · Computer Science 2019-10-15 Brandon Amos , Ivan Dario Jimenez Rodriguez , Jacob Sacks , Byron Boots , J. Zico Kolter

As robots and other intelligent agents move from simple environments and problems to more complex, unstructured settings, manually programming their behavior has become increasingly challenging and expensive. Often, it is easier for a…

Robotics · Computer Science 2018-11-19 Takayuki Osa , Joni Pajarinen , Gerhard Neumann , J. Andrew Bagnell , Pieter Abbeel , Jan Peters

Learning motor skills for sports or performance driving is often done with professional instruction from expert human teachers, whose availability is limited. Our goal is to enable automated teaching via a learned model that interacts with…

Robotic insertion tasks are characterized by contact and friction mechanics, making them challenging for conventional feedback control methods due to unmodeled physical effects. Reinforcement learning (RL) is a promising approach for…

Machine Learning · Computer Science 2020-05-26 Gerrit Schoettler , Ashvin Nair , Juan Aparicio Ojea , Sergey Levine , Eugen Solowjow

This paper presents a safe learning-based eco-driving framework tailored for mixed traffic flows, which aims to optimize energy efficiency while guaranteeing safety during real-system operations. Even though reinforcement learning (RL) is…

Systems and Control · Electrical Eng. & Systems 2024-02-01 Ke Lu , Dongjun Li , Qun Wang , Kaidi Yang , Lin Zhao , Ziyou Song

This paper proposes a safe reinforcement learning (RL) framework based on forward-invariance-induced action-space design. The control problem is cast as a Markov decision process, but instead of relying on runtime shielding or penalty-based…

Systems and Control · Electrical Eng. & Systems 2026-04-10 Chieh Tsai , Muhammad Junayed Hasan Zahed , Salim Hariri , Hossein Rastgoftar

Imitation learning attracts much attention for its ability to allow robots to quickly learn human manipulation skills through demonstrations. However, in the real world, human demonstrations often exhibit random behavior that is not…

Robotics · Computer Science 2024-07-09 Xizhou Bu , Wenjuan Li , Zhengxiong Liu , Zhiqiang Ma , Panfeng Huang

Deep Reinforcement Learning (RL) has shown promise in addressing complex robotic challenges. In real-world applications, RL is often accompanied by failsafe controllers as a last resort to avoid catastrophic events. While necessary for…

Robotics · Computer Science 2023-09-26 Jakob Thumm , Guillaume Pelat , Matthias Althoff

We introduce a simple but effective method for managing risk in model-based reinforcement learning with trajectory sampling that involves probabilistic safety constraints and balancing of optimism in the face of epistemic uncertainty and…

Machine Learning · Computer Science 2023-09-12 Marin Vlastelica , Sebastian Blaes , Cristina Pineri , Georg Martius