English
Related papers

Related papers: Safe Exploration in Model-based Reinforcement Lear…

200 papers

Safety-critical control tasks with high levels of uncertainty are becoming increasingly common. Typically, techniques that guarantee safety during learning and control utilize constraint-based safety certificates, which can be leveraged to…

Systems and Control · Electrical Eng. & Systems 2023-11-07 Alexandre Capone , Ryan Cosner , Aaron Ames , Sandra Hirche

Inspired by the success of imitation and inverse reinforcement learning in replicating expert behavior through optimal control, we propose a learning based approach to safe controller synthesis based on control barrier functions (CBFs). We…

Systems and Control · Electrical Eng. & Systems 2020-11-10 Alexander Robey , Haimin Hu , Lars Lindemann , Hanwen Zhang , Dimos V. Dimarogonas , Stephen Tu , Nikolai Matni

This paper presents a safety-guaranteed, runtime-efficient imitation learning framework for spacecraft close proximity control. We leverage Control Barrier Functions (CBFs) for safety certificates and Control Lyapunov Functions (CLFs) for…

Robotics · Computer Science 2026-03-20 Alexander Meinert , Niklas Baldauf , Peter Stadler , Alen Turnwald

Reinforcement Learning (RL) has shown promise in control tasks but faces significant challenges in real-world applications, primarily due to the absence of safety guarantees during the learning process. Existing methods often struggle with…

Machine Learning · Computer Science 2025-04-29 Donghe Chen , Han Wang , Lin Cheng , Shengping Gong

Safe navigation in unknown and cluttered environments remains a challenging problem in robotics. Model Predictive Contour Control (MPCC) has shown promise for performant obstacle avoidance by enabling precise and agile trajectory tracking,…

Robotics · Computer Science 2025-07-22 Nicholas Mohammad , Nicola Bezzo

This work addresses the challenge of safe and efficient mobile robot navigation in complex dynamic environments with concave moving obstacles. Reactive safe controllers like Control Barrier Functions (CBFs) design obstacle avoidance…

Robotics · Computer Science 2026-02-12 Yifan Xue , Ze Zhang , Knut Åkesson , Nadia Figueroa

This paper introduces the reinforcement learning backup shield (RLBUS), an algorithm that guarantees safe exploration in reinforcement learning (RL) by incorporating backup control barrier functions (BCBFs). RLBUS constructs an implicit…

Systems and Control · Electrical Eng. & Systems 2024-12-10 Pedram Rabiee , Amirsaeid Safari

In this paper, we establish a connection between model predictive control (MPC) techniques and Control Barrier Functions (CBFs). Recognizing the similarity between CBFs and Control Lyapunov Functions (CLFs), we propose a MPC formulation…

Optimization and Control · Mathematics 2025-07-03 Jingyi Huang , Han Wang , Kostas Margellos , Paul Goulart

Reinforcement learning (RL)-based driver assistance systems seek to improve fuel consumption via continual improvement of powertrain control actions considering experiential data from the field. However, the need to explore diverse…

Robotics · Computer Science 2023-01-04 Habtamu Hailemichael , Beshah Ayalew , Lindsey Kerbel , Andrej Ivanco , Keith Loiselle

It has been shown that optimizing quadratic costs while stabilizing affine control systems to desired (sets of) states subject to state and control constraints can be reduced to a sequence of Quadratic Programs (QPs) by using Control…

Optimization and Control · Mathematics 2023-03-17 Wei Xiao , Christos G. Cassandras , Calin A. Belta

Modern nonlinear control theory seeks to develop feedback controllers that endow systems with properties such as safety and stability. The guarantees ensured by these controllers often rely on accurate estimates of the system state for…

Systems and Control · Electrical Eng. & Systems 2020-11-02 Sarah Dean , Andrew J. Taylor , Ryan K. Cosner , Benjamin Recht , Aaron D. Ames

Safety filters, particularly those based on control barrier functions, have gained increased interest as effective tools for safe control of dynamical systems. Existing correct-by-construction synthesis algorithms for such filters, however,…

Machine Learning · Computer Science 2025-09-19 Ihab Tabbara , Hussein Sibai

Imitation learning (IL) is a learning paradigm which can be used to synthesize controllers for complex systems that mimic behavior demonstrated by an expert (user or control algorithm). Despite their popularity, IL methods generally lack…

Systems and Control · Electrical Eng. & Systems 2022-12-23 Ryan K. Cosner , Yisong Yue , Aaron D. Ames

Autonomous spacecraft inspection and docking missions require controllers that can guarantee safety under thrust constraints and uncertainty. Input-constrained control barrier functions (ICCBFs) provide a framework for safety certification…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Minduli C. Wijayatunga , Richard Linares , Roberto Armellin

Reinforcement learning (RL) has shown a promising performance in learning optimal policies for a variety of sequential decision-making tasks. However, in many real-world RL problems, besides optimizing the main objectives, the agent is…

Machine Learning · Computer Science 2021-07-30 Ashkan B. Jeddi , Nariman L. Dehghani , Abdollah Shafieezadeh

Reinforcement learning (RL) solves sequential decision-making problems via a trial-and-error process interacting with the environment. While RL achieves outstanding success in playing complex video games that allow huge trial-and-error,…

Machine Learning · Computer Science 2022-06-22 Fan-Ming Luo , Tian Xu , Hang Lai , Xiong-Hui Chen , Weinan Zhang , Yang Yu

This paper introduces differentiable higher-order control barrier functions (CBF) that are end-to-end trainable together with learning systems. CBFs are usually overly conservative, while guaranteeing safety. Here, we address their…

Machine Learning · Computer Science 2021-11-23 Wei Xiao , Ramin Hasani , Xiao Li , Daniela Rus

We propose new methods to synthesize control barrier function (CBF)-based safe controllers that avoid input saturation, which can cause safety violations. In particular, our method is created for high-dimensional, general nonlinear systems,…

Robotics · Computer Science 2022-11-22 Simin Liu , Changliu Liu , John Dolan

Ensuring safety in the sense of constraint satisfaction for learning-based control is a critical challenge, especially in the model-free case. While safety filters address this challenge in the model-based setting by modifying unsafe…

Systems and Control · Electrical Eng. & Systems 2026-01-15 Kanghui He , Shengling Shi , Ton van den Boom , Bart De Schutter

Reinforcement Learning (RL) has been shown to be effective in many scenarios. However, it typically requires the exploration of a sufficiently large number of state-action pairs, some of which may be unsafe. Consequently, its application to…

Systems and Control · Electrical Eng. & Systems 2022-06-24 Yousef Emam , Gennaro Notomista , Paul Glotfelter , Zsolt Kira , Magnus Egerstedt