English
Related papers

Related papers: Optimal control barrier functions for RL based saf…

200 papers

Safe reinforcement learning (RL) for robotic systems requires policies that improve task performance while satisfying state and input constraints during both training and deployment. Control barrier functions (CBFs) provide a principled…

Robotics · Computer Science 2026-05-27 Dhruv S. Kushwaha , Zoleikha A. Biron

Control barrier functions (CBFs) are widely used in safety-critical controllers. However, constructing a valid CBF is challenging, especially under nonlinear or non-convex constraints and for high relative degree systems. Meanwhile, finding…

Systems and Control · Electrical Eng. & Systems 2022-10-12 Bolun Dai , Prashanth Krishnamurthy , Farshad Khorrami

This paper addresses the target-pursuit problem, aiming to ensure each pursuer's safety regarding collision avoidance, sensing range, and input saturation. An input-constrained CBF is proposed to dynamically regulate the pursuer's control,…

Systems and Control · Electrical Eng. & Systems 2024-12-11 Yaosheng Deng , Junjie Gao , Jiaping Xiao , Mir Feroskhan

This paper develops a model-based reinforcement learning (MBRL) framework for learning online the value function of an infinite-horizon optimal control problem while obeying safety constraints expressed as control barrier functions (CBFs).…

Machine Learning · Computer Science 2022-11-10 Max H. Cohen , Calin Belta

Control Barrier Functions (CBFs) provide an elegant framework for constraining nonlinear control system dynamics to remain within an invariant subset of a designated safe set. However, identifying a CBF that balances performance-by…

Machine Learning · Computer Science 2024-11-05 Lakshmideepakreddy Manda , Shaoru Chen , Mahyar Fazlyab

Safety filters leveraging control barrier functions (CBFs) are highly effective for enforcing safe behavior on complex systems. It is often easier to synthesize CBFs for a Reduced order Model (RoM), and track the resulting safe behavior on…

Systems and Control · Electrical Eng. & Systems 2024-12-09 William D. Compton , Max H. Cohen , Aaron D. Ames

Learning-based control with safety guarantees usually requires real-time safety certification and modifications of possibly unsafe learning-based policies. The control barrier function (CBF) method uses a safety filter containing a…

Systems and Control · Electrical Eng. & Systems 2024-10-25 Kanghui He , Shengling Shi , Ton van den Boom , Bart De Schutter

Control barrier function (CBF) has recently started to serve as a basis to develop approaches for enforcing safety requirements in control systems. However, constructing such function for a general system is a non-trivial task. This paper…

Systems and Control · Electrical Eng. & Systems 2023-01-02 Zihao Liang , Jason King Ching Lo

Inspired by the success of imitation and inverse reinforcement learning in replicating expert behavior through optimal control, we propose a learning based approach to safe controller synthesis based on control barrier functions (CBFs). We…

Systems and Control · Electrical Eng. & Systems 2020-11-10 Alexander Robey , Haimin Hu , Lars Lindemann , Hanwen Zhang , Dimos V. Dimarogonas , Stephen Tu , Nikolai Matni

Guaranteeing safe behaviour of reinforcement learning (RL) policies poses significant challenges for safety-critical applications, despite RL's generality and scalability. To address this, we propose a new approach to apply verification…

Machine Learning · Computer Science 2023-12-06 Daniel C. H. Tan , Fernando Acero , Robert McCarthy , Dimitrios Kanoulas , Zhibin Li

Reinforcement learning (RL) has proven to be particularly effective in solving complex decision-making problems for a wide range of applications. Safe reinforcement learning refers to a class of constrained problems where the constraint…

Systems and Control · Electrical Eng. & Systems 2026-05-13 Dhruv Singh Kushwaha , Zoleikha Abdollahi Biron

Control barrier functions (CBF) have become popular as a safety filter to guarantee the safety of nonlinear dynamical systems for arbitrary inputs. However, it is difficult to construct functions that satisfy the CBF constraints for high…

Optimization and Control · Mathematics 2023-12-06 Oswin So , Zachary Serlin , Makai Mann , Jake Gonzales , Kwesi Rutledge , Nicholas Roy , Chuchu Fan

Model information can be used to predict future trajectories, so it has huge potential to avoid dangerous region when implementing reinforcement learning (RL) on real-world tasks, like autonomous driving. However, existing studies mostly…

Robotics · Computer Science 2021-03-08 Haitong Ma , Jianyu Chen , Shengbo Eben Li , Ziyu Lin , Yang Guan , Yangang Ren , Sifa Zheng

This paper addresses learning safe output feedback control laws from partial observations of expert demonstrations. We assume that a model of the system dynamics and a state estimator are available along with corresponding error bounds,…

Systems and Control · Electrical Eng. & Systems 2024-04-04 Lars Lindemann , Alexander Robey , Lejun Jiang , Satyajeet Das , Stephen Tu , Nikolai Matni

We address the problem of safe policy learning in multi-agent safety-critical autonomous systems. In such systems, it is necessary for each agent to meet the safety requirements at all times while also cooperating with other agents to…

Control barrier functions (CBFs) have been widely used for synthesizing controllers in safety-critical applications. When used as a safety filter, it provides a simple and computationally efficient way to obtain safe controls from a…

Systems and Control · Electrical Eng. & Systems 2023-03-13 Bolun Dai , Heming Huang , Prashanth Krishnamurthy , Farshad Khorrami

Control barrier function (CBF)-based safety filters provide a systematic way to enforce state constraints, but they can significantly alter the closed-loop dynamics induced by a nominal, stabilizing controller. In particular, the resulting…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Yiting Chen , Pol Mestres , Emiliano Dall'Anese , Jorge Cortés

Modern nonlinear control theory seeks to endow systems with properties of stability and safety, and have been deployed successfully in multiple domains. Despite this success, model uncertainty remains a significant challenge in synthesizing…

Systems and Control · Electrical Eng. & Systems 2019-12-24 Andrew Taylor , Andrew Singletary , Yisong Yue , Aaron Ames

This paper addresses the problem of safety-critical control for non-affine control systems. It has been shown that optimizing quadratic costs subject to state and control constraints can be sub-optimally reduced to a sequence of quadratic…

Systems and Control · Electrical Eng. & Systems 2024-02-15 Wei Xiao , Ross Allen , Daniela Rus

Providing safety guarantees for learning-based controllers is important for real-world applications. One approach to realizing safety for arbitrary control policies is safety filtering. If necessary, the filter modifies control inputs to…

Systems and Control · Electrical Eng. & Systems 2023-12-18 Lukas Brunke , Siqi Zhou , Mingxuan Che , Angela P. Schoellig