English
Related papers

Related papers: Multi-Constraint Safe Reinforcement Learning via C…

200 papers

Safety-critical whole-body robot control demands reactive methods that ensure collision avoidance in real-time. Complementarity constraints and control barrier functions (CBF) have emerged as core tools for ensuring such safety constraints,…

Autonomous robot navigation can be particularly demanding, especially when the surrounding environment is not known and safety of the robot is crucial. This work relates to the synthesis of Control Barrier Functions (CBFs) through data for…

Robotics · Computer Science 2024-07-30 Marvin Harms , Mihir Kulkarni , Nikhil Khedekar , Martin Jacquet , Kostas Alexis

Reinforcement learning (RL) has been successfully applied to a variety of robotics applications, where it outperforms classical methods. However, the safety aspect of RL and the transfer to the real world remain an open challenge. A…

Robotics · Computer Science 2025-04-21 Murad Dawood , Ahmed Shokry , Maren Bennewitz

Enforcing multiple constraints based on the concept of control barrier functions (CBFs) is a remaining challenge because each of the CBFs requires a condition on the control inputs to be satisfied which may easily lead to infeasibility…

Optimization and Control · Mathematics 2025-08-26 Mark Spiller , Emilia Isbono , Philipp Schitz

Using control barrier functions (CBFs) as safety filters provides a computationally inexpensive yet effective method for constructing controllers in safety-critical applications. However, using CBFs requires the construction of a valid CBF,…

Systems and Control · Electrical Eng. & Systems 2024-02-15 Bolun Dai , Prashanth Krishnamurthy , Farshad Khorrami

In this paper, we develop a novel closed-form Control Barrier Function (CBF) and associated controller shield for the Kinematic Bicycle Model (KBM) with respect to obstacle avoidance. The proposed CBF and shield -- designed by an algorithm…

Robotics · Computer Science 2025-03-18 James Ferlez , Mahmoud Elnaggar , Yasser Shoukry , Cody Fleming

A popular framework for enforcing safe actions in Reinforcement Learning (RL) is Constrained RL, where trajectory based constraints on expected cost (or other cost measures) are employed to enforce safety and more importantly these…

Machine Learning · Computer Science 2024-08-09 Huy Hoang , Tien Mai , Pradeep Varakantham

Reinforcement learning (RL) offers a compelling data-driven paradigm for synthesizing controllers for complex systems when accurate physical models are unavailable; however, most existing control-oriented RL methods assume stationarity and,…

Machine Learning · Computer Science 2026-04-22 Austin Coursey , Abel Diaz-Gonzalez , Marcos Quinones-Grueiro , Gautam Biswas

Safety-critical control is a crucial aspect of modern systems, and Control Barrier Functions (CBFs) have gained popularity as the framework of choice for ensuring safety. However, implementing a CBF requires exact knowledge of the true…

Systems and Control · Electrical Eng. & Systems 2025-08-26 Rahal Nanayakkara , Aaron D. Ames , Paulo Tabuada

In this paper, we propose a novel Control Barrier Function (CBF) based controller for nonlinear systems with complex, time-varying input constraints. To deal with these constraints, we introduce an auxiliary control input to transform the…

Systems and Control · Electrical Eng. & Systems 2025-05-20 Yaosheng Deng , Yang Bai , Yujie Wang , Masaki Ogura , Mir Feroskhan

Control barrier functions (CBFs) have recently been introduced as a systematic tool to ensure safety by establishing set invariance. When combined with a control Lyapunov function (CLF), they form a safety-critical control mechanism.…

Systems and Control · Electrical Eng. & Systems 2024-04-22 Mohammad Aali , Jun Liu

Under voltage load shedding has been considered as a standard and effective measure to recover the voltage stability of the electric power grid under emergency and severe conditions. However, this scheme usually trips a massive amount of…

Systems and Control · Electrical Eng. & Systems 2021-10-01 Thanh Long Vu , Sayak Mukherjee , Renke Huang , Qiuhua Hung

Although Reinforcement Learning (RL) algorithms have found tremendous success in simulated domains, they often cannot directly be applied to physical systems, especially in cases where there are hard constraints to satisfy (e.g. on safety…

Machine Learning · Computer Science 2020-08-28 Harsh Satija , Philip Amortila , Joelle Pineau

A predictive control barrier function (PCBF) based safety filter is a modular framework to verify safety of a control input by predicting a future trajectory. The approach relies on the solution of two optimization problems, first computing…

Systems and Control · Electrical Eng. & Systems 2023-07-25 Alexandre Didier , Robin C. Jacobs , Jerome Sieber , Kim P. Wabersich , Melanie N. Zeilinger

Several works have addressed the problem of incorporating constraints in the reinforcement learning (RL) framework, however majority of them can only guarantee the satisfaction of soft constraints. In this work, we address the problem of…

Machine Learning · Computer Science 2020-06-16 Kwangyeon Kim , Akshita Gupta , Hong-Cheol Choi , Inseok Hwang

Safety is a fundamental requirement of many robotic systems. Control barrier function (CBF)-based approaches have been proposed to guarantee the safety of robotic systems. However, the effectiveness of these approaches highly relies on the…

Robotics · Computer Science 2024-03-01 Hongchao Zhang , Luyao Niu , Andrew Clark , Radha Poovendran

In this work, we consider the problem of designing a safety filter for a nonlinear uncertain control system. Our goal is to augment an arbitrary controller with a safety filter such that the overall closed-loop system is guaranteed to stay…

Robotics · Computer Science 2022-04-11 Lukas Brunke , Siqi Zhou , Angela P. Schoellig

Industrial control applications require high performance under strict constraints. Control barrier functions (CBFs) provide principled safety mechanisms, but constructing CBF-based safety filters for large-scale systems is challenging. We…

Systems and Control · Electrical Eng. & Systems 2026-02-09 Kim P. Wabersich , Felix Berkel , Felix Gruber , Sven Reimann

In standard reinforcement learning (RL), a learning agent seeks to optimize the overall reward. However, many key aspects of a desired behavior are more naturally expressed as constraints. For instance, the designer may want to limit the…

Machine Learning · Computer Science 2021-01-29 Sobhan Miryoosefi , Kianté Brantley , Hal Daumé , Miroslav Dudik , Robert Schapire

We consider the problem of designing controllers to guarantee safety in a class of nonlinear systems under uncertainties in the system dynamics and/or the environment. We define a class of uncertain control barrier functions (CBFs), and…

Systems and Control · Electrical Eng. & Systems 2023-09-20 Vipul K. Sharma , S. Sivaranjani