English
Related papers

Related papers: CBF-RL: Safety Filtering Reinforcement Learning in…

200 papers

Modern nonlinear control theory seeks to endow systems with properties of stability and safety, and have been deployed successfully in multiple domains. Despite this success, model uncertainty remains a significant challenge in synthesizing…

Systems and Control · Electrical Eng. & Systems 2019-12-24 Andrew Taylor , Andrew Singletary , Yisong Yue , Aaron Ames

Construction automation increasingly requires autonomous mobile robots, yet robust autonomy remains challenging on construction sites. These environments are dynamic and often visually occluded, which complicates perception and navigation.…

Robotics · Computer Science 2026-02-16 Johannes Mootz , Reza Akhavian

Control barrier functions (CBF) have become popular as a safety filter to guarantee the safety of nonlinear dynamical systems for arbitrary inputs. However, it is difficult to construct functions that satisfy the CBF constraints for high…

Optimization and Control · Mathematics 2023-12-06 Oswin So , Zachary Serlin , Makai Mann , Jake Gonzales , Kwesi Rutledge , Nicholas Roy , Chuchu Fan

Reinforcement learning (RL) controllers are flexible and performant but rarely guarantee safety. Safety filters impart hard safety guarantees to RL controllers while maintaining flexibility. However, safety filters can cause undesired…

Robotics · Computer Science 2024-12-20 Federico Pizarro Bejarano , Lukas Brunke , Angela P. Schoellig

In this paper we present the implementation of a Control Barrier Function (CBF) using a quadratic program (QP) formulation that provides obstacle avoidance for a robotic manipulator arm system. CBF is a control technique that has emerged…

Robotics · Computer Science 2022-11-22 Stephen McIlvanna , Nhat Nguyen Minh , Yuzhu Sun , Mien Van , Wasif Naeem

Spacecraft rendezvous and proximity operations (RPO) pose safety risks to high-value assets, so formal safety guarantees are critical. Yet conservative safety controllers can reduce mission efficiency. We propose a unified two-stage…

Optimization and Control · Mathematics 2026-02-03 Minduli Wijayatunga , Nathan Wallace , Salah Sukkarieh , Roberto Armellin

Control Barrier Functions (CBFs) provide an elegant framework for constraining nonlinear control system dynamics to remain within an invariant subset of a designated safe set. However, identifying a CBF that balances performance-by…

Machine Learning · Computer Science 2024-11-05 Lakshmideepakreddy Manda , Shaoru Chen , Mahyar Fazlyab

Control barrier functions (CBFs) are widely used in safety-critical controllers. However, constructing a valid CBF is challenging, especially under nonlinear or non-convex constraints and for high relative degree systems. Meanwhile, finding…

Systems and Control · Electrical Eng. & Systems 2022-10-12 Bolun Dai , Prashanth Krishnamurthy , Farshad Khorrami

Reinforcement learning is a powerful technique for developing new robot behaviors. However, typical lack of safety guarantees constitutes a hurdle for its practical application on real robots. To address this issue, safe reinforcement…

Machine Learning · Computer Science 2024-04-29 Maeva Guerrier , Hassan Fouad , Giovanni Beltrame

Control Barrier Functions (CBFs) have become powerful tools for ensuring safety in nonlinear systems. However, finding valid CBFs that guarantee persistent safety and feasibility remains an open challenge, especially in systems with input…

Robotics · Computer Science 2025-03-05 Taekyung Kim , Robin Inho Kee , Dimitra Panagou

Guaranteeing safe behaviour of reinforcement learning (RL) policies poses significant challenges for safety-critical applications, despite RL's generality and scalability. To address this, we propose a new approach to apply verification…

Machine Learning · Computer Science 2023-12-06 Daniel C. H. Tan , Fernando Acero , Robert McCarthy , Dimitrios Kanoulas , Zhibin Li

Control Barrier Functions (CBFs) have proven to be an effective tool for performing safe control synthesis for nonlinear systems. However, guaranteeing safety in the presence of disturbances and input constraints for high relative degree…

Optimization and Control · Mathematics 2026-01-21 Luzia Knoedler , Oswin So , Ji Yin , Mitchell Black , Zachary Serlin , Panagiotis Tsiotras , Javier Alonso-Mora , Chuchu Fan

We present a real-time safety filter for motion planning, including those that are learning-based, using Control Barrier Functions (CBFs) to provide formal guarantees for collision avoidance with road boundaries. A key feature of our…

Robotics · Computer Science 2026-03-25 Jianye Xu , Chang Che , Bassam Alrifaee

Safe reinforcement learning (RL) for robotic systems requires policies that improve task performance while satisfying state and input constraints during both training and deployment. Control barrier functions (CBFs) provide a principled…

Robotics · Computer Science 2026-05-27 Dhruv S. Kushwaha , Zoleikha A. Biron

Reinforcement learning (RL)-based driver assistance systems seek to improve fuel consumption via continual improvement of powertrain control actions considering experiential data from the field. However, the need to explore diverse…

Robotics · Computer Science 2023-01-04 Habtamu Hailemichael , Beshah Ayalew , Lindsey Kerbel , Andrej Ivanco , Keith Loiselle

Reinforcement Learning (RL) has been shown to be effective in many scenarios. However, it typically requires the exploration of a sufficiently large number of state-action pairs, some of which may be unsafe. Consequently, its application to…

Systems and Control · Electrical Eng. & Systems 2022-06-24 Yousef Emam , Gennaro Notomista , Paul Glotfelter , Zsolt Kira , Magnus Egerstedt

Safety filters, particularly those based on control barrier functions, have gained increased interest as effective tools for safe control of dynamical systems. Existing correct-by-construction synthesis algorithms for such filters, however,…

Machine Learning · Computer Science 2025-09-19 Ihab Tabbara , Hussein Sibai

Ensuring safety in autonomous systems requires controllers that aim to satisfy state-wise constraints without relying on online interaction.While existing Safe Offline RL methods typically enforce soft expected-cost constraints, they…

Artificial Intelligence · Computer Science 2026-04-03 Mumuksh Tayal , Manan Tayal , Aditya Singh , Shishir Kolathaya , Ravi Prakash

Merely pursuing performance may adversely affect the safety, while a conservative policy for safe exploration will degrade the performance. How to balance the safety and performance in learning-based control problems is an interesting yet…

Systems and Control · Electrical Eng. & Systems 2025-01-28 Xinyang Wang , Hongwei Zhang , Shimin Wang , Wei Xiao , Martin Guay

Reinforcement learning (RL) offers a compelling data-driven paradigm for synthesizing controllers for complex systems when accurate physical models are unavailable; however, most existing control-oriented RL methods assume stationarity and,…

Machine Learning · Computer Science 2026-04-22 Austin Coursey , Abel Diaz-Gonzalez , Marcos Quinones-Grueiro , Gautam Biswas