English
Related papers

Related papers: End-to-End Safe Reinforcement Learning through Bar…

200 papers

Reinforcement Learning (RL) uses rewards to guide learning, yet reward design is typically hand-crafted using heuristics that can be difficult to tune. We propose a Control Barrier Function (CBF)-informed reward design for Multi-Agent RL…

Robotics · Computer Science 2026-05-19 Jianye Xu , Bassam Alrifaee

We propose new methods to synthesize control barrier function (CBF)-based safe controllers that avoid input saturation, which can cause safety violations. In particular, our method is created for high-dimensional, general nonlinear systems,…

Robotics · Computer Science 2022-11-22 Simin Liu , Changliu Liu , John Dolan

Safety is a fundamental requirement of control systems. Control Barrier Functions (CBFs) are proposed to ensure the safety of the control system by constructing safety filters or synthesizing control inputs. However, the safety guarantee…

Robotics · Computer Science 2024-03-29 Manan Tayal , Hongchao Zhang , Pushpak Jagtap , Andrew Clark , Shishir Kolathaya

Learning from Demonstration (LfD) is a powerful method for enabling robots to perform novel tasks as it is often more tractable for a non-roboticist end-user to demonstrate the desired skill and for the robot to efficiently learn from the…

Robotics · Computer Science 2023-03-08 Yue Yang , Letian Chen , Matthew Gombolay

This paper proposes an on-policy reinforcement learning (RL) control algorithm that solves the optimal regulation problem for a class of uncertain continuous-time nonlinear systems under user-defined state constraints. We formulate the safe…

Systems and Control · Electrical Eng. & Systems 2022-09-20 Soutrik Bandyopadhyay , Shubhendu Bhasin

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

Modern nonlinear control theory seeks to endow systems with properties of stability and safety, and have been deployed successfully in multiple domains. Despite this success, model uncertainty remains a significant challenge in synthesizing…

Systems and Control · Electrical Eng. & Systems 2019-12-24 Andrew Taylor , Andrew Singletary , Yisong Yue , Aaron Ames

Reinforcement learning (RL) exhibits impressive performance when managing complicated control tasks for robots. However, its wide application to physical robots is limited by the absence of strong safety guarantees. To overcome this…

Robotics · Computer Science 2023-05-18 Desong Du , Shaohang Han , Naiming Qi , Haitham Bou Ammar , Jun Wang , Wei Pan

Reinforcement Learning (RL) has been shown to be effective in many scenarios. However, it typically requires the exploration of a sufficiently large number of state-action pairs, some of which may be unsafe. Consequently, its application to…

Systems and Control · Electrical Eng. & Systems 2022-06-24 Yousef Emam , Gennaro Notomista , Paul Glotfelter , Zsolt Kira , Magnus Egerstedt

Control barrier functions (CBFs) are widely used in safety-critical controllers. However, constructing a valid CBF is challenging, especially under nonlinear or non-convex constraints and for high relative degree systems. Meanwhile, finding…

Systems and Control · Electrical Eng. & Systems 2022-10-12 Bolun Dai , Prashanth Krishnamurthy , Farshad Khorrami

Safety and stability are two critical concerns in pursuit-evasion (PE) problems in an obstacle-rich environment. Most existing works combine control barrier functions (CBFs) and reinforcement learning (RL) to provide an efficient and safe…

Systems and Control · Electrical Eng. & Systems 2025-07-29 Xinyang Wang , Hongwei Zhang , Jun Xu , Shimin Wang , Martin Guay

Reinforcement Learning (RL) and continuous nonlinear control have been successfully deployed in multiple domains of complicated sequential decision-making tasks. However, given the exploration nature of the learning process and the presence…

Robotics · Computer Science 2022-08-01 Wenhao Luo , Wen Sun , Ashish Kapoor

In this work, we consider the problem of designing a safety filter for a nonlinear uncertain control system. Our goal is to augment an arbitrary controller with a safety filter such that the overall closed-loop system is guaranteed to stay…

Robotics · Computer Science 2022-04-11 Lukas Brunke , Siqi Zhou , Angela P. Schoellig

High performance, reliability and safety are crucial properties of any Software-Defined-Networking (SDN) system. Although the use of Deep Reinforcement Learning (DRL) algorithms has been widely studied to improve performance, their…

Networking and Internet Architecture · Computer Science 2024-10-23 Lam Dinh , Pham Tran Anh Quang , Jérémie Leguay

Correct-by-construction techniques, such as control barrier functions (CBFs), can be used to guarantee closed-loop safety by acting as a supervisor of an existing or legacy controller. However, supervisory-control intervention typically…

Systems and Control · Computer Science 2018-05-03 Yuxiao Chen , Ayonga Hereid , Huei Peng , Jessy Grizzle

In this paper, we consider a way to safely navigate the robots in unknown environments using measurement data from sensory devices. The control barrier function (CBF) is one of the promising approaches to encode safety requirements of the…

Systems and Control · Electrical Eng. & Systems 2023-08-11 Wataru Hashimoto , Kazumune Hashimoto , Akifumi Wachi , Xun Shen , Masako Kishida , Shigemasa Takai

Training-time safety violations have been a major concern when we deploy reinforcement learning algorithms in the real world. This paper explores the possibility of safe RL algorithms with zero training-time safety violations in the…

Machine Learning · Computer Science 2022-03-14 Yuping Luo , Tengyu Ma

Using control barrier functions (CBFs) as safety filters provides a computationally inexpensive yet effective method for constructing controllers in safety-critical applications. However, using CBFs requires the construction of a valid CBF,…

Systems and Control · Electrical Eng. & Systems 2024-02-15 Bolun Dai , Prashanth Krishnamurthy , Farshad Khorrami

Reinforcement learning (RL) has demonstrated impressive performance in various areas such as video games and robotics. However, ensuring safety and stability, which are two critical properties from a control perspective, remains a…

Systems and Control · Electrical Eng. & Systems 2023-10-02 Liqun Zhao , Konstantinos Gatsis , Antonis Papachristodoulou

Safe control with guarantees generally requires the system model to be known. It is far more challenging to handle systems with uncertain parameters. In this paper, we propose a generic algorithm that can synthesize and verify safe…

Systems and Control · Electrical Eng. & Systems 2025-11-12 Simin Liu , Kai S. Yun , John M. Dolan , Changliu Liu