English
Related papers

Related papers: Safe Exploration in Model-based Reinforcement Lear…

200 papers

Hybrid dynamical systems are ubiquitous as practical robotic applications often involve both continuous states and discrete switchings. Safety is a primary concern for hybrid robotic systems. Existing safety-critical control approaches for…

Robotics · Computer Science 2024-12-02 Shuo Yang , Yu Chen , Xiang Yin , George J. Pappas , Rahul Mangharam

Safe Reinforcement Learning (SafeRL) is the subfield of reinforcement learning that explicitly deals with safety constraints during the learning and deployment of agents. This survey provides a mathematically rigorous overview of SafeRL…

Machine Learning · Computer Science 2026-04-30 Ankita Kushwaha , Kiran Ravish , Preeti Lamba , Pawan Kumar

The optimal performance of robotic systems is usually achieved near the limit of state and input bounds. Model predictive control (MPC) is a prevalent strategy to handle these operational constraints, however, safety still remains an open…

Systems and Control · Electrical Eng. & Systems 2021-03-24 Jun Zeng , Bike Zhang , Koushil Sreenath

This paper studies the constrained/safe reinforcement learning (RL) problem with sparse indicator signals for constraint violations. We propose a model-based approach to enable RL agents to effectively explore the environment with unknown…

Artificial Intelligence · Computer Science 2021-03-09 Zuxin Liu , Hongyi Zhou , Baiming Chen , Sicheng Zhong , Martial Hebert , Ding Zhao

Control Barrier Functions (CBFs) are a practical approach for designing safety-critical controllers, but constructing them for arbitrary nonlinear dynamical systems remains a challenge. Recent efforts have explored learning-based methods,…

Systems and Control · Electrical Eng. & Systems 2025-05-20 Manan Tayal , Aditya Singh , Pushpak Jagtap , Shishir Kolathaya

Groundbreaking successes have been achieved by Deep Reinforcement Learning (DRL) in solving practical decision-making problems. Robotics, in particular, can involve high-cost hardware and human interactions. Hence, scrupulous evaluations of…

Artificial Intelligence · Computer Science 2020-10-20 Davide Corsi , Enrico Marchesini , Alessandro Farinelli

Control barrier functions (CBFs) offer an efficient framework for designing real-time safe controllers. However, CBF-based controllers can be short-sighted, resulting in poor performance, a behaviour which is aggravated in uncertain…

Systems and Control · Electrical Eng. & Systems 2024-09-16 Allan Andre do Nascimento , Antonis Papachristodoulou , Kostas Margellos

Constrained reinforcement learning (CRL) has gained significant interest recently, since safety constraints satisfaction is critical for real-world problems. However, existing CRL methods constraining discounted cumulative costs generally…

Machine Learning · Computer Science 2022-06-08 Dongjie Yu , Haitong Ma , Shengbo Eben Li , Jianyu Chen

Safety is of paramount importance in control systems to avoid costly risks and catastrophic damages. The control barrier function (CBF) method, a promising solution for safety-critical control, poses a new challenge of enhancing control…

Systems and Control · Electrical Eng. & Systems 2025-03-26 Shengbo Wang , Ke Li , Zheng Yan , Zhenyuan Guo , Song Zhu , Guanghui Wen , Shiping Wen

Ensuring safety under unknown and stochastic dynamics remains a significant challenge in reinforcement learning (RL). In this paper, we propose a model predictive control (MPC)-based safe RL framework, called Probabilistic Ensembles with…

Systems and Control · Electrical Eng. & Systems 2026-04-09 Ali Umut Kaypak , Prashanth Krishnamurthy , Farshad Khorrami

In this paper an output-feedback model-based reinforcement learning (MBRL) method for a class of second-order nonlinear systems is developed. The control technique uses exact model knowledge and integrates a dynamic state estimator within…

Systems and Control · Computer Science 2021-07-07 Ryan Self , Michael Harlan , Rushikesh Kamalapurkar

Providing safety guarantees for learning-based controllers is important for real-world applications. One approach to realizing safety for arbitrary control policies is safety filtering. If necessary, the filter modifies control inputs to…

Systems and Control · Electrical Eng. & Systems 2023-12-18 Lukas Brunke , Siqi Zhou , Mingxuan Che , Angela P. Schoellig

Safety constraints of nonlinear control systems are commonly enforced through the use of control barrier functions (CBFs). Uncertainties in the dynamic model can disrupt forward invariance guarantees or cause the state to be restricted to…

Systems and Control · Electrical Eng. & Systems 2025-01-30 Hannah M. Sweatland , Omkar Sudhir Patil , Warren E. Dixon

Control barrier functions (CBFs) are a popular tool for safety certification of nonlinear dynamical control systems. Recently, CBFs represented as neural networks have shown great promise due to their expressiveness and applicability to a…

Machine Learning · Computer Science 2026-04-15 Nikolaus Vertovec , Frederik Baymler Mathiesen , Thom Badings , Luca Laurenti , Alessandro Abate

This paper proposes a control-based framework for aligning large language models (LLMs) by leveraging a control barrier function (CBF) to ensure user-desirable text generation. The presented framework applies the CBF safety filter to the…

Computation and Language · Computer Science 2026-03-31 Yuya Miyaoka , Masaki Inoue

This letter presents a constrained control framework that integrates Explicit Reference Governors (ERG) with Control Barrier Functions (CBF) to ensure recursive feasibility without online optimization. We formulate the reference update as a…

Systems and Control · Electrical Eng. & Systems 2026-04-07 Satoshi Nakano , Emanuele Garone , Gennaro Notomista

This work introduces a novel Proxy Control Barrier Function (PCBF) scheme that integrates barrier-based and Lyapunov-based safety-critical control strategies for strict-feedback systems with potentially unknown dynamics. The proposed method…

Systems and Control · Electrical Eng. & Systems 2025-05-13 Yujie Wang , Xiangru Xu

Control Barrier Functions (CBFs) have become a popular tool for enforcing set invariance in safety-critical control systems. While guaranteeing safety, most CBF approaches are myopic in the sense that they solve an optimization problem at…

Systems and Control · Electrical Eng. & Systems 2020-08-11 Max Cohen , Calin Belta

Addressing the critical need for robust safety in Large Language Models (LLMs), particularly against adversarial attacks and in-distribution errors, we introduce Reinforcement Learning with Backtracking Feedback (RLBF). This framework…

Machine Learning · Computer Science 2026-04-28 Bilgehan Sel , Vaishakh Keshava , Phillip Wallis , Lukas Rutishauser , Ming Jin , Dingcheng Li

Many modern nonlinear control methods aim to endow systems with guaranteed properties, such as stability or safety, and have been successfully applied to the domain of robotics. However, model uncertainty remains a persistent challenge,…

Robotics · Computer Science 2020-11-20 Andrew J. Taylor , Victor D. Dorobantu , Hoang M. Le , Yisong Yue , Aaron D. Ames