English
Related papers

Related papers: Stability Enhancement in Reinforcement Learning vi…

200 papers

Given a Control Lyapunov Function (CLF), Sontag's famous Formula provides a nonlinear state-feedback guaranteeing asymptotic stability of the setpoint. At the same time, a cost function that depends on the CLF is minimized. While there…

Systems and Control · Electrical Eng. & Systems 2026-02-11 Joscha F. Bongard , Boris Lohmann

Model-free deep reinforcement learning (RL) algorithms have been successfully applied to a range of challenging sequential decision making and control tasks. However, these methods typically suffer from two major challenges: high sample…

With the increasing demand for efficient and flexible robotic exploration solutions, Reinforcement Learning (RL) is becoming a promising approach in the field of autonomous robotic exploration. However, current RL-based exploration…

Robotics · Computer Science 2025-03-19 Chunyu Yang , Shengben Bi , Yihui Xu , Xin Zhang

Safety-critical control is a crucial aspect of modern systems, and Control Barrier Functions (CBFs) have gained popularity as the framework of choice for ensuring safety. However, implementing a CBF requires exact knowledge of the true…

Systems and Control · Electrical Eng. & Systems 2025-08-26 Rahal Nanayakkara , Aaron D. Ames , Paulo Tabuada

This paper proposes tackling safety-critical stochastic Reinforcement Learning (RL) tasks with a sample-based, model-based approach. At the core of the method lies a Model Predictive Control (MPC) scheme that acts as function approximation,…

Systems and Control · Electrical Eng. & Systems 2025-07-30 Filippo Airaldi , Bart De Schutter , Azita Dabiri

Deep reinforcement learning has been recognized as a promising tool to address the challenges in real-time control of power systems. However, its deployment in real-world power systems has been hindered by a lack of explicit stability and…

Systems and Control · Electrical Eng. & Systems 2023-10-04 Jie Feng , Yuanyuan Shi , Guannan Qu , Steven H. Low , Anima Anandkumar , Adam Wierman

Model-free Deep Reinforcement Learning (DRL) controllers have demonstrated promising results on various challenging non-linear control tasks. While a model-free DRL algorithm can solve unknown dynamics and high-dimensional problems, it…

Robotics · Computer Science 2022-03-03 Zikang Xiong , Joe Eappen , Ahmed H. Qureshi , Suresh Jagannathan

We develop an optimization-free framework for safe stabilization of single-input control-affine nonlinear systems with a given control Lyapunov function (CLF) and a given control barrier function (CBF), where the desired equilibrium lies in…

Systems and Control · Electrical Eng. & Systems 2026-03-25 Bo Wang , Miroslav Krstic

Safety critical systems involve the tight coupling between potentially conflicting control objectives and safety constraints. As a means of creating a formal framework for controlling systems of this form, and with a view toward automotive…

Optimization and Control · Mathematics 2018-02-27 Aaron D. Ames , Xiangru Xu , Jessy W. Grizzle , Paulo Tabuada

Modern nonlinear control theory seeks to endow systems with properties of stability and safety, and have been deployed successfully in multiple domains. Despite this success, model uncertainty remains a significant challenge in synthesizing…

Systems and Control · Electrical Eng. & Systems 2019-12-24 Andrew Taylor , Andrew Singletary , Yisong Yue , Aaron Ames

This paper presents a constraint-lifting control framework for designing stabilizing controllers that guarantee the forward invariance of a prescribed safe set. State-of-the-art safety-enforcing methods, such as control barrier functions…

Optimization and Control · Mathematics 2026-04-29 Jhon Manuel Portella Delgado , Ankit Goel

Safety is a fundamental requirement for autonomous systems operating in critical domains. Control barrier functions (CBFs) have been used to design safety filters that minimally alter nominal controls for such systems to maintain their…

Artificial Intelligence · Computer Science 2025-10-27 Yuxuan Yang , Hussein Sibai

Soft robotic manipulators offer operational advantage due to their compliant and deformable structures. However, their inherently nonlinear dynamics presents substantial challenges. Traditional analytical methods often depend on simplifying…

Robotics · Computer Science 2024-10-28 Uljad Berdica , Matthew Jackson , Niccolò Enrico Veronese , Jakob Foerster , Perla Maiolino

Safe reinforcement learning (RL) typically asks $\textit{what}$ an agent should do. We ask $\textit{when}$ it needs to act, and show that a single policy can jointly learn control inputs and communication-efficient timing decisions under a…

Machine Learning · Computer Science 2026-05-14 Adam Haroon , Erick J. Rodríguez-Seda , Cody Fleming , Tristan Schuler

Learning-based control with safety guarantees usually requires real-time safety certification and modifications of possibly unsafe learning-based policies. The control barrier function (CBF) method uses a safety filter containing a…

Systems and Control · Electrical Eng. & Systems 2024-10-25 Kanghui He , Shengling Shi , Ton van den Boom , Bart De Schutter

Reinforcement learning (RL) has achieved remarkable success in various robotic tasks; however, its deployment in real-world scenarios, particularly in contact-rich environments, often overlooks critical safety and stability aspects.…

Robotics · Computer Science 2025-06-13 Heng Zhang , Gokhan Solak , Sebastian Hjorth , Arash Ajoudani

We propose a simple, practical and intuitive approach to improve the performance of a conventional controller in uncertain environments using deep reinforcement learning while maintaining safe operation. Our approach is motivated by the…

Systems and Control · Electrical Eng. & Systems 2021-10-07 Tom Staessens , Tom Lefebvre , Guillaume Crevecoeur

Deep learning has enjoyed much recent success, and applying state-of-the-art model learning methods to controls is an exciting prospect. However, there is a strong reluctance to use these methods on safety-critical systems, which have…

Systems and Control · Electrical Eng. & Systems 2021-07-06 David D. Fan , Jennifer Nguyen , Rohan Thakker , Nikhilesh Alatur , Ali-akbar Agha-mohammadi , Evangelos A. Theodorou

We present a safety-critical controller for the problem of stabilization for force-controlled nonholonomic mobile robots. The proposed control law is based on the constructions of control Lyapunov functions (CLFs) and control barrier…

Systems and Control · Electrical Eng. & Systems 2024-12-04 Tianyu Han , Bo Wang

Constrained reinforcement learning (CRL) has gained significant interest recently, since safety constraints satisfaction is critical for real-world problems. However, existing CRL methods constraining discounted cumulative costs generally…

Machine Learning · Computer Science 2022-06-08 Dongjie Yu , Haitong Ma , Shengbo Eben Li , Jianyu Chen