English
Related papers

Related papers: Verified Safe Reinforcement Learning for Neural Ne…

200 papers

Inverter-based distributed energy resources provide the possibility for fast time-scale voltage control by quickly adjusting their reactive power. The power-electronic interfaces allow these resources to realize almost arbitrary control…

Systems and Control · Electrical Eng. & Systems 2021-10-05 Wenqi Cui , Jiayi Li , Baosen Zhang

Understanding how to efficiently learn while adhering to safety constraints is essential for using online reinforcement learning in practical applications. However, proving rigorous regret bounds for safety-constrained reinforcement…

Machine Learning · Statistics 2025-04-29 Benjamin Schiffer , Lucas Janson

Adversarial examples pose a security threat to many critical systems built on neural networks (such as face recognition systems, and self-driving cars). While many methods have been proposed to build robust models, how to build certifiably…

Machine Learning · Computer Science 2023-09-06 Ruihan Zhang , Peixin Zhang , Jun Sun

Reinforcement learning (RL) has been successfully applied to a variety of robotics applications, where it outperforms classical methods. However, the safety aspect of RL and the transfer to the real world remain an open challenge. A…

Robotics · Computer Science 2025-04-21 Murad Dawood , Ahmed Shokry , Maren Bennewitz

Safety and stability are common requirements for robotic control systems; however, designing safe, stable controllers remains difficult for nonlinear and uncertain models. We develop a model-based learning approach to synthesize robust…

Systems and Control · Electrical Eng. & Systems 2021-10-08 Charles Dawson , Zengyi Qin , Sicun Gao , Chuchu Fan

Reinforcement Learning (RL) has achieved tremendous success in many complex decision-making tasks. However, safety concerns are raised during deploying RL in real-world applications, leading to a growing demand for safe RL algorithms, such…

Artificial Intelligence · Computer Science 2024-05-28 Shangding Gu , Long Yang , Yali Du , Guang Chen , Florian Walter , Jun Wang , Alois Knoll

Safe deployment of autonomous robots in diverse scenarios requires agents that are capable of efficiently adapting to new environments while satisfying constraints. In this work, we propose a practical and theoretically-justified approach…

Robotics · Computer Science 2022-02-17 Thomas Lew , Apoorva Sharma , James Harrison , Andrew Bylard , Marco Pavone

We introduce a novel learning-based approach to synthesize safe and robust controllers for autonomous Cyber-Physical Systems and, at the same time, to generate challenging tests. This procedure combines formal methods for model verification…

Systems and Control · Electrical Eng. & Systems 2021-03-29 Luca Bortolussi , Francesca Cairoli , Ginevra Carbone , Francesco Franchina , Enrico Regolin

Safety in reinforcement learning (RL) is a key property in both training and execution in many domains such as autonomous driving or finance. In this paper, we formalize it with a constrained RL formulation in the distributional RL setting.…

Machine Learning · Computer Science 2021-03-01 Jianyi Zhang , Paul Weng

In the evolving landscape of high-speed agile quadrotor flight, achieving precise trajectory tracking at the platform's operational limits is paramount. Controllers must handle actuator constraints, exhibit robustness to disturbances, and…

Robotics · Computer Science 2025-10-15 Lukas Pries , Markus Ryll

As autonomous systems become more complex and integral in our society, the need to accurately model and safely control these systems has increased significantly. In the past decade, there has been tremendous success in using deep learning…

Robotics · Computer Science 2024-09-10 Hao Wang , Javier Borquez , Somil Bansal

Reinforcement learning has been established over the past decade as an effective tool to find optimal control policies for dynamical systems, with recent focus on approaches that guarantee safety during the learning and/or execution phases.…

Systems and Control · Electrical Eng. & Systems 2021-10-06 S M Nahid Mahmud , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

In this paper, we solve the problem of finding a certified control policy that drives a robot from any given initial state and under any bounded disturbance to the desired reference trajectory, with guarantees on the convergence or bounds…

Robotics · Computer Science 2020-11-26 Dawei Sun , Susmit Jha , Chuchu Fan

A fundamental challenge in learning to control an unknown dynamical system is to reduce model uncertainty by making measurements while maintaining safety. In this work, we formulate a mathematical definition of what it means to safely learn…

Optimization and Control · Mathematics 2020-11-25 Amir Ali Ahmadi , Abraar Chaudhry , Vikas Sindhwani , Stephen Tu

Control design for general nonlinear robotic systems with guaranteed stability and/or safety in the presence of model uncertainties is a challenging problem. Recent efforts attempt to learn a controller and a certificate (e.g., a Lyapunov…

Systems and Control · Electrical Eng. & Systems 2025-06-05 Vivek Sharma , Pan Zhao , Naira Hovakimyan

Safety is a fundamental requirement of control systems. Control Barrier Functions (CBFs) are proposed to ensure the safety of the control system by constructing safety filters or synthesizing control inputs. However, the safety guarantee…

Robotics · Computer Science 2024-03-29 Manan Tayal , Hongchao Zhang , Pushpak Jagtap , Andrew Clark , Shishir Kolathaya

Reinforcement learning (RL) agents with pre-specified reward functions cannot provide guaranteed safety across variety of circumstances that an uncertain system might encounter. To guarantee performance while assuring satisfaction of safety…

Artificial Intelligence · Computer Science 2021-04-20 Aquib Mustafa , Majid Mazouchi , Subramanya Nageshrao , Hamidreza Modares

This work studies the design of safe control policies for large-scale non-linear systems operating in uncertain environments. In such a case, the robust control framework is a principled approach to safety that aims to maximize the…

Systems and Control · Computer Science 2019-03-04 Edouard Leurent , Yann Blanco , Denis Efimov , Odalric-Ambrym Maillard

The deployment of autonomous robots in safety-critical applications requires safety guarantees. Provably safe reinforcement learning is an active field of research that aims to provide such guarantees using safeguards. These safeguards…

Machine Learning · Computer Science 2026-05-08 Tim Walter , Hannah Markgraf , Jonathan Külz , Matthias Althoff

While neural networks (NNs) have potential as autonomous controllers for Cyber-Physical Systems, verifying the safety of NN based control systems (NNCSs) poses significant challenges for the practical use of NNs, especially when safety is…

Systems and Control · Electrical Eng. & Systems 2025-03-06 Samuel Teuber , Stefan Mitsch , André Platzer