English
Related papers

Related papers: On exploration requirements for learning safety co…

200 papers

While learning-based control techniques often outperform classical controller designs, safety requirements limit the acceptance of such methods in many applications. Recent developments address this issue through so-called predictive safety…

Systems and Control · Electrical Eng. & Systems 2022-05-16 Kim P. Wabersich , Melanie N. Zeilinger

Regardless of the particular task we want them to perform in an environment, there are often shared safety constraints we want our agents to respect. For example, regardless of whether it is making a sandwich or clearing the table, a…

Machine Learning · Computer Science 2023-09-06 Konwoo Kim , Gokul Swamy , Zuxin Liu , Ding Zhao , Sanjiban Choudhury , Zhiwei Steven Wu

We address the problem of safely learning controlled stochastic dynamics from discrete-time trajectory observations, ensuring system trajectories remain within predefined safe regions during both training and deployment. Safety-critical…

Machine Learning · Statistics 2026-02-03 Luc Brogat-Motte , Alessandro Rudi , Riccardo Bonalli

We study the constrained linear quadratic regulator with unknown dynamics, addressing the tension between safety and exploration in data-driven control techniques. We present a framework which allows for system identification through…

Optimization and Control · Mathematics 2019-07-09 Sarah Dean , Stephen Tu , Nikolai Matni , Benjamin Recht

The transfer of reinforcement learning (RL) techniques into real-world applications is challenged by safety requirements in the presence of physical limitations. Most RL methods, in particular the most popular algorithms, do not support…

Systems and Control · Computer Science 2021-05-18 Kim P. Wabersich , Melanie N. Zeilinger

While reinforcement learning algorithms have had great success in the field of autonomous navigation, they cannot be straightforwardly applied to the real autonomous systems without considering the safety constraints. The later are crucial…

Robotics · Computer Science 2023-07-28 Brian Angulo , Gregory Gorbov , Aleksandr Panov , Konstantin Yakovlev

Safety and tracking stability are crucial for safety-critical systems such as self-driving cars, autonomous mobile robots, industrial manipulators. To efficiently control safety-critical systems to ensure their safety and achieve tracking…

Robotics · Computer Science 2020-09-22 Lei Zheng , Jiesen Pan , Rui Yang , Hui Cheng , Haifeng Hu

We propose to leverage epistemic uncertainty about constraint satisfaction of a reinforcement learner in safety critical domains. We introduce a framework for specification of requirements for reinforcement learners in constrained settings,…

Artificial Intelligence · Computer Science 2021-02-09 Lenz Belzner , Martin Wirsing

This paper addresses the challenge of integrating explicit hard constraints into the control barrier function (CBF) framework for ensuring safety in autonomous systems, including robots. We propose a novel data-driven method to derive CBFs…

Robotics · Computer Science 2023-12-14 Jaemin Lee , Jeeseop Kim , Aaron D. Ames

The ability to learn and execute optimal control policies safely is critical to realization of complex autonomy, especially where task restarts are not available and/or the systems are safety-critical. Safety requirements are often…

Systems and Control · Electrical Eng. & Systems 2021-10-06 S M Nahid Mahmud , Moad Abudia , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

The design of tracking controllers that closely follow a reference trajectory while ensuring safety and robustness against disturbances is a challenging problem in the control of autonomous systems. In this work, we propose a neural…

Systems and Control · Electrical Eng. & Systems 2025-12-01 Yuezhu Xu , Mohamed Serry , Jun Liu , S. Sivaranjani

Safety is a fundamental requirement for autonomous systems operating in critical domains. Control barrier functions (CBFs) have been used to design safety filters that minimally alter nominal controls for such systems to maintain their…

Artificial Intelligence · Computer Science 2025-10-27 Yuxuan Yang , Hussein Sibai

This paper addresses a fundamental and important question in control: under what conditions does there fail to exist a robust control policy that keeps the state of a constrained linear system within a target set, despite bounded…

Systems and Control · Electrical Eng. & Systems 2025-07-08 Paul Trodden , José M. Maestre , Hideaki Ishii

This tutorial paper focuses on safe physics-informed machine learning in the context of dynamics and control, providing a comprehensive overview of how to integrate physical models and safety guarantees. As machine learning techniques…

Systems and Control · Electrical Eng. & Systems 2025-06-16 Jan Drgona , Truong X. Nghiem , Thomas Beckers , Mahyar Fazlyab , Enrique Mallada , Colin Jones , Draguna Vrabie , Steven L. Brunton , Rolf Findeisen

Safety is critical when applying reinforcement learning (RL) to real-world problems. As a result, safe RL has emerged as a fundamental and powerful paradigm for optimizing an agent's policy while incorporating notions of safety. A prevalent…

Machine Learning · Computer Science 2024-05-09 Akifumi Wachi , Xun Shen , Yanan Sui

We study the problem of safe learning and exploration in sequential control problems. The goal is to safely collect data samples from operating in an environment, in order to learn to achieve a challenging control goal (e.g., an agile…

Machine Learning · Computer Science 2020-06-30 Anqi Liu , Guanya Shi , Soon-Jo Chung , Anima Anandkumar , Yisong Yue

Most recent software related accidents have been system accidents. To validate the absence of system hazards concerning dysfunctional interactions, industrials call for approaches of modeling system safety requirements and interaction…

Software Engineering · Computer Science 2016-11-17 Zhe Chen , Gilles Motet

This work quantifies the safety of trajectories of a dynamical system by the perturbation intensity required to render a system unsafe (crash into the unsafe set). Computation of this measure of safety is posed as a peak-minimizing optimal…

Optimization and Control · Mathematics 2024-10-02 Jared Miller , Mario Sznaier

As autonomous systems become more complex and integral in our society, the need to accurately model and safely control these systems has increased significantly. In the past decade, there has been tremendous success in using deep learning…

Robotics · Computer Science 2024-09-10 Hao Wang , Javier Borquez , Somil Bansal

Model-based reinforcement learning (RL) has emerged as a promising tool for developing controllers for real world systems (e.g., robotics, autonomous driving, etc.). However, real systems often have constraints imposed on their state space…

Machine Learning · Computer Science 2020-10-22 Akshita Gupta , Inseok Hwang