English
Related papers

Related papers: Learning Vision-Based Neural Network Controllers w…

200 papers

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

Learning-enabled control systems have demonstrated impressive empirical performance on challenging control problems in robotics, but this performance comes at the cost of reduced transparency and lack of guarantees on the safety or…

Robotics · Computer Science 2022-12-21 Charles Dawson , Sicun Gao , Chuchu Fan

The increased reliance of self-driving vehicles on neural networks opens up the challenge of their verification. In this paper we present an experience report, describing a case study which we undertook to explore the design and training of…

Logic in Computer Science · Computer Science 2024-11-22 Syed Ali Asadullah Bukhari , Thomas Flinkow , Medet Inkarbekov , Barak A. Pearlmutter , Rosemary Monahan

Providing safety guarantees for autonomous systems is difficult as these systems operate in complex environments that require the use of learning-enabled components, such as deep neural networks (DNNs) for visual perception. DNNs are hard…

Artificial Intelligence · Computer Science 2023-05-31 Corina Pasareanu , Ravi Mangal , Divya Gopinath , Huafeng Yu

Neural Networks are being integrated into safety critical systems, e.g., perception systems for autonomous vehicles, which require trained networks to perform safely in novel scenarios. It is challenging to verify neural networks because…

Machine Learning · Computer Science 2019-12-23 Molly O'Brien , William Goble , Greg Hager , Julia Bukowski

In the current control design of safety-critical autonomous systems, formal verification techniques are typically applied after the controller is designed to evaluate whether the required properties (e.g., safety) are satisfied. However,…

Systems and Control · Electrical Eng. & Systems 2021-06-08 Yixuan Wang , Chao Huang , Zhaoran Wang , Zhilu Wang , Qi Zhu

With the increasing prevalence of complex vision-based sensing methods for use in obstacle identification and state estimation, characterizing environment-dependent measurement errors has become a difficult and essential part of modern…

Neural networks are increasingly applied to support decision making in safety-critical applications (like autonomous cars, unmanned aerial vehicles and face recognition based authentication). While many impressive static verification…

Machine Learning · Computer Science 2021-05-07 Guoliang Dong , Jun Sun , Jingyi Wang , Xinyu Wang , Ting Dai

Uncertainty in decision-making is crucial in the machine learning model used for a safety-critical system that operates in the real world. Therefore, it is important to handle uncertainty in a graceful manner for the safe operation of the…

Machine Learning · Computer Science 2023-03-16 Akash Fogla , Kanish Kumar , Sunnay Saurav , Bishnu ramanujan

With the increasing need for safe control in the domain of autonomous driving, model-based safety-critical control approaches are widely used, especially Control Barrier Function (CBF)-based approaches. Among them, Exponential CBF (eCBF) is…

Robotics · Computer Science 2022-05-10 Spencer Van Koevering , Yiwei Lyu , Wenhao Luo , John Dolan

Quantifying the robustness of neural networks or verifying their safety properties against input uncertainties or adversarial attacks have become an important research area in learning-enabled systems. Most results concentrate around the…

Systems and Control · Electrical Eng. & Systems 2019-10-11 Mahyar Fazlyab , Manfred Morari , George J. Pappas

Recent advances in machine learning technologies and sensing have paved the way for the belief that safe, accessible, and convenient autonomous vehicles may be realized in the near future. Despite tremendous advances within this context,…

Precise and comprehensive situational awareness is a critical capability of modern autonomous systems. Deep neural networks that perceive task-critical details from rich sensory signals have become ubiquitous; however, their black-box…

Systems and Control · Electrical Eng. & Systems 2025-08-21 Jordan Peper , Yan Miao , Sayan Mitra , Ivan Ruchkin

This tutorial paper focuses on safe physics-informed machine learning in the context of dynamics and control, providing a comprehensive overview of how to integrate physical models and safety guarantees. As machine learning techniques…

Systems and Control · Electrical Eng. & Systems 2025-06-16 Jan Drgona , Truong X. Nghiem , Thomas Beckers , Mahyar Fazlyab , Enrique Mallada , Colin Jones , Draguna Vrabie , Steven L. Brunton , Rolf Findeisen

Machine learning has made remarkable advancements, but confidently utilising learning-enabled components in safety-critical domains still poses challenges. Among the challenges, it is known that a rigorous, yet practical, way of achieving…

Machine Learning · Computer Science 2024-09-21 Saddek Bensalem , Chih-Hong Cheng , Wei Huang , Xiaowei Huang , Changshun Wu , Xingyu Zhao

Semantic segmentation networks (SSNs) are central to safety-critical applications such as medical imaging and autonomous driving, where robustness under uncertainty is essential. However, existing probabilistic verification methods often…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Navid Hashemi , Samuel Sasaki , Diego Manzanas Lopez , Lars Lindemann , Ipek Oguz , Meiyi Ma , Taylor T. Johnson

Neural networks (NNs) are increasingly applied in safety-critical systems such as autonomous vehicles. However, they are fragile and are often ill-behaved. Consequently, their behaviors should undergo rigorous guarantees before deployment…

Artificial Intelligence · Computer Science 2022-10-11 Zhen Liang , Dejin Ren , Wanwei Liu , Ji Wang , Wenjing Yang , Bai Xue

Neural certificates have emerged as a powerful tool in cyber-physical systems control, providing witnesses of correctness. These certificates, such as barrier functions, often learned alongside control policies, once verified, serve as…

Symbolic Computation · Computer Science 2025-07-17 Thomas A. Henzinger , Konstantin Kueffner , Emily Yu

We are motivated by the problem of performing failure prediction for safety-critical robotic systems with high-dimensional sensor observations (e.g., vision). Given access to a black-box control policy (e.g., in the form of a neural…

Robotics · Computer Science 2022-05-09 Alec Farid , David Snyder , Allen Z. Ren , Anirudha Majumdar

Over the past decade, machine learning has demonstrated impressive results, often surpassing human capabilities in sensing tasks relevant to autonomous flight. Unlike traditional aerospace software, the parameters of machine learning models…

Machine Learning · Computer Science 2023-10-06 Jean-Guillaume Durand , Arthur Dubois , Robert J. Moss