English
Related papers

Related papers: Guaranteeing Safety for Neural Network-Based Aircr…

200 papers

Neural networks have achieved state-of-the-art performance in solving many problems, including many applications in safety/security-critical systems. Researchers also discovered multiple security issues associated with neural networks. One…

Cryptography and Security · Computer Science 2022-05-17 Long H. Pham , Jun Sun

Obstacle avoidance for small unmanned aircraft is vital for the safety of future urban air mobility (UAM) and Unmanned Aircraft System (UAS) Traffic Management (UTM). There are many techniques for real-time robust drone guidance, but many…

Robotics · Computer Science 2021-11-16 Jueming Hu , Xuxi Yang , Weichang Wang , Peng Wei , Lei Ying , Yongming Liu

In this paper, we consider the problem of training neural network (NN) controllers for nonlinear dynamical systems that are guaranteed to satisfy safety and liveness (e.g., reach-avoid) properties. Our approach is to combine model-based…

Systems and Control · Electrical Eng. & Systems 2021-09-07 Xiaowu Sun , Yasser Shoukry

This paper presents an approach to deal with safety of dynamical systems in presence of multiple non-convex unsafe sets. While optimal control and model predictive control strategies can be employed in these scenarios, they suffer from high…

Systems and Control · Electrical Eng. & Systems 2021-06-14 Gennaro Notomista , Matteo Saveriano

Convolutional Neural Networks (CNN) for object detection, lane detection, and segmentation now sit at the head of most autonomy pipelines, and yet, their safety analysis remains an important challenge. Formal analysis of perception models…

Robotics · Computer Science 2023-09-13 Chiao Hsieh , Keyur Joshi , Sasa Misailovic , Sayan Mitra

The proliferation of unmanned aircraft systems (UAS) has caused airspace regulation authorities to examine the interoperability of these aircraft with collision avoidance systems initially designed for large transport category aircraft.…

Artificial Intelligence · Computer Science 2022-12-05 Cooper Cone , Michael Owen , Luis Alvarez , Marc Brittain

Providing safety guarantees for autonomous systems is difficult as these systems operate in complex environments that require the use of learning-enabled components, such as deep neural networks (DNNs) for visual perception. DNNs are hard…

Artificial Intelligence · Computer Science 2023-05-31 Corina Pasareanu , Ravi Mangal , Divya Gopinath , Huafeng Yu

The problem of probabilistic verification of a neural network investigates the probability of satisfying the safe constraints in the output space when the input is given by a probability distribution. It is significant to answer this…

Artificial Intelligence · Computer Science 2026-04-24 Jingyang Li , Xin Chen , Hongfei Fu , Guoqiang Li

Safety for control systems is often posed as an invariance constraint; the system is said to be safe if state trajectories avoid some unsafe region of the statespace for all time. An assured controller is one that enforces safety online by…

Systems and Control · Electrical Eng. & Systems 2020-08-18 Matthew Abate , Samuel Coogan

This paper presents an optimisation-based approach for an obstacle avoidance problem within an autonomous vehicle racing context. Our control regime leverages online reachability analysis and sensor data to compute the maximal safe…

Multiagent Systems · Computer Science 2023-11-17 Sergiy Bogomolov , Taylor T. Johnson , Diego Manzanas Lopez , Patrick Musau , Paulius Stankaitis

Due to significant improvements in performance in recent years, neural networks are currently used for an ever-increasing number of applications. However, neural networks have the drawback that their decisions are not readily interpretable…

Cryptography and Security · Computer Science 2020-05-15 Christian Berghoff

As neural networks (NNs) become increasingly prevalent in safety-critical neural network-controlled cyber-physical systems (NNCSs), formally guaranteeing their safety becomes crucial. For these systems, safety must be ensured throughout…

Systems and Control · Electrical Eng. & Systems 2025-07-31 Samuel Teuber , Debasmita Lohar , Bernhard Beckert

When designing controllers for safety-critical systems, practitioners often face a challenging tradeoff between robustness and performance. While robust control methods provide rigorous guarantees on system stability under certain…

Machine Learning · Computer Science 2021-04-27 Priya L. Donti , Melrose Roderick , Mahyar Fazlyab , J. Zico Kolter

Safety and stability are common requirements for robotic control systems; however, designing safe, stable controllers remains difficult for nonlinear and uncertain models. We develop a model-based learning approach to synthesize robust…

Systems and Control · Electrical Eng. & Systems 2021-10-08 Charles Dawson , Zengyi Qin , Sicun Gao , Chuchu Fan

Neural network controllers (NNCs) have shown great promise in autonomous and cyber-physical systems. Despite the various verification approaches for neural networks, the safety analysis of NNCs remains an open problem. Existing verification…

Machine Learning · Computer Science 2023-01-31 Chi Zhang , Wenjie Ruan , Peipei Xu

We study the problem of learning controllers for discrete-time non-linear stochastic dynamical systems with formal reach-avoid guarantees. This work presents the first method for providing formal reach-avoid guarantees, which combine and…

Machine Learning · Computer Science 2022-11-30 Đorđe Žikelić , Mathias Lechner , Thomas A. Henzinger , Krishnendu Chatterjee

This paper presents the Neural Network Verification (NNV) software tool, a set-based verification framework for deep neural networks (DNNs) and learning-enabled cyber-physical systems (CPS). The crux of NNV is a collection of reachability…

Systems and Control · Electrical Eng. & Systems 2020-04-14 Hoang-Dung Tran , Xiaodong Yang , Diego Manzanas Lopez , Patrick Musau , Luan Viet Nguyen , Weiming Xiang , Stanley Bak , Taylor T. Johnson

To use neural networks in safety-critical settings it is paramount to provide assurances on their runtime operation. Recent work on ReLU networks has sought to verify whether inputs belonging to a bounded box can ever yield some undesirable…

Machine Learning · Computer Science 2021-06-22 Vicenc Rubies-Royo , Roberto Calandra , Dusan M. Stipanovic , Claire Tomlin

Intercepting dynamic objects in uncertain environments involves a significant unresolved challenge in modern robotic systems. Current control approaches rely solely on estimated information, and results lack guarantees of robustness and…

Robotics · Computer Science 2025-12-16 Tommaso Faraci , Roberto Lampariello

The safety of autonomous vehicles (AVs) depends on their ability to perform complex computations on high-volume sensor data in a timely manner. Their ability to run these computations with state-of-the-art models is limited by the…

Robotics · Computer Science 2023-08-08 Peter Schafhalter , Sukrit Kalra , Le Xu , Joseph E. Gonzalez , Ion Stoica