English
Related papers

Related papers: Provably Safe Neural Network Controllers via Diffe…

200 papers

In this paper, we consider the problem of formally verifying a Neural Network (NN) based autonomous landing system. In such a system, a NN controller processes images from a camera to guide the aircraft while approaching the runway. A…

Machine Learning · Computer Science 2022-03-31 Ulices Santa Cruz , Yasser Shoukry

To create usable and deployable Artificial Intelligence (AI) systems, there requires a level of assurance in performance under many different conditions. Many times, deployed machine learning systems will require more classic logic and…

Artificial Intelligence · Computer Science 2025-02-14 Luke E. Richards , Jessie Yaros , Jasen Babcock , Coung Ly , Robin Cosbey , Timothy Doster , Cynthia Matuszek

Machine learning techniques often lack formal correctness guarantees, evidenced by the widespread adversarial examples that plague most deep-learning applications. This lack of formal guarantees resulted in several research efforts that aim…

Machine Learning · Computer Science 2024-06-11 Anahita Baninajjar , Ahmed Rezine , Amir Aminifar

Neural networks serve as effective controllers in a variety of complex settings due to their ability to represent expressive policies. The complex nature of neural networks, however, makes their output difficult to verify and predict, which…

Artificial Intelligence · Computer Science 2021-10-22 Sydney M. Katz , Kyle D. Julian , Christopher A. Strong , Mykel J. Kochenderfer

A common problem when using model predictive control (MPC) in practice is the satisfaction of safety specifications beyond the prediction horizon. While theoretical works have shown that safety can be guaranteed by enforcing a suitable…

Robotics · Computer Science 2025-07-09 Ji Yin , Oswin So , Eric Yang Yu , Chuchu Fan , Panagiotis Tsiotras

Modern software systems rely on Deep Neural Networks (DNN) when processing complex, unstructured inputs, such as images, videos, natural language texts or audio signals. Provided the intractably large size of such input spaces, the…

Software Engineering · Computer Science 2021-02-03 Michael Weiss , Paolo Tonella

Neural network (NN) controllers achieve strong empirical performance on nonlinear dynamical systems, yet deploying them in safety-critical settings requires robustness to disturbances and uncertainty. We present a method for jointly…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Neelay Junnarkar , Yasin Sonmez , Murat Arcak

The last decade has witnessed significant attention on networked control systems (NCS) due to their ubiquitous presence in industrial applications, and, in the particular case of wireless NCS, because of their architectural flexibility and…

Optimization and Control · Mathematics 2016-11-22 Majid Zamani , Manuel Mazo , Mahmoud Khaled , Alessandro Abate

Neural network controllers have shown potential in achieving superior performance in feedback control systems. Although a neural network can be trained efficiently using deep and reinforcement learning methods, providing formal guarantees…

Optimization and Control · Mathematics 2024-01-10 Han Wang , Zuxun Xiong , Liqun Zhao , Antonis Papachristodoulou

Deep neural networks (DNNs) have become one of the enabling technologies in many safety-critical applications, e.g., autonomous driving and medical image analysis. DNN systems, however, suffer from various kinds of threats, such as…

Machine Learning · Computer Science 2020-10-19 Yu Li , Min Li , Bo Luo , Ye Tian , Qiang Xu

Neural networks (NNs) are increasingly applied in safety-critical systems such as autonomous vehicles. However, they are fragile and are often ill-behaved. Consequently, their behaviors should undergo rigorous guarantees before deployment…

Artificial Intelligence · Computer Science 2022-10-11 Zhen Liang , Dejin Ren , Wanwei Liu , Ji Wang , Wenjing Yang , Bai Xue

Deep neural networks (DNNs) are increasingly being employed in safety-critical systems, and there is an urgent need to guarantee their correctness. Consequently, the verification community has devised multiple techniques and tools for…

Logic in Computer Science · Computer Science 2022-08-30 Omri Isac , Clark Barrett , Min Zhang , Guy Katz

Neural Networks (NNs) can provide major empirical performance improvements for robotic systems, but they also introduce challenges in formally analyzing those systems' safety properties. In particular, this work focuses on estimating the…

Systems and Control · Electrical Eng. & Systems 2021-05-26 Michael Everett , Golnaz Habibi , Jonathan P. How

Neural networks (NNs) are increasingly applied in safety-critical systems such as autonomous vehicles. However, they are fragile and are often ill-behaved. Consequently, their behaviors should undergo rigorous guarantees before deployment…

Machine Learning · Computer Science 2023-06-28 Zhen Liang , Dejin Ren , Bai Xue , Ji Wang , Wenjing Yang , Wanwei Liu

In the rapidly evolving landscape of communication and network security, the increasing reliance on deep neural networks (DNNs) and cloud services for data processing presents a significant vulnerability: the potential for backdoors that…

Cryptography and Security · Computer Science 2024-03-14 Khondoker Murad Hossain , Tim Oates

Neural networks have emerged as essential components in safety-critical applications -- these use cases demand complex, yet trustworthy computations. Binarized Neural Networks (BNNs) are a type of neural network where each neuron is…

Machine Learning · Computer Science 2025-07-08 Jiong Yang , Yong Kiam Tan , Mate Soos , Magnus O. Myreen , Kuldeep S. Meel

Providing safety guarantees for autonomous systems is difficult as these systems operate in complex environments that require the use of learning-enabled components, such as deep neural networks (DNNs) for visual perception. DNNs are hard…

Artificial Intelligence · Computer Science 2023-05-31 Corina Pasareanu , Ravi Mangal , Divya Gopinath , Huafeng Yu

Neuro-Symbolic Artificial Intelligence (NeSy AI) has emerged as a promising direction for integrating neural learning with symbolic reasoning. Typically, in the probabilistic variant of such systems, a neural network first extracts a set of…

Neural ODEs (NODEs) are continuous-time neural networks (NNs) that can process data without the limitation of time intervals. They have advantages in learning and understanding the evolution of complex real dynamics. Many previous works…

Machine Learning · Computer Science 2024-11-05 Wenjie Mei , Dongzhe Zheng , Shihua Li

Neural network (NN) interatomic potentials provide fast prediction of potential energy surfaces, closely matching the accuracy of the electronic structure methods used to produce the training data. However, NN predictions are only reliable…

Machine Learning · Computer Science 2021-08-31 Daniel Schwalbe-Koda , Aik Rui Tan , Rafael Gómez-Bombarelli