English
Related papers

Related papers: Reachability Analysis for Feed-Forward Neural Netw…

200 papers

There has been an increasing interest in using neural networks in closed-loop control systems to improve performance and reduce computational costs for on-line implementation. However, providing safety and stability guarantees for these…

Systems and Control · Electrical Eng. & Systems 2020-04-20 Haimin Hu , Mahyar Fazlyab , Manfred Morari , George J. Pappas

The vulnerability of artificial intelligence (AI) and machine learning (ML) against adversarial disturbances and attacks significantly restricts their applicability in safety-critical systems including cyber-physical systems (CPS) equipped…

Systems and Control · Electrical Eng. & Systems 2020-04-28 Weiming Xiang , Hoang-Dung Tran , Xiaodong Yang , Taylor T. Johnson

Neural networks are a convenient way to automatically fit functions that are too complex to be described by hand. The downside of this approach is that it leads to build a black-box without understanding what happened inside. Finding the…

Machine Learning · Computer Science 2022-08-29 Théo Nancy , Vassili Maillet , Johann Barbier

Neural networks (NNs) have been shown to learn complex control laws successfully, often with performance advantages or decreased computational cost compared to alternative methods. Neural network controllers (NNCs) are, however, highly…

Systems and Control · Electrical Eng. & Systems 2023-09-08 Oliver Gates , Matthew Newton , Konstantinos Gatsis

Deep neural networks have emerged as a widely used and effective means for tackling complex, real-world problems. However, a major obstacle in applying them to safety-critical systems is the great difficulty in providing formal guarantees…

Artificial Intelligence · Computer Science 2017-05-22 Guy Katz , Clark Barrett , David Dill , Kyle Julian , Mykel Kochenderfer

Universal approximation theory offers a foundational framework to verify neural network expressiveness, enabling principled utilization in real-world applications. However, most existing theoretical constructions are established by…

Machine Learning · Computer Science 2026-01-27 ZeYu Li , ShiJun Zhang , TieYong Zeng , FengLei Fan

This paper presents a new reachability analysis approach to compute interval over-approximations of the output set of feedforward neural networks with input uncertainty. We adapt to neural networks an existing mixed-monotonicity method for…

Systems and Control · Electrical Eng. & Systems 2022-06-24 Pierre-Jean Meyer

Among the several paradigms of artificial intelligence (AI) or machine learning (ML), a remarkably successful paradigm is deep learning. Deep learning's phenomenal success has been hoped to be interpreted via fundamental research on the…

Machine Learning · Computer Science 2021-11-29 Tilahun M. Getu

We present a novel approach to efficiently compute tight non-convex enclosures of the image through neural networks with ReLU, sigmoid, or hyperbolic tangent activation functions. In particular, we abstract the input-output relation of each…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Niklas Kochdumper , Christian Schilling , Matthias Althoff , Stanley Bak

As neural networks (NNs) become more prevalent in safety-critical applications such as control of vehicles, there is a growing need to certify that systems with NN components are safe. This paper presents a set of backward reachability…

Systems and Control · Electrical Eng. & Systems 2022-11-22 Nicholas Rober , Sydney M. Katz , Chelsea Sidrane , Esen Yel , Michael Everett , Mykel J. Kochenderfer , Jonathan P. How

Applying neural networks as controllers in dynamical systems has shown great promises. However, it is critical yet challenging to verify the safety of such control systems with neural-network controllers in the loop. Previous methods for…

Systems and Control · Electrical Eng. & Systems 2019-06-26 Chao Huang , Jiameng Fan , Wenchao Li , Xin Chen , Qi Zhu

The increasing prevalence of neural networks (NNs) in safety-critical applications calls for methods to certify their behavior and guarantee safety. This paper presents a backward reachability approach for safety verification of neural…

Systems and Control · Electrical Eng. & Systems 2022-11-22 Nicholas Rober , Michael Everett , Jonathan P. How

Face Anti-Spoofing (FAS) is significant for the security of face recognition systems. Convolutional Neural Networks (CNNs) have been introduced to the field of the FAS and have achieved competitive performance. However, CNN-based methods…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Rizhao Cai , Changsheng Chen

We explore the phase diagram of approximation rates for deep neural networks and prove several new theoretical results. In particular, we generalize the existing result on the existence of deep discontinuous phase in ReLU networks to…

Neural and Evolutionary Computing · Computer Science 2021-01-07 Dmitry Yarotsky , Anton Zhevnerchuk

A control system consists of a plant component and a controller which periodically computes a control input for the plant. We consider systems where the controller is implemented by a feedforward neural network with ReLU activations. The…

Machine Learning · Computer Science 2024-12-10 Christian Schilling , Martin Zimmermann

Safety is a critical concern for the next generation of autonomy that is likely to rely heavily on deep neural networks for perception and control. Formally verifying the safety and robustness of well-trained DNNs and learning-enabled…

Machine Learning · Computer Science 2021-08-10 Xiaodong Yang , Tom Yamaguchi , Hoang-Dung Tran , Bardh Hoxha , Taylor T Johnson , Danil Prokhorov

This paper presents a specification-guided safety verification method for feedforward neural networks with general activation functions. As such feedforward networks are memoryless, they can be abstractly represented as mathematical…

Machine Learning · Computer Science 2018-12-18 Weiming Xiang , Hoang-Dung Tran , Taylor T. Johnson

Deep neural networks are an attractive tool for compressing the control policy lookup tables in systems such as the Airborne Collision Avoidance System (ACAS). It is vital to ensure the safety of such neural controllers via verification…

Machine Learning · Computer Science 2021-08-19 Kai Jia , Martin Rinard

Neural networks (NNs) are increasingly applied in safety-critical systems such as autonomous vehicles. However, they are fragile and are often ill-behaved. Consequently, their behaviors should undergo rigorous guarantees before deployment…

Artificial Intelligence · Computer Science 2022-10-11 Zhen Liang , Dejin Ren , Wanwei Liu , Ji Wang , Wenjing Yang , Bai Xue

In studying the expressiveness of neural networks, an important question is whether there are functions which can only be approximated by sufficiently deep networks, assuming their size is bounded. However, for constant depths, existing…

Machine Learning · Computer Science 2020-12-29 Gal Vardi , Ohad Shamir