English
Related papers

Related papers: Vertex-based reachability analysis for verifying R…

200 papers

We present a method for computing exact reachable sets for deep neural networks with rectified linear unit (ReLU) activation. Our method is well-suited for use in rigorous safety analysis of robotic perception and control systems with deep…

Robotics · Computer Science 2021-04-02 Joseph A. Vincent , Mac Schwager

Deep neural networks have been widely applied as an effective approach to handle complex and practical problems. However, one of the most fundamental open problems is the lack of formal methods to analyze the safety of their behaviors. To…

Artificial Intelligence · Computer Science 2020-03-04 Xiaodong Yang , Hoang-Dung Tran , Weiming Xiang , Taylor Johnson

Recently, formal verification of deep neural networks (DNNs) has garnered considerable attention, and over-approximation based methods have become popular due to their effectiveness and efficiency. However, these strategies face challenges…

Artificial Intelligence · Computer Science 2024-01-24 Zhen Liang , Taoran Wu , Ran Zhao , Bai Xue , Ji Wang , Wenjing Yang , Shaojun Deng , Wanwei Liu

Although neural networks (NNs) with ReLU activation functions have found success in a wide range of applications, their adoption in risk-sensitive settings has been limited by the concerns on robustness and interpretability. Previous works…

Machine Learning · Computer Science 2022-01-11 Shaojie Xu , Joel Vaughan , Jie Chen , Aijun Zhang , Agus Sudjianto

Deep neural networks have emerged as a widely used and effective means for tackling complex, real-world problems. However, a major obstacle in applying them to safety-critical systems is the great difficulty in providing formal guarantees…

Artificial Intelligence · Computer Science 2017-05-22 Guy Katz , Clark Barrett , David Dill , Kyle Julian , Mykel Kochenderfer

We study the reachability problem for systems implemented as feed-forward neural networks whose activation function is implemented via ReLU functions. We draw a correspondence between establishing whether some arbitrary output can ever be…

Artificial Intelligence · Computer Science 2017-06-23 Alessio Lomuscio , Lalit Maganti

Neural networks have been widely used to solve complex real-world problems. Due to the complicate, nonlinear, non-convex nature of neural networks, formal safety guarantees for the output behaviors of neural networks will be crucial for…

Machine Learning · Computer Science 2017-12-25 Weiming Xiang , Hoang-Dung Tran , Taylor T. Johnson

Over-approximating the reachable sets of dynamical systems is a fundamental problem in safety verification and robust control synthesis. The representation of these sets is a key factor that affects the computational complexity and the…

Systems and Control · Electrical Eng. & Systems 2023-05-17 Taha Entesari , Mahyar Fazlyab

Verification plays an essential role in the formal analysis of safety-critical systems. Most current verification methods have specific requirements when working on Deep Neural Networks (DNNs). They either target one particular network…

Machine Learning · Computer Science 2023-04-04 Chi Zhang , Wenjie Ruan , Fu Wang , Peipei Xu , Geyong Min , Xiaowei Huang

Neural networks have recently become popular for a wide variety of uses, but have seen limited application in safety-critical domains such as robotics near and around humans. This is because it remains an open challenge to train a neural…

Machine Learning · Computer Science 2021-07-19 Long Kiu Chung , Adam Dai , Derek Knowles , Shreyas Kousik , Grace X. Gao

We present a novel approach to efficiently compute tight non-convex enclosures of the image through neural networks with ReLU, sigmoid, or hyperbolic tangent activation functions. In particular, we abstract the input-output relation of each…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Niklas Kochdumper , Christian Schilling , Matthias Althoff , Stanley Bak

In this paper, we consider the computational complexity of formally verifying the behavior of Rectified Linear Unit (ReLU) Neural Networks (NNs), where verification entails determining whether the NN satisfies convex polytopic…

Machine Learning · Computer Science 2021-03-26 James Ferlez , Yasser Shoukry

Deep neural networks are widely used for nonlinear function approximation with applications ranging from computer vision to control. Although these networks involve the composition of simple arithmetic operations, it can be very challenging…

Machine Learning · Computer Science 2020-12-02 Changliu Liu , Tomer Arnon , Christopher Lazarus , Christopher Strong , Clark Barrett , Mykel J. Kochenderfer

Formal verification of neural networks is essential before their deployment in safety-critical applications. However, existing methods for formally verifying neural networks are not yet scalable enough to handle practical problems under…

Machine Learning · Computer Science 2025-07-08 Tobias Ladner , Matthias Althoff

Neural networks have been widely used to solve complex real-world problems. Due to the complicate, nonlinear, non-convex nature of neural networks, formal safety guarantees for the behaviors of neural network systems will be crucial for…

Systems and Control · Computer Science 2018-02-13 Weiming Xiang , Diego Manzanas Lopez , Patrick Musau , Taylor T. Johnson

Verifying correctness of deep neural networks (DNNs) is challenging. We study a generic reachability problem for feed-forward DNNs which, for a given set of inputs to the network and a Lipschitz-continuous function over its outputs,…

Machine Learning · Computer Science 2018-05-08 Wenjie Ruan , Xiaowei Huang , Marta Kwiatkowska

Deep neural network with rectified linear units (ReLU) is getting more and more popular recently. However, the derivatives of the function represented by a ReLU network are not continuous, which limit the usage of ReLU network to situations…

Machine Learning · Computer Science 2020-12-03 Bo Li , Shanshan Tang , Haijun Yu

Deep neural networks can be trained to be efficient and effective controllers for dynamical systems; however, the mechanics of deep neural networks are complex and difficult to guarantee. This work presents a general approach for providing…

Systems and Control · Computer Science 2019-06-05 Kyle D. Julian , Mykel J. Kochenderfer

We investigate the complexity of the reachability problem for (deep) neural networks: does it compute valid output given some valid input? It was recently claimed that the problem is NP-complete for general neural networks and…

Computational Complexity · Computer Science 2026-04-08 Marco Sälzer , Martin Lange

In this paper, the output reachable estimation and safety verification problems for multi-layer perceptron neural networks are addressed. First, a conception called maximum sensitivity in introduced and, for a class of multi-layer…

Machine Learning · Computer Science 2018-02-21 Weiming Xiang , Hoang-Dung Tran , Taylor T. Johnson
‹ Prev 1 2 3 10 Next ›