English
Related papers

Related papers: Bounding the Complexity of Formally Verifying Neur…

200 papers

Formal verification of neural networks is an active topic of research, and recent advances have significantly increased the size of the networks that verification tools can handle. However, most methods are designed for verification of an…

Artificial Intelligence · Computer Science 2022-04-06 Thomas A. Henzinger , Mathias Lechner , Đorđe Žikelić

We explore the concept of co-design in the context of neural network verification. Specifically, we aim to train deep neural networks that not only are robust to adversarial perturbations but also whose robustness can be verified more…

Machine Learning · Computer Science 2019-04-25 Kai Y. Xiao , Vincent Tjeng , Nur Muhammad Shafiullah , Aleksander Madry

The robustness of deep neural networks is crucial to modern AI-enabled systems and should be formally verified. Sigmoid-like neural networks have been adopted in a wide range of applications. Due to their non-linearity, Sigmoid-like…

Machine Learning · Computer Science 2022-08-31 Zhaodi Zhang , Yiting Wu , Si Liu , Jing Liu , Min Zhang

Deep Neural Networks (DNN) are crucial in approximating nonlinear functions across diverse applications, ranging from image classification to control. Verifying specific input-output properties can be a highly challenging task due to the…

Machine Learning · Computer Science 2025-07-22 Tianhao Wei , Hanjiang Hu , Luca Marzari , Kai S. Yun , Peizhi Niu , Xusheng Luo , Changliu Liu

Probabilistic verification problems of neural networks are concerned with formally analysing the output distribution of a neural network under a probability distribution of the inputs. Examples of probabilistic verification problems include…

Machine Learning · Computer Science 2025-07-11 David Boetius , Stefan Leue , Tobias Sutter

Neural networks are increasingly applied to support decision making in safety-critical applications (like autonomous cars, unmanned aerial vehicles and face recognition based authentication). While many impressive static verification…

Machine Learning · Computer Science 2021-05-07 Guoliang Dong , Jun Sun , Jingyi Wang , Xinyu Wang , Ting Dai

This paper studies the expressive power of artificial neural networks with rectified linear units. In order to study them as a model of real-valued computation, we introduce the concept of Max-Affine Arithmetic Programs and show equivalence…

Machine Learning · Computer Science 2024-07-18 Christoph Hertrich , Leon Sering

Verifying robustness of neural network classifiers has attracted great interests and attention due to the success of deep neural networks and their unexpected vulnerability to adversarial perturbations. Although finding minimum adversarial…

Machine Learning · Statistics 2018-11-30 Akhilan Boopathy , Tsui-Wei Weng , Pin-Yu Chen , Sijia Liu , Luca Daniel

We derive upper bounds on the complexity of ReLU neural networks approximating the solution of a linear system given the matrix and the right-hand side. We focus on matrices which are symmetric positive definite and sparse, as they appear…

Numerical Analysis · Mathematics 2026-03-20 Benjamin Dörich , Roland Maier , Lukas Ullmer

A ReLU network is a piecewise linear function over polytopes. Figuring out the properties of such polytopes is of fundamental importance for the research and development of neural networks. So far, either theoretical or empirical studies on…

Machine Learning · Computer Science 2024-11-25 Feng-Lei Fan , Wei Huang , Xiangru Zhong , Lecheng Ruan , Tieyong Zeng , Huan Xiong , Fei Wang

Deep learning has been widely used in many fields, but the model training process usually consumes massive computational resources and time. Therefore, designing an efficient neural network training method with a provable convergence…

Machine Learning · Computer Science 2023-07-14 Lianke Qin , Zhao Song , Yuanyuan Yang

Understanding the computational complexity of training simple neural networks with rectified linear units (ReLUs) has recently been a subject of intensive research. Closing gaps and complementing results from the literature, we present…

Machine Learning · Computer Science 2022-08-24 Vincent Froese , Christoph Hertrich , Rolf Niedermeier

In this paper, we consider the problem of repairing a data-trained Rectified Linear Unit (ReLU) Neural Network (NN) controller for a discrete-time, input-affine system. That is we assume that such a NN controller is available, and we seek…

Machine Learning · Computer Science 2021-04-08 Ulices Santa Cruz , James Ferlez , Yasser Shoukry

Quantifying the robustness of neural networks or verifying their safety properties against input uncertainties or adversarial attacks have become an important research area in learning-enabled systems. Most results concentrate around the…

Systems and Control · Electrical Eng. & Systems 2019-10-11 Mahyar Fazlyab , Manfred Morari , George J. Pappas

In the field of formal verification, Neural Networks (NNs) are typically reformulated into equivalent mathematical programs which are optimized over. To overcome the inherent non-convexity of these reformulations, convex relaxations of…

Machine Learning · Computer Science 2024-08-23 Samuel Chevalier , Duncan Starkenburg , Krishnamurthy Dvijotham

This work introduces HyParLyVe (Hyperplane Partitioned Lyapunov Verifier), a novel algorithm for sound and complete verification of neural Lyapunov candidates by interpreting shallow ReLU networks as hyperplane arrangements. This…

Systems and Control · Electrical Eng. & Systems 2026-05-06 Jesse Wayment , Brian Yarbrough , Jingbo Wang , Shreyas Sundaram , Philip E. Paré

Deciding whether a graph can be embedded in a grid using only unit-length edges is NP-complete, even when restricted to binary trees. However, it is not difficult to devise a number of graph classes for which the problem is polynomial, even…

Data Structures and Algorithms · Computer Science 2012-04-13 Vinícius G. P. de Sá , Guilherme D. da Fonseca , Raphael Machado , Celina M. H. de Figueiredo

Deep neural networks (DNNs) are the workhorses of deep learning, which constitutes the state of the art in numerous application domains. However, DNN-based decision rules are notoriously prone to poor generalization, i.e., may prove…

Machine Learning · Computer Science 2023-05-11 Guy Amir , Osher Maayan , Tom Zelazny , Guy Katz , Michael Schapira

The ubiquity of deep learning algorithms in various applications has amplified the need for assuring their robustness against small input perturbations such as those occurring in adversarial attacks. Existing complete verification…

Machine Learning · Computer Science 2024-06-17 Matthias König , Xiyue Zhang , Holger H. Hoos , Marta Kwiatkowska , Jan N. van Rijn

Barrier certificates play an important role in verifying the safety of continuous-time systems, including autonomous driving, robotic manipulators and other critical applications. Recently, ReLU neural barrier certificates -- barrier…

Systems and Control · Electrical Eng. & Systems 2025-11-14 Dejin Ren , Yiling Xue , Taoran Wu , Bai Xue