English
Related papers

Related papers: Provably Bounding Neural Network Preimages

200 papers

Neural network verification aims at providing formal guarantees on the output of trained neural networks, to ensure their robustness against adversarial examples and enable their deployment in safety-critical applications. This paper…

Optimization and Control · Mathematics 2024-04-02 Haoruo Zhao , Hassan Hijazi , Haydn Jones , Juston Moore , Mathieu Tanneau , Pascal Van Hentenryck

Binarized neural networks (BNNs) are feedforward neural networks with binary weights and activation functions. In the context of using a BNN for classification, the verification problem seeks to determine whether a small perturbation of a…

Machine Learning · Computer Science 2025-10-03 Woojin Kim , James R. Luedtke

We introduce two algorithms for computing tight guarantees on the probabilistic robustness of Bayesian Neural Networks (BNNs). Computing robustness guarantees for BNNs is a significantly more challenging task than verifying the robustness…

Machine Learning · Computer Science 2024-03-01 Ben Batten , Mehran Hosseini , Alessio Lomuscio

The success of Deep Learning and its potential use in many safety-critical applications has motivated research on formal verification of Neural Network (NN) models. In this context, verification involves proving or disproving that an NN…

Machine Learning · Computer Science 2025-08-27 Rudy Bunel , Jingyue Lu , Ilker Turkaslan , Philip H. S. Torr , Pushmeet Kohli , M. Pawan Kumar

Deep neural networks are widely used for nonlinear function approximation with applications ranging from computer vision to control. Although these networks involve the composition of simple arithmetic operations, it can be very challenging…

Machine Learning · Computer Science 2020-12-02 Changliu Liu , Tomer Arnon , Christopher Lazarus , Christopher Strong , Clark Barrett , Mykel J. Kochenderfer

The rapid growth of deep learning applications in real life is accompanied by severe safety concerns. To mitigate this uneasy phenomenon, much research has been done providing reliable evaluations of the fragility level in different deep…

Machine Learning · Computer Science 2019-12-03 Zhaoyang Lyu , Ching-Yun Ko , Zhifeng Kong , Ngai Wong , Dahua Lin , Luca Daniel

Deep neural networks are increasingly being used as controllers for safety-critical systems. Because neural networks are opaque, certifying their correctness is a significant challenge. To address this issue, several neural network…

Formal Languages and Automata Theory · Computer Science 2020-07-22 Yizhak Yisrael Elboher , Justin Gottschlich , Guy Katz

The ubiquity of deep learning algorithms in various applications has amplified the need for assuring their robustness against small input perturbations such as those occurring in adversarial attacks. Existing complete verification…

Machine Learning · Computer Science 2024-06-17 Matthias König , Xiyue Zhang , Holger H. Hoos , Marta Kwiatkowska , Jan N. van Rijn

This paper explores methods for verifying the properties of Binary Neural Networks (BNNs), focusing on robustness against adversarial attacks. Despite their lower computational and memory needs, BNNs, like their full-precision counterparts,…

Machine Learning · Computer Science 2025-04-16 Jianting Yang , Srećko Ðurašinović , Jean-Bernard Lasserre , Victor Magron , Jun Zhao

The robustness of deep neural networks is crucial to modern AI-enabled systems and should be formally verified. Sigmoid-like neural networks have been adopted in a wide range of applications. Due to their non-linearity, Sigmoid-like…

Machine Learning · Computer Science 2022-08-31 Zhaodi Zhang , Yiting Wu , Si Liu , Jing Liu , Min Zhang

Learning-based methods could provide solutions to many of the long-standing challenges in control. However, the neural networks (NNs) commonly used in modern learning approaches present substantial challenges for analyzing the resulting…

Machine Learning · Computer Science 2022-02-03 Michael Everett

With neural networks being used to control safety-critical systems, they increasingly have to be both accurate (in the sense of matching inputs to outputs) and robust. However, these two properties are often at odds with each other and a…

Systems and Control · Electrical Eng. & Systems 2024-05-30 Ross Drummond , Chris Guiver , Matthew C. Turner

Learning-based methods for synthesizing controllers have gained popularity due to their high expressiveness and strong empirical performance. However, in safety-critical scenarios such as autonomous driving, robotics, and power systems,…

Systems and Control · Electrical Eng. & Systems 2026-05-27 Haoyu Li , Xiangru Zhong , Hao Cheng , Bin Hu , Huan Zhang

We improve the scalability of Branch and Bound (BaB) algorithms for formally proving input-output properties of neural networks. First, we propose novel bounding algorithms based on Lagrangian Decomposition. Previous works have used…

Although recent provable methods have been developed to compute preimage bounds for neural networks, their scalability is fundamentally limited by the #P-hardness of the problem. In this work, we adopt a novel probabilistic perspective,…

Machine Learning · Computer Science 2025-11-18 Luca Marzari , Manuele Bicego , Ferdinando Cicalese , Alessandro Farinelli

Formal verification of neural networks is essential for their deployment in safety-critical areas. Many available formal verification methods have been shown to be instances of a unified Branch and Bound (BaB) formulation. We propose a…

Machine Learning · Computer Science 2019-12-04 Jingyue Lu , M. Pawan Kumar

Deep neural networks are known to be fragile to small adversarial perturbations. This issue becomes more critical when a neural network is interconnected with a physical system in a closed loop. In this paper, we show how to combine recent…

Machine Learning · Computer Science 2019-08-20 Yuh-Shyang Wang , Tsui-Wei Weng , Luca Daniel

Neural networks are known to be vulnerable to adversarial attacks, which are small, imperceptible perturbations that can significantly alter the network's output. Conversely, there may exist large, meaningful perturbations that do not…

Machine Learning · Computer Science 2023-05-18 Tianqi Cui , Thomas Bertalan , George J. Pappas , Manfred Morari , Ioannis G. Kevrekidis , Mahyar Fazlyab

Bound propagation based incomplete neural network verifiers such as CROWN are very efficient and can significantly accelerate branch-and-bound (BaB) based complete verification of neural networks. However, bound propagation cannot fully…

Machine Learning · Computer Science 2021-11-02 Shiqi Wang , Huan Zhang , Kaidi Xu , Xue Lin , Suman Jana , Cho-Jui Hsieh , J. Zico Kolter

The problem of probabilistic verification of a neural network investigates the probability of satisfying the safe constraints in the output space when the input is given by a probability distribution. It is significant to answer this…

Artificial Intelligence · Computer Science 2026-04-24 Jingyang Li , Xin Chen , Hongfei Fu , Guoqiang Li