English
Related papers

Related papers: Stress-Testing Neural Network Verifiers with Prova…

200 papers

Reliable and robust evaluation methods are a necessary first step towards developing machine learning models that are themselves robust and reliable. Unfortunately, current evaluation protocols typically used to assess classifiers fail to…

Machine Learning · Computer Science 2025-05-26 Michael W. Spratling

Extensive research on formal verification of machine learning systems indicates that learning from data alone often fails to capture underlying background knowledge, such as specifications implicitly available in the data. Various neural…

Logic in Computer Science · Computer Science 2025-03-17 Thomas Flinkow , Barak A. Pearlmutter , Rosemary Monahan

In this paper we investigate formal verification problems for Neural Network computations. Various reachability problems will be in the focus, such as: Given symbolic specifications of allowed inputs and outputs in form of Linear…

Computational Complexity · Computer Science 2023-06-12 Adrian Wurm

Learning reliably safe autonomous control is one of the core problems in trustworthy autonomy. However, training a controller that can be formally verified to be safe remains a major challenge. We introduce a novel approach for learning…

Machine Learning · Computer Science 2024-11-19 Junlin Wu , Huan Zhang , Yevgeniy Vorobeychik

Data-driven models, especially deep learning classifiers often demonstrate great success on clean datasets. Yet, they remain vulnerable to common data distortions such as adversarial and common corruption perturbations. These perturbations…

We develop the first (to the best of our knowledge) provably correct neural networks for a precise computational task, with the proof of correctness generated by an automated verification algorithm without any human input. Prior work on…

Machine Learning · Computer Science 2024-05-09 Rudy Bunel , Krishnamurthy Dvijotham , M. Pawan Kumar , Alessandro De Palma , Robert Stanforth

The wide deployment of deep neural networks, though achieving great success in many domains, has severe safety and reliability concerns. Existing adversarial attack generation and automatic verification techniques cannot formally verify…

Machine Learning · Computer Science 2020-06-09 Weidi Sun , Yuteng Lu , Xiyue Zhang , Zhanxing Zhu , Meng Sun

Modern verification tools for deep neural networks (DNNs) increasingly rely on abstraction to scale to realistic architectures. In parallel, proof production is becoming a critical requirement for increasing the reliability of DNN…

Logic in Computer Science · Computer Science 2025-06-12 Yizhak Yisrael Elboher , Omri Isac , Guy Katz , Tobias Ladner , Haoze Wu

State-of-the-art neural network verifiers operate by encoding neural network verification as constraint satisfaction problems. When dealing with standard piecewise-linear activation functions, such as ReLUs, verifiers typically employ…

Logic in Computer Science · Computer Science 2025-12-12 Maya Swisa , Guy Katz

Machine learning models are increasingly deployed for critical decision-making tasks, making it important to verify that they do not contain gender or racial biases picked up from training data. Typical approaches to achieve fairness…

Machine Learning · Computer Science 2022-12-19 Giorgian Borca-Tasciuc , Xingzhi Guo , Stanley Bak , Steven Skiena

Existing neural network verifiers compute a proof that each input is handled correctly under a given perturbation by propagating a symbolic abstraction of reachable values at each layer. This process is repeated from scratch independently…

Machine Learning · Computer Science 2023-11-27 Marc Fischer , Christian Sprecher , Dimitar I. Dimitrov , Gagandeep Singh , Martin Vechev

AI Safety is a major concern in many deep learning applications such as autonomous driving. Given a trained deep learning model, an important natural problem is how to reliably verify the model's prediction. In this paper, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Tong Che , Xiaofeng Liu , Site Li , Yubin Ge , Ruixiang Zhang , Caiming Xiong , Yoshua Bengio

Fairness is crucial for neural networks which are used in applications with important societal implication. Recently, there have been multiple attempts on improving fairness of neural networks, with a focus on fairness testing (e.g.,…

Machine Learning · Computer Science 2021-07-20 Bing Sun , Jun Sun , Ting Dai , Lijun Zhang

Current approaches to neural network verification focus on specifications that target small regions around known input data points, such as local robustness. Thus, using these approaches, we can not obtain guarantees for inputs that are not…

Machine Learning · Computer Science 2023-06-23 David Boetius , Stefan Leue

Neural networks have become increasingly popular in controller design due to their versatility and efficiency. However, their integration into feedback systems can pose stability challenges, particularly in the presence of uncertainties.…

Optimization and Control · Mathematics 2025-03-04 Yuhao Zhang , Xiangru Xu

We consider the problem of whether a Neural Network (NN) model satisfies global individual fairness. Individual Fairness suggests that similar individuals with respect to a certain task are to be treated similarly by the decision model. In…

Machine Learning · Computer Science 2022-05-23 Haitham Khedr , Yasser Shoukry

Robustness certification, which aims to formally certify the predictions of neural networks against adversarial inputs, has become an integral part of important tool for safety-critical applications. Despite considerable progress, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Daqian Shao , Lukas Fesser , Marta Kwiatkowska

Adversarial noise attacks present a significant threat to quantum machine learning (QML) models, similar to their classical counterparts. This is especially true in the current Noisy Intermediate-Scale Quantum era, where noise is…

Quantum Physics · Physics 2024-07-19 Yanling Lin , Ji Guan , Wang Fang , Mingsheng Ying , Zhaofeng Su

Datasets typically contain inaccuracies due to human error and societal biases, and these inaccuracies can affect the outcomes of models trained on such datasets. We present a technique for certifying whether linear regression models are…

Machine Learning · Computer Science 2022-06-09 Anna P. Meyer , Aws Albarghouthi , Loris D'Antoni

Formal verification is only as good as the specification of a system, which is also true for neural network verification. Existing specifications follow the paradigm of data as specification, where the local neighborhood around a reference…

Machine Learning · Computer Science 2025-03-17 Chuqin Geng , Zhaoyue Wang , Haolin Ye , Xujie Si