English
Related papers

Related papers: Reluplex: An Efficient SMT Solver for Verifying De…

200 papers

It is commonly recognized that the expressiveness of deep neural networks is contingent upon a range of factors, encompassing their depth, width, and other relevant considerations. Currently, the practical performance of the majority of…

Machine Learning · Computer Science 2023-11-08 Xuan Qi , Yi Wei

Recurrent neural networks (RNNs) such as Long Short Term Memory (LSTM) networks have become popular in a variety of applications such as image processing, data classification, speech recognition, and as controllers in autonomous systems. In…

Machine Learning · Computer Science 2020-07-21 Sara Mohammadinejad , Brandon Paulsen , Chao Wang , Jyotirmoy V. Deshmukh

Deep neural network (DNN) verification is an emerging field, with diverse verification engines quickly becoming available. Demonstrating the effectiveness of these engines on real-world DNNs is an important step towards their wider…

Logic in Computer Science · Computer Science 2020-08-11 Sumathi Gokulanathan , Alexander Feldsher , Adi Malca , Clark Barrett , Guy Katz

Constraint solving is an elementary way for verification of deep neural networks (DNN). In the domain of AI safety, a DNN might be modified in its structure and parameters for its repair or attack. For such situations, we propose the…

Artificial Intelligence · Computer Science 2023-02-14 Pengfei Yang , Zhiming Chi , Zongxin Liu , Mengyu Zhao , Cheng-Chao Huang , Shaowei Cai , Lijun Zhang

The reliable deployment of neural networks in control systems requires rigorous robustness guarantees. In this paper, we obtain tight robustness certificates over convex attack sets for min-max representations of ReLU neural networks by…

Optimization and Control · Mathematics 2023-10-10 Brendon G. Anderson , Samuel Pfrommer , Somayeh Sojoudi

Verifying robustness of neural network classifiers has attracted great interests and attention due to the success of deep neural networks and their unexpected vulnerability to adversarial perturbations. Although finding minimum adversarial…

Machine Learning · Statistics 2018-11-30 Akhilan Boopathy , Tsui-Wei Weng , Pin-Yu Chen , Sijia Liu , Luca Daniel

Due to the increasing deployment of Deep Neural Networks (DNNs) in real-world security-critical domains including autonomous vehicles and collision avoidance systems, formally checking security properties of DNNs, especially under different…

Artificial Intelligence · Computer Science 2018-07-03 Shiqi Wang , Kexin Pei , Justin Whitehouse , Junfeng Yang , Suman Jana

Deep neural networks are widely used for nonlinear function approximation with applications ranging from computer vision to control. Although these networks involve the composition of simple arithmetic operations, it can be very challenging…

Machine Learning · Computer Science 2020-12-02 Changliu Liu , Tomer Arnon , Christopher Lazarus , Christopher Strong , Clark Barrett , Mykel J. Kochenderfer

Reverse engineering deep ReLU networks is a critical problem in understanding the complex behavior and interpretability of neural networks. In this research, we present a novel method for reconstructing deep ReLU networks by leveraging…

Machine Learning · Computer Science 2023-12-11 Mehrab Hamidi

Formal verification of neural networks is critical for their safe adoption in real-world applications. However, designing a precise and scalable verifier which can handle different activation functions, realistic network architectures and…

Artificial Intelligence · Computer Science 2022-03-01 Mark Niklas Müller , Gleb Makarchuk , Gagandeep Singh , Markus Püschel , Martin Vechev

Neural networks have recently become popular for a wide variety of uses, but have seen limited application in safety-critical domains such as robotics near and around humans. This is because it remains an open challenge to train a neural…

Machine Learning · Computer Science 2021-07-19 Long Kiu Chung , Adam Dai , Derek Knowles , Shreyas Kousik , Grace X. Gao

While neural networks have achieved high performance in different learning tasks, their accuracy drops significantly in the presence of small adversarial perturbations to inputs. Defenses based on regularization and adversarial training are…

Machine Learning · Computer Science 2019-02-07 Sahil Singla , Soheil Feizi

Deep neural networks (DNNs) enable high performance across domains but remain vulnerable to adversarial perturbations, limiting their use in safety-critical settings. Here, we introduce two quantum-optimization-based models for robust…

Machine Learning · Computer Science 2026-03-03 Wenxin Li , Wenchao Liu , Chuan Wang , Qi Gao , Yin Ma , Hai Wei , Kai Wen

Neural networks are a powerful class of functions that can be trained with simple gradient descent to achieve state-of-the-art performance on a variety of applications. Despite their practical success, there is a paucity of results that…

Machine Learning · Computer Science 2017-03-06 Bo Xie , Yingyu Liang , Le Song

We explore the concept of co-design in the context of neural network verification. Specifically, we aim to train deep neural networks that not only are robust to adversarial perturbations but also whose robustness can be verified more…

Machine Learning · Computer Science 2019-04-25 Kai Y. Xiao , Vincent Tjeng , Nur Muhammad Shafiullah , Aleksander Madry

Deep learning has emerged as an effective approach for creating modern software systems, with neural networks often surpassing hand-crafted systems. Unfortunately, neural networks are known to suffer from various safety and security issues.…

Machine Learning · Computer Science 2021-01-19 Guy Amir , Haoze Wu , Clark Barrett , Guy Katz

Rectified Linear Units (ReLUs) have been shown to ameliorate the vanishing gradient problem, allow for efficient backpropagation, and empirically promote sparsity in the learned parameters. They have led to state-of-the-art results in a…

Machine Learning · Computer Science 2016-05-30 Xingyuan Pan , Vivek Srikumar

Motivated by the growing theoretical understanding of neural networks that employ the Rectified Linear Unit (ReLU) as their activation function, we revisit the use of ReLU activation functions for learning implicit neural representations…

Image and Video Processing · Electrical Eng. & Systems 2024-08-05 Joseph Shenouda , Yamin Zhou , Robert D. Nowak

The success of Deep Learning and its potential use in many safety-critical applications has motivated research on formal verification of Neural Network (NN) models. In this context, verification involves proving or disproving that an NN…

Machine Learning · Computer Science 2025-08-27 Rudy Bunel , Jingyue Lu , Ilker Turkaslan , Philip H. S. Torr , Pushmeet Kohli , M. Pawan Kumar

The robustness of deep neural networks is crucial to modern AI-enabled systems and should be formally verified. Sigmoid-like neural networks have been adopted in a wide range of applications. Due to their non-linearity, Sigmoid-like…

Machine Learning · Computer Science 2022-08-31 Zhaodi Zhang , Yiting Wu , Si Liu , Jing Liu , Min Zhang