English
Related papers

Related papers: Provable Preimage Under-Approximation for Neural N…

200 papers

We introduce a pruning algorithm that provably sparsifies the parameters of a trained model in a way that approximately preserves the model's predictive accuracy. Our algorithm uses a small batch of input points to construct a data-informed…

Machine Learning · Computer Science 2021-03-16 Cenk Baykal , Lucas Liebenwein , Igor Gilitschenski , Dan Feldman , Daniela Rus

We study the problem of formally verifying the robustness to adversarial examples of support vector machines (SVMs), a major machine learning model for classification and regression tasks. Following a recent stream of works on formal…

Machine Learning · Computer Science 2019-04-29 Francesco Ranzato , Marco Zanella

Verification of deep neural networks has witnessed a recent surge of interest, fueled by success stories in diverse domains and by abreast concerns about safety and security in envisaged applications. Complexity and sheer size of such…

Machine Learning · Computer Science 2020-03-18 Dario Guidotti , Francesco Leofante , Luca Pulina , Armando Tacchella

We present a provable, sampling-based approach for generating compact Convolutional Neural Networks (CNNs) by identifying and removing redundant filters from an over-parameterized network. Our algorithm uses a small batch of input data…

Machine Learning · Computer Science 2020-03-24 Lucas Liebenwein , Cenk Baykal , Harry Lang , Dan Feldman , Daniela Rus

We present a scalable and precise verifier for recurrent neural networks, called Prover based on two novel ideas: (i) a method to compute a set of polyhedral abstractions for the non-convex and nonlinear recurrent update functions by…

Machine Learning · Computer Science 2021-06-14 Wonryong Ryou , Jiayu Chen , Mislav Balunovic , Gagandeep Singh , Andrei Dan , Martin Vechev

Formal verification is only as good as the specification of a system, which is also true for neural network verification. Existing specifications follow the paradigm of data as specification, where the local neighborhood around a reference…

Machine Learning · Computer Science 2025-03-17 Chuqin Geng , Zhaoyue Wang , Haolin Ye , Xujie Si

Neural networks are now extensively used in perception, prediction and control of autonomous systems. Their deployment in safety-critical systems brings forth the need for verification techniques for such networks. As an alternative to…

Artificial Intelligence · Computer Science 2021-04-27 Moumita Das , Rajarshi Ray , Swarup Kumar Mohalik , Ansuman Banerjee

We develop a corrective mechanism for neural network approximation: the total available non-linear units are divided into multiple groups and the first group approximates the function under consideration, the second group approximates the…

Machine Learning · Computer Science 2020-06-23 Guy Bresler , Dheeraj Nagaraj

Pruning neural networks has proven to be a successful approach to increase the efficiency and reduce the memory storage of deep learning models without compromising performance. Previous literature has shown that it is possible to achieve a…

Machine Learning · Computer Science 2024-08-12 Joaquin Alvarez

Analysis and manipulation of trained neural networks is a challenging and important problem. We propose a symbolic representation for piecewise-linear neural networks and discuss its efficient computation. With this representation, one can…

Machine Learning · Computer Science 2019-08-21 Matthew Sotoudeh , Aditya V. Thakur

Quantifying the robustness of neural networks or verifying their safety properties against input uncertainties or adversarial attacks have become an important research area in learning-enabled systems. Most results concentrate around the…

Systems and Control · Electrical Eng. & Systems 2019-10-11 Mahyar Fazlyab , Manfred Morari , George J. Pappas

The robustness of deep neural networks (DNNs) is crucial to the hosting system's reliability and security. Formal verification has been demonstrated to be effective in providing provable robustness guarantees. To improve its scalability,…

Machine Learning · Computer Science 2023-05-29 Zhiyi Xue , Si Liu , Zhaodi Zhang , Yiting Wu , Min Zhang

The problem of probabilistic verification of a neural network investigates the probability of satisfying the safe constraints in the output space when the input is given by a probability distribution. It is significant to answer this…

Artificial Intelligence · Computer Science 2026-04-24 Jingyang Li , Xin Chen , Hongfei Fu , Guoqiang Li

Probabilistic verification problems of neural networks are concerned with formally analysing the output distribution of a neural network under a probability distribution of the inputs. Examples of probabilistic verification problems include…

Machine Learning · Computer Science 2025-07-11 David Boetius , Stefan Leue , Tobias Sutter

Image superresolution involves the processing of an image sequence to generate a still image with higher resolution. Classical approaches, such as bayesian MAP methods, require iterative minimization procedures, with high computational…

Computer Vision and Pattern Recognition · Computer Science 2016-08-31 Carlos Miravet , Francisco B. Rodriguez

This paper explores methods for verifying the properties of Binary Neural Networks (BNNs), focusing on robustness against adversarial attacks. Despite their lower computational and memory needs, BNNs, like their full-precision counterparts,…

Machine Learning · Computer Science 2025-04-16 Jianting Yang , Srećko Ðurašinović , Jean-Bernard Lasserre , Victor Magron , Jun Zhao

This paper addresses the problem of formally verifying desirable properties of neural networks, i.e., obtaining provable guarantees that neural networks satisfy specifications relating their inputs and outputs (robustness to bounded norm…

Machine Learning · Computer Science 2018-08-06 Krishnamurthy , Dvijotham , Robert Stanforth , Sven Gowal , Timothy Mann , Pushmeet Kohli

Compressing large Neural Networks (NN) by quantizing the parameters, while maintaining the performance is highly desirable due to reduced memory and time complexity. In this work, we cast NN quantization as a discrete labelling problem, and…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Thalaiyasingam Ajanthan , Puneet K. Dokania , Richard Hartley , Philip H. S. Torr

Despite having high accuracy, neural nets have been shown to be susceptible to adversarial examples, where a small perturbation to an input can cause it to become mislabeled. We propose metrics for measuring the robustness of a neural net…

Machine Learning · Computer Science 2017-06-19 Osbert Bastani , Yani Ioannou , Leonidas Lampropoulos , Dimitrios Vytiniotis , Aditya Nori , Antonio Criminisi

Deep neural network with rectified linear units (ReLU) is getting more and more popular recently. However, the derivatives of the function represented by a ReLU network are not continuous, which limit the usage of ReLU network to situations…

Machine Learning · Computer Science 2020-12-03 Bo Li , Shanshan Tang , Haijun Yu