English
Related papers

Related papers: Efficient Exact Verification of Binarized Neural N…

200 papers

Formal verification of neural networks is essential for their deployment in safety-critical areas. Many available formal verification methods have been shown to be instances of a unified Branch and Bound (BaB) formulation. We propose a…

Machine Learning · Computer Science 2019-12-04 Jingyue Lu , M. Pawan Kumar

This paper presents the Neural Network Verification (NNV) software tool, a set-based verification framework for deep neural networks (DNNs) and learning-enabled cyber-physical systems (CPS). The crux of NNV is a collection of reachability…

Systems and Control · Electrical Eng. & Systems 2020-04-14 Hoang-Dung Tran , Xiaodong Yang , Diego Manzanas Lopez , Patrick Musau , Luan Viet Nguyen , Weiming Xiang , Stanley Bak , Taylor T. Johnson

Verification of binary neural network (BNN) robustness is NP-hard, as it can be formulated as a combinatorial search for an adversarial perturbation that induces misclassification. Exact verification methods therefore scale poorly with…

Emerging Technologies · Computer Science 2026-03-09 Madhav Vadlamani , Rahul Singh , Yuyao Kong , Zheng Zhang , Shimeng Yu

A key enabler of deploying convolutional neural networks on resource-constrained embedded systems is the binary neural network (BNN). BNNs save on memory and simplify computation by binarizing both features and weights. Unfortunately,…

Machine Learning · Computer Science 2023-10-19 Floran de Putter , Henk Corporaal

Most work on the formal verification of neural networks has focused on bounding the set of outputs that correspond to a given set of inputs (for example, bounded perturbations of a nominal input). However, many use cases of neural network…

Machine Learning · Computer Science 2024-03-19 Suhas Kotha , Christopher Brix , Zico Kolter , Krishnamurthy Dvijotham , Huan Zhang

We consider adversarial training of deep neural networks through the lens of Bayesian learning, and present a principled framework for adversarial training of Bayesian Neural Networks (BNNs) with certifiable guarantees. We rely on…

Machine Learning · Computer Science 2021-02-24 Matthew Wicker , Luca Laurenti , Andrea Patane , Zhoutong Chen , Zheng Zhang , Marta Kwiatkowska

Neural network verification is an active and rapidly maturing research area, with a growing ecosystem of solvers and tools. The VNN-LIB standard was introduced to support interoperability in this ecosystem, but Version~1.0 has several…

Machine Learning · Computer Science 2026-05-11 Ann Roy , Allen Antony , Andrea Gimelli , Matthew L. Daggitt

As a new programming paradigm, deep neural networks (DNNs) have been increasingly deployed in practice, but the lack of robustness hinders their applications in safety-critical domains. While there are techniques for verifying DNNs with…

Software Engineering · Computer Science 2022-07-05 Jiaxiang Liu , Yunhan Xing , Xiaomu Shi , Fu Song , Zhiwu Xu , Zhong Ming

Although deep neural networks are successful for many tasks in the speech domain, the high computational and memory costs of deep neural networks make it difficult to directly deploy highperformance Neural Network systems on low-resource…

Sound · Computer Science 2021-04-07 Tinglong Zhu , Xiaoyi Qin , Ming Li

We develop the first (to the best of our knowledge) provably correct neural networks for a precise computational task, with the proof of correctness generated by an automated verification algorithm without any human input. Prior work on…

Machine Learning · Computer Science 2024-05-09 Rudy Bunel , Krishnamurthy Dvijotham , M. Pawan Kumar , Alessandro De Palma , Robert Stanforth

Deep Neural Networks (DNNs) are powerful tools for various computer vision tasks, yet they often struggle with reliable uncertainty quantification - a critical requirement for real-world applications. Bayesian Neural Networks (BNN) are…

Machine Learning · Computer Science 2023-12-27 Gianni Franchi , Olivier Laurent , Maxence Leguéry , Andrei Bursuc , Andrea Pilzer , Angela Yao

To alleviate the practical constraints for deploying deep neural networks (DNNs) on edge devices, quantization is widely regarded as one promising technique. It reduces the resource requirements for computational power and storage space by…

Machine Learning · Computer Science 2023-05-24 Yedi Zhang , Fu Song , Jun Sun

We study embedded Binarized Neural Networks (eBNNs) with the aim of allowing current binarized neural networks (BNNs) in the literature to perform feedforward inference efficiently on small embedded devices. We focus on minimizing the…

Computer Vision and Pattern Recognition · Computer Science 2017-09-08 Bradley McDanel , Surat Teerapittayanon , H. T. Kung

Branch-and-bound (BaB) is among the most effective techniques for neural network (NN) verification. However, existing works on BaB for NN verification have mostly focused on NNs with piecewise linear activations, especially ReLU networks.…

Machine Learning · Computer Science 2025-02-11 Zhouxing Shi , Qirui Jin , Zico Kolter , Suman Jana , Cho-Jui Hsieh , Huan Zhang

Sound event detection (SED) is a hot topic in consumer and smart city applications. Existing approaches based on Deep Neural Networks are very effective, but highly demanding in terms of memory, power, and throughput when targeting…

Machine Learning · Computer Science 2021-01-13 Gianmarco Cerutti , Renzo Andri , Lukas Cavigelli , Michele Magno , Elisabetta Farella , Luca Benini

Neural networks have demonstrated considerable success on a wide variety of real-world problems. However, networks trained only to optimize for training accuracy can often be fooled by adversarial examples - slightly perturbed inputs that…

Machine Learning · Computer Science 2019-02-19 Vincent Tjeng , Kai Xiao , Russ Tedrake

Convolutional neural networks have gained vast popularity due to their excellent performance in the fields of computer vision, image processing, and others. Unfortunately, it is now well known that convolutional networks often produce…

Machine Learning · Computer Science 2022-01-07 Matan Ostrovsky , Clark Barrett , Guy Katz

Boolean Satisfiability problems are vital components in Electronic Design Automation, particularly within the Logic Equivalence Checking process. Currently, SAT solvers are employed for these problems and neural network is tried as…

Artificial Intelligence · Computer Science 2024-03-07 Tsz Ho Chan , Wenyi Xiao , Junhua Huang , Huiling Zhen , Guangji Tian , Mingxuan Yuan

Non-volatile memory (NVM) crossbars have been identified as a promising technology, for accelerating important machine learning operations, with matrix-vector multiplication being a key example. Binary neural networks (BNNs) are especially…

Emerging Technologies · Computer Science 2023-08-14 Ruirong Huang , Zichao Yue , Caroline Huang , Janarbek Matai , Zhiru Zhang

Network quantization has rapidly become one of the most widely used methods to compress and accelerate deep neural networks. Recent efforts propose to quantize weights and activations from different layers with different precision to…

Machine Learning · Computer Science 2020-03-18 Yuhang Li , Wei Wang , Haoli Bai , Ruihao Gong , Xin Dong , Fengwei Yu