English
Related papers

Related papers: Mini-Batch Robustness Verification of Deep Neural …

200 papers

In deep learning, mini-batch training is commonly used to optimize network parameters. However, the traditional mini-batch method may not learn the under-represented samples and complex patterns in the data, leading to a longer time for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Subin Sahayam , John Zakkam , Umarani Jayaraman

Current approaches to novelty or anomaly detection are based on deep neural networks. Despite their effectiveness, neural networks are also vulnerable to imperceptible deformations of the input data. This is a serious issue in critical…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Ranya Almohsen , Shivang Patel , Donald A. Adjeroh , Gianfranco Doretto

The disparity between the computational demands of deep learning and the capabilities of compute hardware is expanding drastically. Although deep learning achieves remarkable performance in countless tasks, its escalating requirements for…

Machine Learning · Computer Science 2025-09-12 Xiao Wang , Hendrik Borras , Bernhard Klein , Holger Fröning

Deep Neural Network-based systems are now the state-of-the-art in many robotics tasks, but their application in safety-critical domains remains dangerous without formal guarantees on network robustness. Small perturbations to sensor inputs…

Machine Learning · Computer Science 2022-02-03 Michael Everett , Bjorn Lutjens , Jonathan P. How

Efficient matching of local image features is a fundamental task in many computer vision applications. However, the real-time performance of top matching algorithms is compromised in computationally limited devices, such as mobile phones or…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Iago Suárez , Ghesn Sfeir , José M. Buenaposada , Luis Baumela

Verifying robustness of neural network classifiers has attracted great interests and attention due to the success of deep neural networks and their unexpected vulnerability to adversarial perturbations. Although finding minimum adversarial…

Machine Learning · Statistics 2018-11-30 Akhilan Boopathy , Tsui-Wei Weng , Pin-Yu Chen , Sijia Liu , Luca Daniel

Reliable and robust evaluation methods are a necessary first step towards developing machine learning models that are themselves robust and reliable. Unfortunately, current evaluation protocols typically used to assess classifiers fail to…

Machine Learning · Computer Science 2025-05-26 Michael W. Spratling

We present a theoretical study of the robustness of parameterized networks to random input perturbations. Specifically, we analyze local robustness at a given network input by quantifying the probability that a small additive random…

Machine Learning · Computer Science 2026-02-24 Věra Kůrková

Although neural networks are widely used, it remains challenging to formally verify the safety and robustness of neural networks in real-world applications. Existing methods are designed to verify the network before deployment, which are…

Machine Learning · Computer Science 2023-02-06 Tianhao Wei , Changliu Liu

Modern deep neural network training is typically based on mini-batch stochastic gradient optimization. While the use of large mini-batches increases the available computational parallelism, small batch training has been shown to provide…

Machine Learning · Computer Science 2018-04-23 Dominic Masters , Carlo Luschi

Formal verification is only as good as the specification of a system, which is also true for neural network verification. Existing specifications follow the paradigm of data as specification, where the local neighborhood around a reference…

Machine Learning · Computer Science 2025-03-17 Chuqin Geng , Zhaoyue Wang , Haolin Ye , Xujie Si

Hundreds of defenses have been proposed to make deep neural networks robust against minimal (adversarial) input perturbations. However, only a handful of these defenses held up their claims because correctly evaluating robustness is…

Machine Learning · Computer Science 2022-06-29 Roland S. Zimmermann , Wieland Brendel , Florian Tramer , Nicholas Carlini

Malware, or software designed with harmful intent, is an ever-evolving threat that can have drastic effects on both individuals and institutions. Neural network malware classification systems are key tools for combating these threats but…

Cryptography and Security · Computer Science 2024-04-09 Preston K. Robinette , Diego Manzanas Lopez , Serena Serbinowska , Kevin Leach , Taylor T. Johnson

Downstream applications often require text classification models to be accurate and robust. While the accuracy of the state-of-the-art Language Models (LMs) approximates human performance, they often exhibit a drop in performance on noisy…

Computation and Language · Computer Science 2024-10-29 Zhivar Sourati , Darshan Deshpande , Filip Ilievski , Kiril Gashteovski , Sascha Saralajew

We propose a spurious region guided refinement approach for robustness verification of deep neural networks. Our method starts with applying the DeepPoly abstract domain to analyze the network. If the robustness property cannot be verified,…

Artificial Intelligence · Computer Science 2020-10-16 Pengfei Yang , Renjue Li , Jianlin Li , Cheng-Chao Huang , Jingyi Wang , Jun Sun , Bai Xue , Lijun Zhang

A globally robust deep neural network resists perturbations on all meaningful inputs. Current robustness certification methods emphasize local robustness, struggling to scale and generalize. This paper presents a systematic and efficient…

Machine Learning · Computer Science 2024-06-03 You Li , Guannan Zhao , Shuyu Kong , Yunqi He , Hai Zhou

Neural network verification mainly focuses on local robustness properties, which can be checked by bounding the image (set of outputs) of a given input set. However, often it is important to know whether a given property holds globally for…

Software Engineering · Computer Science 2024-01-30 Xiyue Zhang , Benjie Wang , Marta Kwiatkowska

Deep Neural Networks are vulnerable to small perturbations that can drastically alter their predictions for perceptually unchanged inputs. The literature on adversarially robust Deep Learning attempts to either enhance the robustness of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Thomas Massena , Corentin Friedrich , Franck Mamalet , Mathieu Serrurier

Adversarial examples are perturbed inputs that are designed (from a deep learning network's (DLN) parameter gradients) to mislead the DLN during test time. Intuitively, constraining the dimensionality of inputs or parameters of a network…

Machine Learning · Computer Science 2019-06-04 Priyadarshini Panda , Indranil Chakraborty , Kaushik Roy

Polynomial Networks (PNs) have demonstrated promising performance on face and image recognition recently. However, robustness of PNs is unclear and thus obtaining certificates becomes imperative for enabling their adoption in real-world…

Machine Learning · Computer Science 2022-10-25 Elias Abad Rocamora , Mehmet Fatih Sahin , Fanghui Liu , Grigorios G Chrysos , Volkan Cevher