English
Related papers

Related papers: Towards Stable and Efficient Training of Verifiabl…

200 papers

Network security applications, including intrusion detection systems of deep neural networks, are increasing rapidly to make detection task of anomaly activities more accurate and robust. With the rapid increase of using DNN and the volume…

Machine Learning · Computer Science 2020-07-10 Rana Abou Khamis , Ashraf Matrawy

Despite strong performance in numerous applications, the fragility of deep learning to input perturbations has raised serious questions about its use in safety-critical domains. While adversarial training can mitigate this issue in…

Machine Learning · Statistics 2021-11-01 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani , Alejandro Ribeiro

We present $\textbf{P}$robabilistically $\textbf{T}$ightened $\textbf{Li}$near $\textbf{R}$elaxation-based $\textbf{P}$erturbation $\textbf{A}$nalysis ($\texttt{PT-LiRPA}$), a novel framework that combines over-approximation techniques from…

Machine Learning · Computer Science 2026-01-01 Luca Marzari , Ferdinando Cicalese , Alessandro Farinelli

Neural networks are vulnerable to adversarial attacks: adding well-crafted, imperceptible perturbations to their input can modify their output. Adversarial training is one of the most effective approaches to training robust models against…

Machine Learning · Computer Science 2023-08-09 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

This paper presents a dynamic network rewiring (DNR) method to generate pruned deep neural network (DNN) models that are robust against adversarial attacks yet maintain high accuracy on clean images. In particular, the disclosed DNR method…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Souvik Kundu , Mahdi Nazemi , Peter A. Beerel , Massoud Pedram

Despite having high accuracy, neural nets have been shown to be susceptible to adversarial examples, where a small perturbation to an input can cause it to become mislabeled. We propose metrics for measuring the robustness of a neural net…

Machine Learning · Computer Science 2017-06-19 Osbert Bastani , Yani Ioannou , Leonidas Lampropoulos , Dimitrios Vytiniotis , Aditya Nori , Antonio Criminisi

Despite the exploding interest in graph neural networks there has been little effort to verify and improve their robustness. This is even more alarming given recent findings showing that they are extremely vulnerable to adversarial attacks…

Machine Learning · Computer Science 2019-12-20 Aleksandar Bojchevski , Stephan Günnemann

Most existing works focus on improving robustness against adversarial attacks bounded by a single $l_p$ norm using adversarial training (AT). However, these AT models' multiple-norm robustness (union accuracy) is still low, which is crucial…

Machine Learning · Computer Science 2024-09-24 Enyi Jiang , Gagandeep Singh

Throughout the past five years, the susceptibility of neural networks to minimal adversarial perturbations has moved from a peculiar phenomenon to a core issue in Deep Learning. Despite much attention, however, progress towards more robust…

Machine Learning · Statistics 2019-12-13 Wieland Brendel , Jonas Rauber , Matthias Kümmerer , Ivan Ustyuzhaninov , Matthias Bethge

Backpropagation (BP) remains the dominant and most successful method for training parameters of deep neural network models. However, BP relies on two computationally distinct phases, does not provide a satisfactory explanation of biological…

Machine Learning · Computer Science 2025-11-12 Sander Dalm , Marcel van Gerven , Nasir Ahmad

With the growth of interest in the attack and defense of deep neural networks, researchers are focusing more on the robustness of applying them to devices with limited memory. Thus, unlike adversarial training, which only considers the…

Machine Learning · Computer Science 2021-09-10 Haidong Xie , Lixin Qian , Xueshuang Xiang , Naijin Liu

We use interval reachability analysis to obtain robustness guarantees for implicit neural networks (INNs). INNs are a class of implicit learning models that use implicit equations as layers and have been shown to exhibit several notable…

Machine Learning · Computer Science 2022-04-04 Alexander Davydov , Saber Jafarpour , Matthew Abate , Francesco Bullo , Samuel Coogan

The study of sparsity in Convolutional Neural Networks (CNNs) has become widespread to compress and accelerate models in environments with limited resources. By constraining N consecutive weights along the output channel to be group-wise…

Machine Learning · Computer Science 2023-10-11 Jingyang Xiang , Siqi Li , Jun Chen , Shipeng Bai , Yukai Ma , Guang Dai , Yong Liu

The ever-growing computational demands of increasingly complex machine learning models frequently necessitate the use of powerful cloud-based infrastructure for their training. Binary neural networks are known to be promising candidates for…

The information bottleneck (IB) method is a feasible defense solution against adversarial attacks in deep learning. However, this method suffers from the spurious correlation, which leads to the limitation of its further improvement of…

Machine Learning · Computer Science 2022-10-27 Huan Hua , Jun Yan , Xi Fang , Weiquan Huang , Huilin Yin , Wancheng Ge

It is well-known that recurrent neural networks (RNNs), although widely used, are vulnerable to adversarial attacks including one-frame attacks and multi-frame attacks. Though a few certified defenses exist to provide guaranteed robustness…

Machine Learning · Computer Science 2023-04-18 Yunruo Zhang , Tianyu Du , Shouling Ji , Peng Tang , Shanqing Guo

Pruning methods have shown to be effective at reducing the size of deep neural networks while keeping accuracy almost intact. Among the most effective methods are those that prune a network while training it with a sparsity prior loss and…

Neural and Evolutionary Computing · Computer Science 2019-12-20 Carl Lemaire , Andrew Achkar , Pierre-Marc Jodoin

Binary Neural Networks (BNNs), which constrain both weights and activations to binary values, offer substantial reductions in computational complexity, memory footprint, and energy consumption. These advantages make them particularly well…

Machine Learning · Computer Science 2026-02-18 Luca Colombo , Fabrizio Pittorino , Daniele Zambon , Carlo Baldassi , Manuel Roveri , Cesare Alippi

The robustness of Vision-Language Models (VLMs) such as CLIP is critical for their deployment in safety-critical applications like autonomous driving, healthcare diagnostics, and security systems, where accurate interpretation of visual and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Yuhan Liang , Yijun Li , Yumeng Niu , Qianhe Shen , Hangyu Liu

We focus on the robustness of neural networks for classification. To permit a fair comparison between methods to achieve robustness, we first introduce a standard based on the mensuration of a classifier's degradation. Then, we propose…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Sadaf Gulshad , Arnold Smeulders