English
Related papers

Related papers: Over-parameterization and Adversarial Robustness i…

200 papers

Deep neural networks have been widely deployed in various machine learning tasks. However, recent works have demonstrated that they are vulnerable to adversarial examples: carefully crafted small perturbations to cause misclassification by…

Machine Learning · Computer Science 2019-03-01 Ke Sun , Zhanxing Zhu , Zhouchen Lin

Learning-based pattern classifiers, including deep networks, have shown impressive performance in several application domains, ranging from computer vision to cybersecurity. However, it has also been shown that adversarial input…

Computer Vision and Pattern Recognition · Computer Science 2018-07-24 Battista Biggio , Fabio Roli

Adversarial attack research in natural language processing (NLP) has made significant progress in designing powerful attack methods and defence approaches. However, few efforts have sought to identify which source samples are the most…

Computation and Language · Computer Science 2023-06-26 Vyas Raina , Mark Gales

Most machine learning classifiers, including deep neural networks, are vulnerable to adversarial examples. Such inputs are typically generated by adding small but purposeful modifications that lead to incorrect outputs while imperceptible…

Machine Learning · Computer Science 2017-09-28 Beilun Wang , Ji Gao , Yanjun Qi

Overparameterized neural networks enjoy great representation power on complex data, and more importantly yield sufficiently smooth output, which is crucial to their generalization and robustness. Most existing function approximation…

Machine Learning · Statistics 2022-06-10 Hao Liu , Minshuo Chen , Siawpeng Er , Wenjing Liao , Tong Zhang , Tuo Zhao

The reliability of deep learning algorithms is fundamentally challenged by the existence of adversarial examples, which are incorrectly classified inputs that are extremely close to a correctly classified input. We explore the properties of…

Machine Learning · Statistics 2021-07-23 Giacomo De Palma , Bobak T. Kiani , Seth Lloyd

To evaluate the robustness gain of Bayesian neural networks on image classification tasks, we perform input perturbations, and adversarial attacks to the state-of-the-art Bayesian neural networks, with a benchmark CNN model as reference.…

Machine Learning · Computer Science 2021-06-18 Yutian Pang , Sheng Cheng , Jueming Hu , Yongming Liu

Deep neural networks are easily misled by adversarial examples. Although lots of defense methods are proposed, many of them are demonstrated to lose effectiveness when against properly performed adaptive attacks. How to evaluate the…

Cryptography and Security · Computer Science 2021-01-08 Pengfei Xia , Ziqiang Li , Hongjing Niu , Bin Li

In this paper we aim to explore the general robustness of neural network classifiers by utilizing adversarial as well as natural perturbations. Different from previous works which mainly focus on studying the robustness of neural networks…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Sadaf Gulshad , Jan Hendrik Metzen , Arnold Smeulders

Neural network pruning has shown to be an effective technique for reducing the network size, trading desirable properties like generalization and robustness to adversarial attacks for higher sparsity. Recent work has claimed that…

Machine Learning · Computer Science 2023-10-13 Giorgio Piras , Maura Pintor , Ambra Demontis , Battista Biggio

Adversarial training can considerably robustify deep neural networks to resist adversarial attacks. However, some works suggested that adversarial training might comprise the privacy-preserving and generalization abilities. This paper…

Machine Learning · Computer Science 2020-12-29 Fengxiang He , Shaopeng Fu , Bohan Wang , Dacheng Tao

Vulnerability to adversarial attacks is one of the principal hurdles to the adoption of deep learning in safety-critical applications. Despite significant efforts, both practical and theoretical, training deep learning models robust to…

Machine Learning · Computer Science 2024-02-29 Luca Bortolussi , Ginevra Carbone , Luca Laurenti , Andrea Patane , Guido Sanguinetti , Matthew Wicker

The increasing size of Deep Neural Networks (DNNs) poses a pressing need for model compression, particularly when employed on resource constrained devices. Concurrently, the susceptibility of DNNs to adversarial attacks presents another…

Machine Learning · Computer Science 2023-08-17 Brijesh Vora , Kartik Patwari , Syed Mahbub Hafiz , Zubair Shafiq , Chen-Nee Chuah

Robustness of machine learning models is critical for security related applications, where real-world adversaries are uniquely focused on evading neural network based detectors. Prior work mainly focus on crafting adversarial examples (AEs)…

Machine Learning · Computer Science 2021-11-01 Ecenaz Erdemir , Jeffrey Bickford , Luca Melis , Sergul Aydore

Over the past decade, there has been extensive research aimed at enhancing the robustness of neural networks, yet this problem remains vastly unsolved. Here, one major impediment has been the overestimation of the robustness of new defense…

Artificial Intelligence · Computer Science 2023-10-31 Leo Schwinn , David Dobre , Stephan Günnemann , Gauthier Gidel

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

Machine Learning · Computer Science 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

In learning problems, the noise inherent to the task at hand hinders the possibility to infer without a certain degree of uncertainty. Quantifying this uncertainty, regardless of its wide use, assumes high relevance for security-sensitive…

We identify three common cases that lead to overestimation of adversarial accuracy against bounded first-order attack methods, which is popularly used as a proxy for adversarial robustness in empirical studies. For each case, we propose…

Machine Learning · Computer Science 2020-06-03 Kyungmi Lee , Anantha P. Chandrakasan

Deep Neural Networks are vulnerable to adversarial attacks. Among many defense strategies, adversarial training with untargeted attacks is one of the most effective methods. Theoretically, adversarial perturbation in untargeted attacks can…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Pengyue Hou , Jie Han , Xingyu Li

Transfer learning is a widely-used paradigm in deep learning, where models pre-trained on standard datasets can be efficiently adapted to downstream tasks. Typically, better pre-trained models yield better transfer results, suggesting that…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Hadi Salman , Andrew Ilyas , Logan Engstrom , Ashish Kapoor , Aleksander Madry