English
Related papers

Related papers: Understanding (Non-)Robust Feature Disentanglement…

200 papers

Owing to the susceptibility of deep learning systems to adversarial attacks, there has been a great deal of work in developing (both empirically and certifiably) robust classifiers. While most work has defended against a single type of…

Machine Learning · Computer Science 2020-07-30 Pratyush Maini , Eric Wong , J. Zico Kolter

Deep neural network (DNN) architecture based models have high expressive power and learning capacity. However, they are essentially a black box method since it is not easy to mathematically formulate the functions that are learned within…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Gaurav Goswami , Nalini Ratha , Akshay Agarwal , Richa Singh , Mayank Vatsa

Recently, it has been widely known that deep neural networks are highly vulnerable and easily broken by adversarial attacks. To mitigate the adversarial vulnerability, many defense algorithms have been proposed. Recently, to improve…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Hong Joo Lee , Yong Man Ro

Deep neural networks are vulnerable against adversarial examples. In this paper, we propose to train and test the networks with randomly subsampled images with high drop rates. We show that this approach significantly improves robustness…

Machine Learning · Computer Science 2019-05-02 Hossein Hosseini , Sreeram Kannan , Radha Poovendran

Adversarial training, which is to enhance robustness against adversarial attacks, has received much attention because it is easy to generate human-imperceptible perturbations of data to deceive a given deep neural network. In this paper, we…

Machine Learning · Statistics 2023-06-02 Dongyoon Yang , Insung Kong , Yongdai Kim

Deep Neural Networks (DNNs) are vulnerable to invisible perturbations on the images generated by adversarial attacks, which raises researches on the adversarial robustness of DNNs. A series of methods represented by the adversarial training…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Kun Fang , Qinghua Tao , Yingwen Wu , Tao Li , Jia Cai , Feipeng Cai , Xiaolin Huang , Jie Yang

Neural networks have been shown vulnerable to a variety of adversarial algorithms. A crucial step to understanding the rationale for this lack of robustness is to assess the potential of the neural networks' representation to encode the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Shashank Kotyan , Danilo Vasconcellos Vargas , Moe Matsuki

Causal Neural Network models have shown high levels of robustness to adversarial attacks as well as an increased capacity for generalisation tasks such as few-shot learning and rare-context classification compared to traditional Neural…

Machine Learning · Computer Science 2023-08-22 Preben M. Ness , Dusica Marijan , Sunanda Bose

Adversarial examples are inevitable on the road of pervasive applications of deep neural networks (DNN). Imperceptible perturbations applied on natural samples can lead DNN-based classifiers to output wrong prediction with fair confidence…

Machine Learning · Computer Science 2020-11-04 Tao Bai , Jinqi Luo , Jun Zhao

Lifted neural networks (i.e. neural architectures explicitly optimizing over respective network potentials to determine the neural activities) can be combined with a type of adversarial training to gain robustness for internal as well as…

Machine Learning · Computer Science 2025-03-12 Christopher Zach

Upon the discovery of adversarial attacks, robust models have become obligatory for deep learning-based systems. Adversarial training with first-order attacks has been one of the most effective defenses against adversarial perturbations to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Inci M. Baytas , Debayan Deb

Machine learning and deep learning in particular has been recently used to successfully address many tasks in the domain of code such as finding and fixing bugs, code completion, decompilation, type inference and many others. However, the…

Machine Learning · Computer Science 2020-08-18 Pavol Bielik , Martin Vechev

Adversarial robustness refers to a model's ability to resist perturbation of inputs, while distribution robustness evaluates the performance of the model under data shifts. Although both aim to ensure reliable performance, prior work has…

Machine Learning · Computer Science 2026-01-26 Yipei Wang , Zhaoying Pan , Xiaoqian Wang

In recent years novel architecture components for image classification have been developed, starting with attention and patches used in transformers. While prior works have analyzed the influence of some aspects of architecture components…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Francesco Croce , Matthias Hein

Despite significant advances, deep networks remain highly susceptible to adversarial attack. One fundamental challenge is that small input perturbations can often produce large movements in the network's final-layer feature space. In this…

Machine Learning · Computer Science 2023-04-20 Maria-Florina Balcan , Avrim Blum , Dravyansh Sharma , Hongyang Zhang

Modern deep learning architecture utilize batch normalization (BN) to stabilize training and improve accuracy. It has been shown that the BN layers alone are surprisingly expressive. In the context of robustness against adversarial…

Machine Learning · Computer Science 2022-04-27 Nils Philipp Walter , David Stutz , Bernt Schiele

Neural networks are known to be highly sensitive to adversarial examples. These may arise due to different factors, such as random initialization, or spurious correlations in the learning problem. To better understand these factors, we…

Machine Learning · Statistics 2022-07-05 Elvis Dohmatob , Alberto Bietti

While deep neural networks have been achieving state-of-the-art performance across a wide variety of applications, their vulnerability to adversarial attacks limits their widespread deployment for safety-critical applications. Alongside…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Ahmadreza Jeddi , Mohammad Javad Shafiee , Michelle Karg , Christian Scharfenberger , Alexander Wong

Adversarial Training (AT) with Projected Gradient Descent (PGD) is an effective approach for improving the robustness of the deep neural networks. However, PGD AT has been shown to suffer from two main limitations: i) high computational…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Ahmadreza Jeddi , Mohammad Javad Shafiee , Alexander Wong

This paper proposes an attack-independent (non-adversarial training) technique for improving adversarial robustness of neural network models, with minimal loss of standard accuracy. We suggest creating a neighborhood around each training…

Machine Learning · Computer Science 2021-07-28 Bronya Roni Chernyak , Bhiksha Raj , Tamir Hazan , Joseph Keshet