English
Related papers

Related papers: Wavelet Regularization Benefits Adversarial Traini…

200 papers

Adversarial training has become the primary method to defend against adversarial samples. However, it is hard to practically apply due to many shortcomings. One of the shortcomings of adversarial training is that it will reduce the…

Machine Learning · Computer Science 2021-08-31 Zhishen Nie , Ying Lin , Sp Ren , Lan Zhang

In recent years, there has been an explosion of research into developing more robust deep neural networks against adversarial examples. Adversarial training appears as one of the most successful methods. To deal with both the robustness…

Machine Learning · Computer Science 2023-03-21 Gaojie Jin , Xinping Yi , Dengyu Wu , Ronghui Mu , Xiaowei Huang

Adversarial examples pose a unique challenge for deep learning systems. Despite recent advances in both attacks and defenses, there is still a lack of clarity and consensus in the community about the true nature and underlying properties of…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Shishira R Maiya , Max Ehrlich , Vatsal Agarwal , Ser-Nam Lim , Tom Goldstein , Abhinav Shrivastava

In this work, we describe a new approach that uses deep neural networks (DNN) to obtain regularization parameters for solving inverse problems. We consider a supervised learning approach, where a network is trained to approximate the…

Numerical Analysis · Mathematics 2021-04-15 Babak Maboudi Afkham , Julianne Chung , Matthias Chung

Despite remarkable achievements in deep learning across various domains, its inherent vulnerability to adversarial examples still remains a critical concern for practical deployment. Adversarial training has emerged as one of the most…

Machine Learning · Computer Science 2024-11-06 Junhao Dong , Xinghua Qu , Z. Jane Wang , Yew-Soon Ong

Adversarial training is one of the strongest defenses against adversarial attacks, but it requires adversarial examples to be generated for every mini-batch during optimization. The expense of producing these examples during training often…

Machine Learning · Computer Science 2019-10-28 Ali Shafahi , Amin Ghiasi , Furong Huang , Tom Goldstein

Enhancing our understanding of adversarial examples is crucial for the secure application of machine learning models in real-world scenarios. A prevalent method for analyzing adversarial examples is through a frequency-based approach.…

Machine Learning · Computer Science 2024-04-17 Zhun Zhang , Yi Zeng , Qihe Liu , Shijie Zhou

It is well-known that the performance of well-trained deep neural networks may degrade significantly when they are applied to data with even slightly shifted distributions. Recent studies have shown that introducing certain perturbation on…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Yabin Zhang , Bin Deng , Ruihuang Li , Kui Jia , Lei Zhang

Deep neural networks have presented impressive performance in biometric applications. However, their performance is highly at risk when facing carefully crafted input samples known as adversarial examples. In this paper, we present three…

Computer Vision and Pattern Recognition · Computer Science 2019-08-09 Sobhan Soleymani , Ali Dabouei , Jeremy Dawson , Nasser M. Nasrabadi

Adversarial training (AT) is proved to reliably improve network's robustness against adversarial data. However, current AT with a pre-specified perturbation budget has limitations in learning a robust network. Firstly, applying a…

Machine Learning · Computer Science 2022-10-05 Chaojian Yu , Dawei Zhou , Li Shen , Jun Yu , Bo Han , Mingming Gong , Nannan Wang , Tongliang Liu

With the widespread use of machine learning, concerns over its security and reliability have become prevalent. As such, many have developed defenses to harden neural networks against adversarial examples, imperceptibly perturbed inputs that…

Machine Learning · Computer Science 2022-05-09 Pratik Vaishnavi , Kevin Eykholt , Amir Rahmati

Adversarial training is a defense technique that improves adversarial robustness of a deep neural network (DNN) by including adversarial examples in the training data. In this paper, we identify an overlooked problem of adversarial training…

Machine Learning · Computer Science 2020-09-24 Wonseok Lee , Hanbit Lee , Sang-goo Lee

Powerful deep neural networks are vulnerable to adversarial attacks. To obtain adversarially robust models, researchers have separately developed adversarial training and Jacobian regularization techniques. There are abundant theoretical…

Machine Learning · Statistics 2024-12-18 Dongya Wu , Xin Li

While adversarial training is generally used as a defense mechanism, recent works show that it can also act as a regularizer. By co-training a neural network on clean and adversarial inputs, it is possible to improve classification accuracy…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Sylvestre-Alvise Rebuffi , Francesco Croce , Sven Gowal

Generative Adversarial Networks (GANs) have been widely applied in different scenarios thanks to the development of deep neural networks. The original GAN was proposed based on the non-parametric assumption of the infinite capacity of…

Machine Learning · Computer Science 2022-11-04 Ziqiang Li , Muhammad Usman , Rentuo Tao , Pengfei Xia , Chaoyue Wang , Huanhuan Chen , Bin Li

Despite numerous attempts sought to provide empirical evidence of adversarial regularization outperforming sole supervision, the theoretical understanding of such phenomena remains elusive. In this study, we aim to resolve whether…

Machine Learning · Computer Science 2020-10-02 Litu Rout

Deep learning methods have shown impressive results for a variety of medical problems over the last few years. However, datasets tend to be small due to time-consuming annotation. As datasets with different patients are often very…

Computer Vision and Pattern Recognition · Computer Science 2018-05-17 Nils Gessert , Markus Heyder , Sarah Latus , David M. Leistner , Youssef S. Abdelwahed , Matthias Lutz , Alexander Schlaefer

In this paper, we propose a novel method, IB-RAR, which uses Information Bottleneck (IB) to strengthen adversarial robustness for both adversarial training and non-adversarial-trained methods. We first use the IB theory to build…

Machine Learning · Computer Science 2023-06-01 Xiaoyun Xu , Guilherme Perin , Stjepan Picek

Supervised learning methods trained with maximum likelihood objectives often overfit on training data. Most regularizers that prevent overfitting look to increase confidence on additional examples (e.g., data augmentation, adversarial…

Machine Learning · Computer Science 2022-06-06 Amrith Setlur , Benjamin Eysenbach , Virginia Smith , Sergey Levine

The deep neural networks are known to be vulnerable to well-designed adversarial attacks. The most successful defense technique based on adversarial training (AT) can achieve optimal robustness against particular attacks but cannot…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Guang Lin , Chao Li , Jianhai Zhang , Toshihisa Tanaka , Qibin Zhao