English
Related papers

Related papers: Towards Understanding Fast Adversarial Training

200 papers

Classifiers trained using conventional empirical risk minimization or maximum likelihood methods are known to suffer dramatic performance degradations when tested over examples adversarially selected based on knowledge of the classifier's…

Machine Learning · Statistics 2018-03-01 Alireza Bagheri , Osvaldo Simeone , Bipin Rajendran

Deep neural networks are vulnerable to adversarial noise. Adversarial Training (AT) has been demonstrated to be the most effective defense strategy to protect neural networks from being fooled. However, we find AT omits to learning robust…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Nuoyan Zhou , Nannan Wang , Decheng Liu , Dawei Zhou , Xinbo Gao

Adversarial training can be used to learn models that are robust against perturbations. For linear models, it can be formulated as a convex optimization problem. Compared to methods proposed in the context of deep learning, leveraging the…

Machine Learning · Statistics 2025-03-20 Antônio H. RIbeiro , Thomas B. Schön , Dave Zahariah , Francis Bach

Following the recent adoption of deep neural networks (DNN) accross a wide range of applications, adversarial attacks against these models have proven to be an indisputable threat. Adversarial samples are crafted with a deliberate intention…

Machine Learning · Computer Science 2017-08-31 Valentina Zantedeschi , Maria-Irina Nicolae , Ambrish Rawat

Adversarial Training (AT) has been found to substantially improve the robustness of deep learning classifiers against adversarial attacks. AT involves obtaining robustness by including adversarial examples in training a classifier. Most…

Machine Learning · Computer Science 2023-07-17 Olukorede Fakorede , Ashutosh Kumar Nirala , Modeste Atsague , Jin Tian

While adversarial training and its variants have shown to be the most effective algorithms to defend against adversarial attacks, their extremely slow training process makes it hard to scale to large datasets like ImageNet. The key idea of…

Machine Learning · Computer Science 2022-06-07 Zhichao Huang , Yanbo Fan , Chen Liu , Weizhong Zhang , Yong Zhang , Mathieu Salzmann , Sabine Süsstrunk , Jue Wang

Adversarial training (AT) is an effective technique for enhancing adversarial robustness, but it usually comes at the cost of a decline in generalization ability. Recent studies have attempted to use clean training to assist adversarial…

Machine Learning · Computer Science 2025-04-02 MingWei Zhou , Xiaobing Pei

Despite the success of convolutional neural networks (CNNs) in many academic benchmarks for computer vision tasks, their application in the real-world is still facing fundamental challenges. One of these open problems is the inherent lack…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Julia Grabinski , Paul Gavrikov , Janis Keuper , Margret Keuper

Adversarial Training is proved to be an efficient method to defend against adversarial examples, being one of the few defenses that withstand strong attacks. However, traditional defense mechanisms assume a uniform attack over the examples…

Machine Learning · Computer Science 2020-10-27 Huimin Zeng , Chen Zhu , Tom Goldstein , Furong Huang

Neural networks are known to be vulnerable to adversarial attacks -- slight but carefully constructed perturbations of the inputs which can drastically impair the network's performance. Many defense methods have been proposed for improving…

Adversarial training shows promise as an approach for training models that are robust towards adversarial perturbation. In this paper, we explore some of the practical challenges of adversarial training. We present a sensitivity analysis…

Machine Learning · Computer Science 2019-05-13 Evelyn Duesterwald , Anupama Murthi , Ganesh Venkataraman , Mathieu Sinn , Deepak Vijaykeerthy

Adversarial attacks, e.g., adversarial perturbations of the input and adversarial samples, pose significant challenges to machine learning and deep learning techniques, including interactive recommendation systems. The latent embedding…

Machine Learning · Computer Science 2021-12-03 Siyu Wang , Yuanjiang Cao , Xiaocong Chen , Lina Yao , Xianzhi Wang , Quan Z. Sheng

Federated learning allows for clients in a distributed system to jointly train a machine learning model. However, clients' models are vulnerable to attacks during the training and testing phases. In this paper, we address the issue of…

Machine Learning · Computer Science 2023-10-24 Taejin Kim , Shubhranshu Singh , Nikhil Madaan , Carlee Joe-Wong

Adversarial training is a method for enhancing neural networks to improve the robustness against adversarial examples. Besides the security concerns of potential adversarial examples, adversarial training can also improve the generalization…

Machine Learning · Computer Science 2022-12-21 Zhiyuan Zhang , Wei Li , Ruihan Bao , Keiko Harimoto , Yunfang Wu , Xu Sun

Vision Transformers (ViTs) have recently achieved competitive performance in broad vision tasks. Unfortunately, on popular threat models, naturally trained ViTs are shown to provide no more adversarial robustness than convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Yichuan Mo , Dongxian Wu , Yifei Wang , Yiwen Guo , Yisen Wang

We revisit the concept of "adversary" in online learning, motivated by solving robust optimization and adversarial training using online learning methods. While one of the classical setups in online learning deals with the "adversarial"…

Machine Learning · Computer Science 2021-01-28 Sebastian Pokutta , Huan Xu

In this paper, we study the adversarial examples existence and adversarial training from the standpoint of convergence and provide evidence that pointwise convergence in ANNs can explain these observations. The main contribution of our…

Machine Learning · Computer Science 2022-05-27 Ramin Barati , Reza Safabakhsh , Mohammad Rahmati

Adversarial training is a training scheme designed to counter adversarial attacks by augmenting the training dataset with adversarial examples. Surprisingly, several studies have observed that loss gradients from adversarially trained DNNs…

Machine Learning · Computer Science 2019-04-22 Beomsu Kim , Junghoon Seo , Taegyun Jeon

Adversarial training (AT) has been demonstrated to be effective in improving model robustness by leveraging adversarial examples for training. However, most AT methods are in face of expensive time and computational cost for calculating…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Xiaojun Jia , Yong Zhang , Baoyuan Wu , Jue Wang , Xiaochun Cao

Adversarial training is one of the most powerful methods to improve the robustness of pre-trained language models (PLMs). However, this approach is typically more expensive than traditional fine-tuning because of the necessity to generate…

Computation and Language · Computer Science 2022-12-01 Zhiheng Xi , Rui Zheng , Tao Gui , Qi Zhang , Xuanjing Huang
‹ Prev 1 8 9 10 Next ›