English
Related papers

Related papers: Bridging the Performance Gap between FGSM and PGD …

200 papers

Deep learning models have achieved state-of-the-art performances in various domains, while they are vulnerable to the inputs with well-crafted but small perturbations, which are named after adversarial examples (AEs). Among many strategies…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Huihui Gong

Projected Gradient Descent (PGD) is a strong and widely used first-order adversarial attack, yet its computational cost scales poorly, as all training samples undergo identical iterative inner-loop optimization despite contributing…

Machine Learning · Computer Science 2025-12-29 Youran Ye , Dejin Wang , Ajinkya Bhandare

Adversarial training, especially projected gradient descent (PGD), has proven to be a successful approach for improving robustness against adversarial attacks. After adversarial training, gradients of models with respect to their inputs…

Machine Learning · Statistics 2023-04-21 Ricardo Bigolin Lanfredi , Joyce D. Schroeder , Tolga Tasdizen

Distributed learning is an effective approach to accelerate model training using multiple workers. However, substantial communication delays emerge between workers and a parameter server due to massive costs associated with communicating…

Machine Learning · Computer Science 2024-02-05 Chanho Park , Namyoon Lee

We investigate adversarial-sample generation methods from a frequency domain perspective and extend standard $l_{\infty}$ Projected Gradient Descent (PGD) to the frequency domain. The resulting method, which we call Spectral Projected…

Machine Learning · Computer Science 2020-10-14 Hans Shih-Han Wang , Cory Cornelius , Brandon Edwards , Jason Martin

Generating adversarial examples at scale is a core primitive for robustness evaluation, adversarial training, and red-teaming, yet even "fast" attacks such as FGSM remain throughput-limited by the cost of a backward pass. We introduce a…

Machine Learning · Computer Science 2026-05-15 Kamil Ciosek , Aleksandr V. Petrov , Nicolò Felicioni , Konstantina Palla

Adversarial training is one of the most effective approaches to improve model robustness against adversarial examples. However, previous works mainly focus on the overall robustness of the model, and the in-depth analysis on the role of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Qi Tian , Kun Kuang , Kelu Jiang , Fei Wu , Yisen Wang

Adversarial noise introduces small perturbations in images, misleading deep learning models into misclassification and significantly impacting recognition accuracy. In this study, we analyzed the effects of Fast Gradient Sign Method (FGSM)…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Manish Kansana , Keyan Alexander Rahimi , Elias Hossain , Iman Dehzangi , Noorbakhsh Amiri Golilarz

In recent years, neural networks have demonstrated outstanding effectiveness in a large amount of applications.However, recent works have shown that neural networks are susceptible to adversarial examples, indicating possible flaws…

Machine Learning · Computer Science 2018-06-08 Fuxun Yu , Zirui Xu , Yanzhi Wang , Chenchen Liu , Xiang Chen

This paper presents GReAT (Graph Regularized Adversarial Training), a novel regularization method designed to enhance the robust classification performance of deep learning models. Adversarial examples, characterized by subtle perturbations…

Machine Learning · Computer Science 2024-05-06 Samet Bayram , Kenneth Barner

Despite recent success on various tasks, deep learning techniques still perform poorly on adversarial examples with small perturbations. While optimization-based methods for adversarial attacks are well-explored in the field of computer…

Computation and Language · Computer Science 2023-06-09 Lifan Yuan , Yichi Zhang , Yangyi Chen , Wei Wei

Automatic speech recognition (ASR) systems based on deep neural networks are weak against adversarial perturbations. We propose mixPGD adversarial training method to improve the robustness of the model for ASR systems. In standard…

Sound · Computer Science 2023-03-13 Aminul Huq , Weiyi Zhang , Xiaolin Hu

A recent line of work focused on making adversarial training computationally efficient for deep learning models. In particular, Wong et al. (2020) showed that $\ell_\infty$-adversarial training with fast gradient sign method (FGSM) can fail…

Machine Learning · Computer Science 2020-10-27 Maksym Andriushchenko , Nicolas Flammarion

Generating adversarial examples (AEs) can be formulated as an optimization problem. Among various optimization-based attacks, the gradient-based PGD and the momentum-based MI-FGSM have garnered considerable interest. However, all these…

Machine Learning · Computer Science 2025-12-17 Wei Tao , Sheng Long , Xin Liu , Wei Li , Qing Tao

Whereas adversarial training can be useful against specific adversarial perturbations, they have also proven ineffective in generalizing towards attacks deviating from those used for training. However, we observe that this ineffectiveness…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Tianyue Zheng , Zhe Chen , Shuya Ding , Chao Cai , Jun Luo

The reliance on deep learning algorithms has grown significantly in recent years. Yet, these models are highly vulnerable to adversarial attacks, which introduce visually imperceptible perturbations into testing data to induce…

Machine Learning · Computer Science 2019-06-14 Rajeev Sahay , Rehana Mahfuz , Aly El Gamal

Deep learning models are vulnerable to adversarial examples crafted by applying human-imperceptible perturbations on benign inputs. However, under the black-box setting, most existing adversaries often have a poor transferability to attack…

Machine Learning · Computer Science 2020-02-04 Jiadong Lin , Chuanbiao Song , Kun He , Liwei Wang , John E. Hopcroft

Deep neural networks continue to awe the world with their remarkable performance. Their predictions, however, are prone to be corrupted by adversarial examples that are imperceptible to humans. Current efforts to improve the robustness of…

Machine Learning · Computer Science 2021-08-11 Jisoo Mok , Byunggook Na , Hyeokjun Choe , Sungroh Yoon

Deep neural networks are vulnerable to adversarial examples, which are crafted by adding small, human-imperceptible perturbations to the original images, but make the model output inaccurate predictions. Before deep neural networks are…

Computer Vision and Pattern Recognition · Computer Science 2021-01-13 Bo Yang , Kaiyong Xu , Hengjun Wang , Hengwei Zhang

Deep neural network-based image classifications are vulnerable to adversarial perturbations. The image classifications can be easily fooled by adding artificial small and imperceptible perturbations to input images. As one of the most…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Jindong Gu , Hengshuang Zhao , Volker Tresp , Philip Torr