English
Related papers

Related papers: Improving Fast Adversarial Training via Self-Knowl…

200 papers

Classifiers fail to classify correctly input images that have been purposefully and imperceptibly perturbed to cause misclassification. This susceptability has been shown to be consistent across classifiers, regardless of their type,…

Machine Learning · Computer Science 2018-12-11 Blerta Lindqvist , Shridatt Sugrim , Rauf Izmailov

Adversarial training (AT) is one of the most effective strategies for promoting model robustness. However, recent benchmarks show that most of the proposed improvements on AT are less effective than simply early stopping the training…

Machine Learning · Computer Science 2021-04-01 Tianyu Pang , Xiao Yang , Yinpeng Dong , Hang Su , Jun Zhu

Adversarial attacks pose significant challenges for vision models in critical fields like healthcare, where reliability is essential. Although adversarial training has been well studied in natural images, its application to biomedical and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Hashmat Shadab Malik , Shahina Kunhimon , Muzammal Naseer , Fahad Shahbaz Khan , Salman Khan

Despite federated learning endows distributed clients with a cooperative training mode under the premise of protecting data privacy and security, the clients are still vulnerable when encountering adversarial samples due to the lack of…

Machine Learning · Computer Science 2021-10-29 Shuang Luo , Didi Zhu , Zexi Li , Chao Wu

State-of-the-art classifiers have been shown to be largely vulnerable to adversarial perturbations. One of the most effective strategies to improve robustness is adversarial training. In this paper, we investigate the effect of adversarial…

Machine Learning · Computer Science 2018-11-27 Seyed-Mohsen Moosavi-Dezfooli , Alhussein Fawzi , Jonathan Uesato , Pascal Frossard

Generative adversarial networks have achieved remarkable performance on various tasks but suffer from training instability. Despite many training strategies proposed to improve training stability, this issue remains as a challenge. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Faqiang Liu , Mingkun Xu , Guoqi Li , Jing Pei , Luping Shi , Rong Zhao

Deep neural networks are susceptible to adversarial examples, posing a significant security risk in critical applications. Adversarial Training (AT) is a well-established technique to enhance adversarial robustness, but it often comes at…

Machine Learning · Computer Science 2023-08-08 Kaijie Zhu , Jindong Wang , Xixu Hu , Xing Xie , Ge Yang

Gradient-based saliency methods such as Vanilla Gradient (VG) and Integrated Gradients (IG) are widely used to explain image classifiers, yet the resulting maps are often noisy and unstable, limiting their usefulness in high-stakes…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Dipkamal Bhusal , Md Tanvirul Alam , Nidhi Rastogi

Machine-learning models demand periodic updates to improve their average accuracy, exploiting novel architectures and additional data. However, a newly updated model may commit mistakes the previous model did not make. Such…

Machine Learning · Computer Science 2025-05-30 Daniele Angioni , Luca Demetrio , Maura Pintor , Luca Oneto , Davide Anguita , Battista Biggio , Fabio Roli

Adversarial training, as one of the most effective defense methods against adversarial attacks, tends to learn an inclusive decision boundary to increase the robustness of deep learning models. However, due to the large and unnecessary…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Xiaoyu Liang , Yaguan Qian , Jianchang Huang , Xiang Ling , Bin Wang , Chunming Wu , Wassim Swaileh

Alignment methodologies have emerged as a critical pathway for enhancing language model alignment capabilities. While SFT (supervised fine-tuning) accelerates convergence through direct token-level loss intervention, its efficacy is…

Some of the most popular methods for improving the stability and performance of GANs involve constraining or regularizing the discriminator. In this paper we consider a largely overlooked regularization technique which we refer to as the…

Machine Learning · Computer Science 2020-12-10 Andreas Munk , William Harvey , Frank Wood

Recent studies demonstrate that Graph Neural Networks (GNNs) are vulnerable to slight but adversarially designed perturbations, known as adversarial examples. To address this issue, robust training methods against adversarial examples have…

Machine Learning · Computer Science 2022-11-22 Jintang Li , Jiaying Peng , Liang Chen , Zibin Zheng , Tingting Liang , Qing Ling

Federated learning (FL) has attracted increasing attention in recent years. As a privacy-preserving collaborative learning paradigm, it enables a broader range of applications, especially for computer vision and natural language processing…

Machine Learning · Computer Science 2020-11-24 Yilun Lin , Chaochao Chen , Cen Chen , Li Wang

Adversarial training has been shown to be one of the most effective approaches to improve the robustness of deep neural networks. It is formalized as a min-max optimization over model weights and adversarial perturbations, where the weights…

Machine Learning · Computer Science 2022-03-14 Gaojie Jin , Xinping Yi , Wei Huang , Sven Schewe , Xiaowei Huang

Deep learning achieves state-of-the-art performance in many tasks but exposes to the underlying vulnerability against adversarial examples. Across existing defense techniques, adversarial training with the projected gradient decent attack…

Cryptography and Security · Computer Science 2022-10-04 Tianjin Huang , Vlado Menkovski , Yulong Pei , Mykola Pechenizkiy

While adversarial training and its variants have shown to be the most effective algorithms to defend against adversarial attacks, their extremely slow training process makes it hard to scale to large datasets like ImageNet. The key idea of…

Machine Learning · Computer Science 2022-06-07 Zhichao Huang , Yanbo Fan , Chen Liu , Weizhong Zhang , Yong Zhang , Mathieu Salzmann , Sabine Süsstrunk , Jue Wang

Machine learning algorithms with empirical risk minimization are vulnerable under distributional shifts due to the greedy adoption of all the correlations found in training data. There is an emerging literature on tackling this problem by…

Machine Learning · Computer Science 2022-11-22 Jiashuo Liu , Zheyan Shen , Peng Cui , Linjun Zhou , Kun Kuang , Bo Li

Adversarial training has shown promise in building robust models against adversarial examples. A major drawback of adversarial training is the computational overhead introduced by the generation of adversarial examples. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Xiaojun Jia , Jianshu Li , Jindong Gu , Yang Bai , Xiaochun Cao

Vision Transformer (ViT) models have achieved remarkable performance across various vision tasks, with scalability being a key advantage when applied to large datasets. This scalability enables ViT models to exhibit strong generalization…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Wenyun Li , Zheng Zhang , Dongmei Jiang , Yaowei Wang , Xiangyuan Lan