English
Related papers

Related papers: Attacking Transformers with Feature Diversity Adve…

200 papers

Transformers have emerged as a competitive alternative to convnets in vision tasks, yet they lack the architectural inductive bias of convnets, which may hinder their potential performance. Specifically, Vision Transformers (ViTs) are not…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Hagay Michaeli , Daniel Soudry

Deep networks are highly vulnerable to adversarial attacks, yet conventional attack methods utilize static adversarial perturbations that induce fixed mispredictions. In this work, we exploit an overlooked property of adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yaoteng Tan , Zikui Cai , M. Salman Asif

Adversarial attacks have threatened the application of deep neural networks in security-sensitive scenarios. Most existing black-box attacks fool the target model by interacting with it many times and producing global perturbations.…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Tao Xiang , Hangcheng Liu , Shangwei Guo , Tianwei Zhang , Xiaofeng Liao

Adversarial attacks with improved transferability - the ability of an adversarial example crafted on a known model to also fool unknown models - have recently received much attention due to their practicality. Nevertheless, existing…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Woo Jae Kim , Seunghoon Hong , Sung-Eui Yoon

Vision transformers (ViTs) have recently set off a new wave in neural architecture design thanks to their record-breaking performance in various vision tasks. In parallel, to fulfill the goal of deploying ViTs into real-world vision…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yonggan Fu , Shunyao Zhang , Shang Wu , Cheng Wan , Yingyan Celine Lin

Deep learning models often rely only on a small set of features even when there is a rich set of predictive signals in the training data. This makes models brittle and sensitive to distribution shifts. In this work, we first examine vision…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Armand Mihai Nicolicioiu , Andrei Liviu Nicolicioiu , Bogdan Alexe , Damien Teney

Previous works on multi-label image recognition (MLIR) usually use CNNs as a starting point for research. In this paper, we take pure Vision Transformer (ViT) as the research base and make full use of the advantages of Transformer with…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Yunqing Hu , Xuan Jin , Yin Zhang , Haiwen Hong , Jingfeng Zhang , Feihu Yan , Yuan He , Hui Xue

Many recent studies have shown that deep neural models are vulnerable to adversarial samples: images with imperceptible perturbations, for example, can fool image classifiers. In this paper, we present the first type-specific approach to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Omid Mohamad Nezami , Akshay Chaturvedi , Mark Dras , Utpal Garain

Deep Neural Networks can be easily fooled by small and imperceptible perturbations. The query-based black-box attack (QBBA) is able to create the perturbations using model output probabilities of image queries requiring no access to the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Jindong Gu , Fangyun Wei , Philip Torr , Han Hu

The transferability of adversarial examples is a key issue in the security of deep neural networks. The possibility of an adversarial example crafted for a source model fooling another targeted model makes the threat of adversarial attacks…

Cryptography and Security · Computer Science 2023-07-18 Thibault Maho , Seyed-Mohsen Moosavi-Dezfooli , Teddy Furon

Vision Transformers (ViTs) have outperformed traditional Convolutional Neural Networks (CNN) across various computer vision tasks. However, akin to CNN, ViTs are vulnerable to backdoor attacks, where the adversary embeds the backdoor into…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Ji Guo , Hongwei Li , Wenbo Jiang , Guoming Lu

With the advancement of vision transformers (ViTs) and self-supervised learning (SSL) techniques, pre-trained large ViTs have become the new foundation models for computer vision applications. However, studies have shown that, like…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Weijie Zheng , Xingjun Ma , Hanxun Huang , Zuxuan Wu , Yu-Gang Jiang

Adversarial transferability enables black-box attacks on unknown victim deep neural networks (DNNs), rendering attacks viable in real-world scenarios. Current transferable attacks create adversarial perturbation over the entire image,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Shangbo Wu , Yu-an Tan , Yajie Wang , Ruinan Ma , Wencong Ma , Yuanzhang Li

Vision Transformers (ViTs) that leverage self-attention mechanism have shown superior performance on many classical vision tasks compared to convolutional neural networks (CNNs) and gain increasing popularity recently. Existing ViTs works…

Cryptography and Security · Computer Science 2024-04-29 Xinghua Xue , Cheng Liu , Ying Wang , Bing Yang , Tao Luo , Lei Zhang , Huawei Li , Xiaowei Li

Foundation models represent the most prominent and recent paradigm shift in artificial intelligence. Foundation models are large models, trained on broad data that deliver high accuracy in many downstream tasks, often without fine-tuning.…

Cryptography and Security · Computer Science 2025-09-15 Hondamunige Prasanna Silva , Federico Becattini , Lorenzo Seidenari

Adversarial training (AT) can help improve the robustness of Vision Transformers (ViT) against adversarial attacks by intentionally injecting adversarial examples into the training data. However, this way of adversarial injection inevitably…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Fudong Lin , Jiadong Lou , Xu Yuan , Nian-Feng Tzeng

The literature on adversarial attacks in computer vision typically focuses on pixel-level perturbations. These tend to be very difficult to interpret. Recent work that manipulates the latent representations of image generators to create…

Machine Learning · Computer Science 2023-09-12 Stephen Casper , Max Nadeau , Dylan Hadfield-Menell , Gabriel Kreiman

Ensemble-based attacks have been proven to be effective in enhancing adversarial transferability by aggregating the outputs of models with various architectures. However, existing research primarily focuses on refining ensemble weights or…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Hanwen Cao , Haobo Lu , Xiaosen Wang , Kun He

Vision Transformer (ViT) has recently demonstrated promise in computer vision problems. However, unlike Convolutional Neural Networks (CNN), it is known that the performance of ViT saturates quickly with depth increasing, due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Peihao Wang , Wenqing Zheng , Tianlong Chen , Zhangyang Wang

Vision Transformers (ViTs) have achieved record-breaking performance in various visual tasks. However, concerns about their robustness against backdoor attacks have grown. Backdoor attacks involve associating a specific trigger with a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Deng Siqin , Zhou Xiaoyi