English
Related papers

Related papers: Adversarial Token Attacks on Vision Transformers

200 papers

This work does not introduce a new method. Instead, we present an interesting finding that questions the necessity of the inductive bias of locality in modern computer vision architectures. Concretely, we find that vanilla Transformers can…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Duy-Kien Nguyen , Mahmoud Assran , Unnat Jain , Martin R. Oswald , Cees G. M. Snoek , Xinlei Chen

Despite the success of convolutional neural networks (CNNs) in many academic benchmarks for computer vision tasks, their application in the real-world is still facing fundamental challenges. One of these open problems is the inherent lack…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Julia Grabinski , Paul Gavrikov , Janis Keuper , Margret Keuper

Adversarial examples raise questions about whether neural network models are sensitive to the same visual features as humans. In this paper, we first detect adversarial examples or otherwise corrupted images based on a class-conditional…

Machine Learning · Computer Science 2020-02-19 Yao Qin , Nicholas Frosst , Sara Sabour , Colin Raffel , Garrison Cottrell , Geoffrey Hinton

Vision transformers (ViTs) have demonstrated impressive performance in various computer vision tasks. However, the adversarial examples generated by ViTs are challenging to transfer to other networks with different structures. Recent attack…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Huipeng Zhou , Yu-an Tan , Yajie Wang , Haoran Lyu , Shangbo Wu , Yuanzhang Li

Adversarial training has been demonstrated to be one of the most effective remedies for defending adversarial examples, yet it often suffers from the huge robustness generalization gap on unseen testing adversaries, deemed as the…

Machine Learning · Computer Science 2023-03-13 Aishan Liu , Shiyu Tang , Siyuan Liang , Ruihao Gong , Boxi Wu , Xianglong Liu , Dacheng Tao

Vision transformer has demonstrated promising performance on challenging computer vision tasks. However, directly training the vision transformers may yield unstable and sub-optimal results. Recent works propose to improve the performance…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Chengyue Gong , Dilin Wang , Meng Li , Vikas Chandra , Qiang Liu

Since their inception, Vision Transformers (ViTs) have emerged as a compelling alternative to Convolutional Neural Networks (CNNs) across a wide spectrum of tasks. ViTs exhibit notable characteristics, including global attention, resilience…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Hanan Gani , Nada Saadi , Noor Hussein , Karthik Nandakumar

Adversarial transferability remains a critical challenge in evaluating the robustness of deep neural networks. In security-critical applications, transferability enables black-box attacks without access to model internals, making it a key…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Amira Guesmi , Bassem Ouni , Muhammad Shafique

While deep convolutional neural networks (CNNs) are vulnerable to adversarial attacks, considerably few efforts have been paid to construct robust deep tracking algorithms against adversarial attacks. Current studies on adversarial attack…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Shuai Jia , Chao Ma , Yibing Song , Xiaokang Yang

Convolutional Neural networks (CNN) have been the first choice of paradigm in many computer vision applications. The convolution operation however has a significant weakness which is it only operates on a local neighborhood of pixels, thus…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Michael Yang

Following their success in visual recognition tasks, Vision Transformers(ViTs) are being increasingly employed for image restoration. As a few recent works claim that ViTs for image classification also have better robustness properties, we…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Shashank Agnihotri , Kanchana Vaishnavi Gandikota , Julia Grabinski , Paramanand Chandramouli , Margret Keuper

Deep neural networks (DNNs) are well known to be vulnerable to adversarial examples (AEs). In addition, AEs have adversarial transferability, which means AEs generated for a source model can fool another black-box model (target model) with…

Cryptography and Security · Computer Science 2024-01-08 Ryota Iijima , Sayaka Shiota , Hitoshi Kiya

Vision transformers (ViTs) have been successfully applied in image classification tasks recently. In this paper, we show that, unlike convolution neural networks (CNNs)that can be improved by stacking more convolutional layers, the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Daquan Zhou , Bingyi Kang , Xiaojie Jin , Linjie Yang , Xiaochen Lian , Zihang Jiang , Qibin Hou , Jiashi Feng

Convolutional neural network-based medical image classifiers have been shown to be especially susceptible to adversarial examples. Such instabilities are likely to be unacceptable in the future of automated diagnoses. Though statistical…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Isaac Wasserman

Vision Transformers (ViT) have shown their competitive advantages performance-wise compared to convolutional neural networks (CNNs) though they often come with high computational costs. To this end, previous methods explore different…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Cong Wei , Brendan Duke , Ruowei Jiang , Parham Aarabi , Graham W. Taylor , Florian Shkurti

Foundation models represent the most prominent and recent paradigm shift in artificial intelligence. Foundation models are large models, trained on broad data that deliver high accuracy in many downstream tasks, often without fine-tuning.…

Cryptography and Security · Computer Science 2025-09-15 Hondamunige Prasanna Silva , Federico Becattini , Lorenzo Seidenari

Robustness of huge Transformer-based models for natural language processing is an important issue due to their capabilities and wide adoption. One way to understand and improve robustness of these models is an exploration of an adversarial…

Adversarial attack methods have demonstrated the fragility of deep neural networks. Their imperceptible perturbations are frequently able fool classifiers into potentially dangerous misclassifications. We propose a novel way to interpret…

Machine Learning · Computer Science 2018-03-22 Joachim Folz , Sebastian Palacio , Joern Hees , Damian Borth , Andreas Dengel

Recently, it has been shown that, in spite of the significant performance of deep neural networks in different fields, those are vulnerable to adversarial examples. In this paper, we propose a gradient-based adversarial attack against…

Computation and Language · Computer Science 2022-03-14 Sahar Sadrizadeh , Ljiljana Dolamic , Pascal Frossard

Recent work has shown that self-attention can serve as a basic building block for image recognition models. We explore variations of self-attention and assess their effectiveness for image recognition. We consider two forms of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Hengshuang Zhao , Jiaya Jia , Vladlen Koltun