English
Related papers

Related papers: ViTGuard: Attention-aware Detection against Advers…

200 papers

Convolutional Neural Networks (CNNs) have become the de facto gold standard in computer vision applications in the past years. Recently, however, new model architectures have been proposed challenging the status quo. The Vision Transformer…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Philipp Benz , Soomin Ham , Chaoning Zhang , Adil Karjauv , In So Kweon

In recent years, vision transformers (ViTs) have emerged as powerful and promising techniques for computer vision tasks such as image classification, object detection, and segmentation. Unlike convolutional neural networks (CNNs), which…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Shaibal Saha , Lanyu Xu

Vision Transformers (ViTs) have outperformed traditional Convolutional Neural Networks (CNN) across various computer vision tasks. However, akin to CNN, ViTs are vulnerable to backdoor attacks, where the adversary embeds the backdoor into…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Ji Guo , Hongwei Li , Wenbo Jiang , Guoming Lu

Recent advances in attention-based networks have shown that Vision Transformers can achieve state-of-the-art or near state-of-the-art results on many image classification tasks. This puts transformers in the unique position of being a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Kaleel Mahmood , Rigel Mahmood , Marten van Dijk

Vision Transformers (ViTs) are becoming a very popular paradigm for vision tasks as they achieve state-of-the-art performance on image classification. However, although early works implied that this network structure had increased…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Hugo Lemarchant , Liangzi Li , Yiming Qian , Yuta Nakashima , Hajime Nagahara

Vision Transformer(ViT) is one of the most widely used models in the computer vision field with its great performance on various tasks. In order to fully utilize the ViT-based architecture in various applications, proper visualization…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Saebom Leem , Hyunseok Seo

Recently, Vision Transformers (ViTs) have achieved unprecedented effectiveness in the general domain of image classification. Nonetheless, these models remain underexplored in the field of deepfake detection, given their lower performance…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Dat Nguyen , Marcella Astrid , Enjie Ghorbel , Djamila Aouada

Vision Transformer (ViT) is known to be highly nonlinear like other classical neural networks and could be easily fooled by both natural and adversarial patch perturbations. This limitation could pose a threat to the deployment of ViT in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yuheng Huang , Lei Ma , Yuanchun Li

Deep neural networks are known to be vulnerable to adversarial attacks. This exposes them to potential exploits in security-sensitive applications and highlights their lack of robustness. This paper uses a variational auto-encoder (VAE) to…

Computer Vision and Pattern Recognition · Computer Science 2018-12-10 Yi Luo , Henry Pfister

An adversarial patch can arbitrarily manipulate image pixels within a restricted region to induce model misclassification. The threat of this localized attack has gained significant attention because the adversary can mount a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Chong Xiang , Prateek Mittal

Transformers are popular neural network models that use layers of self-attention and fully-connected nodes with embedded tokens. Vision Transformers (ViT) adapt transformers for image recognition tasks. In order to do this, the images are…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Brian Kenji Iwana , Akihiro Kusuda

Vision Transformers (ViTs) have recently achieved competitive performance in broad vision tasks. Unfortunately, on popular threat models, naturally trained ViTs are shown to provide no more adversarial robustness than convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Yichuan Mo , Dongxian Wu , Yifei Wang , Yiwen Guo , Yisen Wang

Deep learning vision systems are increasingly deployed in safety-critical domains such as healthcare, yet they remain vulnerable to small adversarial patches that can trigger misclassifications. Most existing defenses assume a single patch…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Aja Khanal , Ahmed Faid , Apurva Narayan

Vision Transformer (ViT) has demonstrated promising performance in computer vision tasks, comparable to state-of-the-art neural networks. Yet, this new type of deep neural network architecture is vulnerable to adversarial attacks limiting…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Shashank Kotyan , Danilo Vasconcellos Vargas

Since their inception, Vision Transformers (ViTs) have emerged as a compelling alternative to Convolutional Neural Networks (CNNs) across a wide spectrum of tasks. ViTs exhibit notable characteristics, including global attention, resilience…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Hanan Gani , Nada Saadi , Noor Hussein , Karthik Nandakumar

Vision transformer (ViT) expands the success of transformer models from sequential data to images. The model decomposes an image into many smaller patches and arranges them into a sequence. Multi-head self-attentions are then applied to the…

Machine Learning · Computer Science 2023-03-27 Yiran Li , Junpeng Wang , Xin Dai , Liang Wang , Chin-Chia Michael Yeh , Yan Zheng , Wei Zhang , Kwan-Liu Ma

Vision Transformers (ViTs) have emerged as a fundamental architecture and serve as the backbone of modern vision-language models. Despite their impressive performance, ViTs exhibit notable vulnerability to evasion attacks, necessitating the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Xiaoyun Xu , Shujian Yu , Zhuoran Liu , Stjepan Picek

Deep neural networks (DNNs) are well known to be vulnerable to adversarial examples (AEs). In addition, AEs have adversarial transferability, which means AEs generated for a source model can fool another black-box model (target model) with…

Cryptography and Security · Computer Science 2023-07-27 Ryota Iijima , Miki Tanaka , Sayaka Shiota , Hitoshi Kiya

Unsupervised domain adaptation (UDA) aims to transfer knowledge from a labeled source domain to an unlabeled target domain. The most recent UDA methods always resort to adversarial training to yield state-of-the-art results and a dominant…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Yahan Li , Yuan Wu

Vision Transformer (ViT) is becoming widely popular in automating accurate disease diagnosis in medical imaging owing to its robust self-attention mechanism. However, ViTs remain vulnerable to adversarial attacks that may thwart the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Neha A S , Vivek Chaturvedi , Muhammad Shafique