English
Related papers

Related papers: Backdoor Attack Against Vision Transformers via At…

200 papers

Vision Transformers (ViT) have recently demonstrated exemplary performance on a variety of vision tasks and are being used as an alternative to CNNs. Their design is based on a self-attention mechanism that processes images as a sequence of…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Akshayvarun Subramanya , Aniruddha Saha , Soroush Abbasi Koohpayegani , Ajinkya Tejankar , Hamed Pirsiavash

Vision Transformers (ViTs) have a radically different architecture with significantly less inductive bias than Convolutional Neural Networks. Along with the improvement in performance, security and robustness of ViTs are also of great…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Khoa D. Doan , Yingjie Lao , Peng Yang , Ping Li

Vision Transformers (ViTs) have demonstrated the state-of-the-art performance in various vision-related tasks. The success of ViTs motivates adversaries to perform backdoor attacks on ViTs. Although the vulnerability of traditional CNNs to…

Machine Learning · Computer Science 2023-09-15 Mengxin Zheng , Qian Lou , Lei Jiang

Vision Transformer (ViT), as a powerful alternative to Convolutional Neural Network (CNN), has received much attention. Recent work showed that ViTs are also vulnerable to adversarial examples like CNNs. To build robust ViTs, an intuitive…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Boxi Wu , Jindong Gu , Zhifeng Li , Deng Cai , Xiaofei He , Wei Liu

The increasing reliance on machine learning systems has made their security a critical concern. Evasion attacks enable adversaries to manipulate the decision-making processes of AI systems, potentially causing security breaches or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Kasper Cools , Clara Maathuis , Alexander M. van Oers , Claudia S. Hübner , Nikos Deligiannis , Marijke Vandewal , Geert De Cubber

Vision Transformers (ViTs) have achieved record-breaking performance in various visual tasks. However, concerns about their robustness against backdoor attacks have grown. Backdoor attacks involve associating a specific trigger with a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Deng Siqin , Zhou Xiaoyi

In this work we demonstrate the vulnerability of vision transformers (ViTs) to gradient-based inversion attacks. During this attack, the original data batch is reconstructed given model weights and the corresponding gradients. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Ali Hatamizadeh , Hongxu Yin , Holger Roth , Wenqi Li , Jan Kautz , Daguang Xu , Pavlo Molchanov

The use of transformers for vision tasks has challenged the traditional dominant role of convolutional neural networks (CNN) in computer vision (CV). For image classification tasks, Vision Transformer (ViT) effectively establishes spatial…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Shihua Sun , Kenechukwu Nwodo , Shridatt Sugrim , Angelos Stavrou , Haining Wang

Vision Transformers (ViTs) have become popular in computer vision tasks. Backdoor attacks, which trigger undesirable behaviours in models during inference, threaten ViTs' performance, particularly in security-sensitive tasks. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Zeyu Michael Li

Vision Transformers (ViTs) have achieved remarkable success across vision tasks, yet recent studies show they remain vulnerable to backdoor attacks. Existing patch-wise attacks typically assume a single fixed trigger location during…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Dazhuang Liu , Yanqi Qiao , Rui Wang , Kaitai Liang , Georgios Smaragdakis

This paper investigates how Backdoor Attacks are represented within Vision Transformers (ViTs). By assuming knowledge of the trigger, we identify a specific ``trigger direction'' in the model's activations that corresponds to the internal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Sengim Karayalcin , Marina Krcek , Pin-Yu Chen , Stjepan Picek

Recent studies have revealed that vision transformers (ViTs) face similar security risks from adversarial attacks as deep convolutional neural networks (CNNs). However, directly applying attack methodology on CNNs to ViTs has been…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Chao Zhou , Xiaowen Shi , Yuan-Gen Wang

The major part of the vanilla vision transformer (ViT) is the attention block that brings the power of mimicking the global context of the input image. For better performance, ViT needs large-scale training data. To overcome this data…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Ahmed Aldahdooh , Wassim Hamidouche , Olivier Deforges

Vision transformers (ViTs) process input images as sequences of patches via self-attention; a radically different architecture than convolutional neural networks (CNNs). This makes it interesting to study the adversarial feature space of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Muzammal Naseer , Kanchana Ranasinghe , Salman Khan , Fahad Shahbaz Khan , Fatih Porikli

Adversarial training (AT) can help improve the robustness of Vision Transformers (ViT) against adversarial attacks by intentionally injecting adversarial examples into the training data. However, this way of adversarial injection inevitably…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Fudong Lin , Jiadong Lou , Xu Yuan , Nian-Feng Tzeng

Recent advances in Vision Transformer (ViT) have demonstrated its impressive performance in image classification, which makes it a promising alternative to Convolutional Neural Network (CNN). Unlike CNNs, ViT represents an input image as a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Jindong Gu , Volker Tresp , Yao Qin

Vision transformers (ViTs) have demonstrated impressive performance on a series of computer vision tasks, yet they still suffer from adversarial examples. % crafted in a similar fashion as CNNs. In this paper, we posit that adversarial…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Zhipeng Wei , Jingjing Chen , Micah Goldblum , Zuxuan Wu , Tom Goldstein , Yu-Gang Jiang

Vision Transformers (ViTs) that leverage self-attention mechanism have shown superior performance on many classical vision tasks compared to convolutional neural networks (CNNs) and gain increasing popularity recently. Existing ViTs works…

Cryptography and Security · Computer Science 2024-04-29 Xinghua Xue , Cheng Liu , Ying Wang , Bing Yang , Tao Luo , Lei Zhang , Huawei Li , Xiaowei Li

Vision transformers (ViTs) have been successfully deployed in a variety of computer vision tasks, but they are still vulnerable to adversarial samples. Transfer-based attacks use a local model to generate adversarial samples and directly…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Jianping Zhang , Yizhan Huang , Weibin Wu , Michael R. Lyu

Vision Transformers (ViT) are competing to replace Convolutional Neural Networks (CNN) for various computer vision tasks in medical imaging such as classification and segmentation. While the vulnerability of CNNs to adversarial attacks is a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Faris Almalik , Mohammad Yaqub , Karthik Nandakumar
‹ Prev 1 2 3 10 Next ›