English
Related papers

Related papers: Defending Backdoor Attacks on Vision Transformer v…

200 papers

Vision Transformers (ViTs) have emerged as a fundamental architecture and serve as the backbone of modern vision-language models. Despite their impressive performance, ViTs exhibit notable vulnerability to evasion attacks, necessitating the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Xiaoyun Xu , Shujian Yu , Zhuoran Liu , Stjepan Picek

In recent years, vision transformers (ViTs) have emerged as powerful and promising techniques for computer vision tasks such as image classification, object detection, and segmentation. Unlike convolutional neural networks (CNNs), which…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Shaibal Saha , Lanyu Xu

Vision transformers (ViTs) have demonstrated impressive performance and stronger adversarial robustness compared to Convolutional Neural Networks (CNNs). On the one hand, ViTs' focus on global interaction between individual patches reduces…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Yucheng Shi , Yahong Han , Yu-an Tan , Xiaohui Kuang

Vision transformers (ViTs) have significantly changed the computer vision landscape and have periodically exhibited superior performance in vision tasks compared to convolutional neural networks (CNNs). Although the jury is still out on…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Ariel N. Lee , Sarah Adel Bargal , Janavi Kasera , Stan Sclaroff , Kate Saenko , Nataniel Ruiz

Vision transformers (ViTs) have recently demonstrated state-of-the-art performance in a variety of vision tasks, replacing convolutional neural networks (CNNs). Meanwhile, since ViT has a different architecture than CNN, it may behave…

Computer Vision and Pattern Recognition · Computer Science 2021-11-17 Bum Jun Kim , Hyeyeon Choi , Hyeonah Jang , Dong Gu Lee , Wonseok Jeong , Sang Woo Kim

Vision Transformers (ViTs) are increasingly used in computer vision due to their high performance, but their vulnerability to adversarial attacks is a concern. Existing methods lack a solid theoretical basis, focusing mainly on empirical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xixu Hu , Runkai Zheng , Jindong Wang , Cheuk Hang Leung , Qi Wu , Xing Xie

Transformers, composed of multiple self-attention layers, hold strong promises toward a generic learning primitive applicable to different data modalities, including the recent breakthroughs in computer vision achieving state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Sayak Paul , Pin-Yu Chen

Vision State Space Models (SSMs), particularly architectures like Vision Mamba (ViM), have emerged as promising alternatives to Vision Transformers (ViTs). However, the security implications of this novel architecture, especially their…

Cryptography and Security · Computer Science 2025-07-02 Yinghao Wu , Liyan Zhang

Vision Transformers (ViTs) have been widely applied in various computer vision and vision-language tasks. To gain insights into their robustness in practical scenarios, transferable adversarial examples on ViTs have been extensively…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yuchen Ren , Zhengyu Zhao , Chenhao Lin , Bo Yang , Lu Zhou , Zhe Liu , Chao Shen

Detecting plant diseases is a crucial aspect of modern agriculture, as it plays a key role in maintaining crop health and increasing overall yield. Traditional approaches, though still valuable, often rely on manual inspection or…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Saber Mehdipour , Seyed Abolghasem Mirroshandel , Seyed Amirhossein Tabatabaei

Recent advances on Vision Transformer (ViT) and its improved variants have shown that self-attention-based networks surpass traditional Convolutional Neural Networks (CNNs) in most vision tasks. However, existing ViTs focus on the standard…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Xiaofeng Mao , Gege Qi , Yuefeng Chen , Xiaodan Li , Ranjie Duan , Shaokai Ye , Yuan He , Hui Xue

Despite the remarkable success of Vision Transformers (ViTs) across a wide range of vision tasks, recent studies have revealed that they remain vulnerable to adversarial examples, much like Convolutional Neural Networks (CNNs). A common…

Machine Learning · Computer Science 2026-04-22 Jiaming Zhang , Meng Ding , Shaopeng Fu , Jingfeng Zhang , Di Wang

While recent face anti-spoofing methods perform well under the intra-domain setups, an effective approach needs to account for much larger appearance variations of images acquired in complex scenes with different sensors for robust…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Hsin-Ping Huang , Deqing Sun , Yaojie Liu , Wen-Sheng Chu , Taihong Xiao , Jinwei Yuan , Hartwig Adam , Ming-Hsuan Yang

Vision transformers (ViTs) that model an image as a sequence of partitioned patches have shown notable performance in diverse vision tasks. Because partitioning patches eliminates the image structure, to reflect the order of patches, ViTs…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Bum Jun Kim , Hyeyeon Choi , Hyeonah Jang , Sang Woo Kim

Following their success in visual recognition tasks, Vision Transformers(ViTs) are being increasingly employed for image restoration. As a few recent works claim that ViTs for image classification also have better robustness properties, we…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Shashank Agnihotri , Kanchana Vaishnavi Gandikota , Julia Grabinski , Paramanand Chandramouli , Margret Keuper

Backdoor attack is a major threat to deep learning systems in safety-critical scenarios, which aims to trigger misbehavior of neural network models under attacker-controlled conditions. However, most backdoor attacks have to modify the…

Machine Learning · Computer Science 2023-08-24 Yizhen Yuan , Rui Kong , Shenghao Xie , Yuanchun Li , Yunxin Liu

Recently, vision Transformers (ViTs) are developing rapidly and starting to challenge the domination of convolutional neural networks (CNNs) in the realm of computer vision (CV). With the general-purpose Transformer architecture replacing…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Haofei Zhang , Jiarui Duan , Mengqi Xue , Jie Song , Li Sun , Mingli Song

Vision Transformers (ViTs) have gained rapid adoption in computational pathology for their ability to model long-range dependencies through self-attention, addressing the limitations of convolutional neural networks that excel at local…

Image and Video Processing · Electrical Eng. & Systems 2026-01-15 Fuyao Chen , Yuexi Du , Elèonore V. Lieffrig , Nicha C. Dvornek , John A. Onofrey

Vision Transformer (ViT) has demonstrated promising performance in computer vision tasks, comparable to state-of-the-art neural networks. Yet, this new type of deep neural network architecture is vulnerable to adversarial attacks limiting…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Shashank Kotyan , Danilo Vasconcellos Vargas

Neural architectures based on attention such as vision transformers are revolutionizing image recognition. Their main benefit is that attention allows reasoning about all parts of a scene jointly. In this paper, we show how the global…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Giulio Lovisotto , Nicole Finnie , Mauricio Munoz , Chaithanya Kumar Mummadi , Jan Hendrik Metzen