English
Related papers

Related papers: Transferable Adversarial Attacks on Vision Transfo…

200 papers

Transfer-based adversarial attacks can evaluate model robustness in the black-box setting. Several methods have demonstrated impressive untargeted transferability, however, it is still challenging to efficiently produce targeted…

Machine Learning · Computer Science 2022-07-25 Xiao Yang , Yinpeng Dong , Tianyu Pang , Hang Su , Jun Zhu

Vision Transformers (ViT) have recently demonstrated exemplary performance on a variety of vision tasks and are being used as an alternative to CNNs. Their design is based on a self-attention mechanism that processes images as a sequence of…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Akshayvarun Subramanya , Aniruddha Saha , Soroush Abbasi Koohpayegani , Ajinkya Tejankar , Hamed Pirsiavash

Adversarial images pose a severe security threat to multimodal large language models through prompt injection. Existing defenses largely lack a principled understanding of the underlying mechanisms and struggle to balance efficiency and…

Machine Learning · Computer Science 2026-05-26 Dongpeng Zhang , Ke Ma , Yangbangyan Jiang , Gaozheng Pei , Longtao Huang , Qianqian Xu , Qingming Huang

Vision Transformers (ViTs) have outperformed traditional Convolutional Neural Networks (CNN) across various computer vision tasks. However, akin to CNN, ViTs are vulnerable to backdoor attacks, where the adversary embeds the backdoor into…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Ji Guo , Hongwei Li , Wenbo Jiang , Guoming Lu

Deep neural networks (DNNs) are well known to be vulnerable to adversarial examples (AEs). In addition, AEs have adversarial transferability, which means AEs generated for a source model can fool another black-box model (target model) with…

Cryptography and Security · Computer Science 2023-07-27 Ryota Iijima , Miki Tanaka , Sayaka Shiota , Hitoshi Kiya

Vision Transformers (ViT) are competing to replace Convolutional Neural Networks (CNN) for various computer vision tasks in medical imaging such as classification and segmentation. While the vulnerability of CNNs to adversarial attacks is a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Faris Almalik , Mohammad Yaqub , Karthik Nandakumar

Recent advances in attention-based networks have shown that Vision Transformers can achieve state-of-the-art or near state-of-the-art results on many image classification tasks. This puts transformers in the unique position of being a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Kaleel Mahmood , Rigel Mahmood , Marten van Dijk

Vision transformers (ViTs) have achieved promising results on a variety of Computer Vision tasks, however their quadratic complexity in the number of input tokens has limited their application specially in resource-constrained settings.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Wentao Zhu

Despite recent success on various tasks, deep learning techniques still perform poorly on adversarial examples with small perturbations. While optimization-based methods for adversarial attacks are well-explored in the field of computer…

Computation and Language · Computer Science 2023-06-09 Lifan Yuan , Yichi Zhang , Yangyi Chen , Wei Wei

Vision Transformers (ViTs) have recently achieved competitive performance in broad vision tasks. Unfortunately, on popular threat models, naturally trained ViTs are shown to provide no more adversarial robustness than convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Yichuan Mo , Dongxian Wu , Yifei Wang , Yiwen Guo , Yisen Wang

We propose the first general-purpose gradient-based attack against transformer models. Instead of searching for a single adversarial example, we search for a distribution of adversarial examples parameterized by a continuous-valued matrix,…

Computation and Language · Computer Science 2021-04-29 Chuan Guo , Alexandre Sablayrolles , Hervé Jégou , Douwe Kiela

Transferable adversarial attacks pose significant threats to deep neural networks, particularly in black-box scenarios where internal model information is inaccessible. Studying adversarial attack methods helps advance the performance of…

Artificial Intelligence · Computer Science 2024-09-23 Zhibo Jin , Jiayu Zhang , Zhiyu Zhu , Chenyu Zhang , Jiahao Huang , Jianlong Zhou , Fang Chen

Deep learning is vulnerable to adversarial examples. Many defenses based on randomized neural networks have been proposed to solve the problem, but fail to achieve robustness against attacks using proxy gradients such as the Expectation…

Machine Learning · Computer Science 2021-07-07 Sungyoon Lee , Hoki Kim , Jaewook Lee

Deep neural networks are vulnerable to adversarial examples, which can mislead classifiers by adding imperceptible perturbations. An intriguing property of adversarial examples is their good transferability, making black-box attacks…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Yinpeng Dong , Tianyu Pang , Hang Su , Jun Zhu

Multimodal large language models (MLLMs) remain vulnerable to transfer-based targeted attacks, where perturbations optimized on open-source surrogate encoders can generalize to closed-source MLLMs. A key challenge for improving adversarial…

Cryptography and Security · Computer Science 2026-05-22 Leitao Yuan , Qinghua Mao , Daizong Liu , Kun Wang , Wenjie Wang , Yan Teng , Jing Shao , Dongrui Liu

Deep neural networks are vulnerable to adversarial examples, which are crafted by adding small, human-imperceptible perturbations to the original images, but make the model output inaccurate predictions. Before deep neural networks are…

Computer Vision and Pattern Recognition · Computer Science 2021-01-13 Bo Yang , Kaiyong Xu , Hengjun Wang , Hengwei Zhang

Adversarial training (AT) can help improve the robustness of Vision Transformers (ViT) against adversarial attacks by intentionally injecting adversarial examples into the training data. However, this way of adversarial injection inevitably…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Fudong Lin , Jiadong Lou , Xu Yuan , Nian-Feng Tzeng

Vision Transformer (ViT), as a powerful alternative to Convolutional Neural Network (CNN), has received much attention. Recent work showed that ViTs are also vulnerable to adversarial examples like CNNs. To build robust ViTs, an intuitive…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Boxi Wu , Jindong Gu , Zhifeng Li , Deng Cai , Xiaofei He , Wei Liu

Vision transformers (ViTs) have become essential backbones in advanced computer vision applications and multi-modal foundation models. Despite their strengths, ViTs remain vulnerable to adversarial perturbations, comparable to or even…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Bhavna Gopal , Huanrui Yang , Mark Horton , Yiran Chen

In recent years, visual tracking methods based on convolutional neural networks and Transformers have achieved remarkable performance and have been successfully applied in fields such as autonomous driving. However, the numerous security…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Wei-Long Tian , Peng Gao , Xiao Liu , Long Xu , Hamido Fujita , Hanan Aljuai , Mao-Li Wang