English
Related papers

Related papers: Transferable Adversarial Attacks on Vision Transfo…

200 papers

Recent advancements in Optical Character Recognition (OCR) have been driven by transformer-based models. OCR systems are critical in numerous high-stakes domains, yet their vulnerability to adversarial attack remains largely uncharted…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Lucas Beerens , Desmond J. Higham

Deep neural networks (DNNs) are widely used today, but they are vulnerable to adversarial attacks. To develop effective methods of defense, it is important to understand the potential weak spots of DNNs. Often attacks are organized taking…

Numerical Analysis · Mathematics 2025-08-22 Andrei Chertkov , Ivan Oseledets

Targeted adversarial attacks are widely used to evaluate the robustness of neural machine translation systems. Unfortunately, this paper first identifies a critical issue in the existing settings of NMT targeted adversarial attacks, where…

Computation and Language · Computer Science 2024-07-09 Junjie Wu , Lemao Liu , Wei Bi , Dit-Yan Yeung

Inferring the latent variable generating a given test sample is a challenging problem in Generative Adversarial Networks (GANs). In this paper, we propose InvGAN - a novel framework for solving the inference problem in GANs, which involves…

Machine Learning · Computer Science 2019-12-02 Wei-An Lin , Yogesh Balaji , Pouya Samangouei , Rama Chellappa

A hard challenge in developing practical face recognition (FR) attacks is due to the black-box nature of the target FR model, i.e., inaccessible gradient and parameter information to attackers. While recent research took an important step…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Zexin Li , Bangjie Yin , Taiping Yao , Juefeng Guo , Shouhong Ding , Simin Chen , Cong Liu

The effectiveness of Graph Convolutional Networks (GCNs) has been demonstrated in a wide range of graph-based machine learning tasks. However, the update of parameters in GCNs is only from labeled nodes, lacking the utilization of unlabeled…

Machine Learning · Computer Science 2020-02-21 Ke Sun , Zhouchen Lin , Hantao Guo , Zhanxing Zhu

Transferable adversarial examples are known to cause threats in practical, black-box attack scenarios. A notable approach to improving transferability is using integrated gradients (IG), originally developed for model interpretability. In…

Cryptography and Security · Computer Science 2024-12-30 Yuchen Ren , Zhengyu Zhao , Chenhao Lin , Bo Yang , Lu Zhou , Zhe Liu , Chao Shen

Transformers, which are popular for language modeling, have been explored for solving vision tasks recently, e.g., the Vision Transformer (ViT) for image classification. The ViT model splits each image into a sequence of tokens with fixed…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Li Yuan , Yunpeng Chen , Tao Wang , Weihao Yu , Yujun Shi , Zihang Jiang , Francis EH Tay , Jiashi Feng , Shuicheng Yan

We propose a simple and highly query-efficient black-box adversarial attack named SWITCH, which has a state-of-the-art performance in the score-based setting. SWITCH features a highly efficient and effective utilization of the gradient of a…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Chen Ma , Shuyu Cheng , Li Chen , Jun Zhu , Junhai Yong

While deep learning systems are becoming increasingly prevalent in medical image analysis, their vulnerabilities to adversarial perturbations raise serious concerns for clinical deployment. These vulnerability evaluations largely rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Emily Curl , Kofi Ampomah , Md Erfan , Sayanton Dibbo

Large vision-language models (LVLMs) have achieved impressive performance across multimodal tasks, but their reliance on visual inputs exposes them to adversarial threats. Encoder-based attacks provide an efficient alternative to end-to-end…

Cryptography and Security · Computer Science 2026-05-26 Xinwei Zhang , Li Bai , Tianwei Zhang , Youqian Zhang , Qingqing Ye , Yingnan Zhao , Ruochen Du , Haibo Hu

Transfer-based adversarial attacks raise a severe threat to real-world deep learning systems since they do not require access to target models. Adversarial training (AT), which is recognized as the strongest defense against white-box…

Cryptography and Security · Computer Science 2023-10-17 Yulong Yang , Chenhao Lin , Xiang Ji , Qiwei Tian , Qian Li , Hongshan Yang , Zhibo Wang , Chao Shen

Recently, large pre-trained foundation models have become widely adopted by machine learning practitioners for a multitude of tasks. Given that such models are publicly available, relying on their use as backbone models for downstream tasks…

Machine Learning · Computer Science 2025-03-14 Brian Pulfer , Yury Belousov , Slava Voloshynovskiy

Robustness of huge Transformer-based models for natural language processing is an important issue due to their capabilities and wide adoption. One way to understand and improve robustness of these models is an exploration of an adversarial…

In recent years, the rapid development of deep neural networks has brought increased attention to the security and robustness of these models. While existing adversarial attack algorithms have demonstrated success in improving adversarial…

Machine Learning · Computer Science 2025-02-25 Wenyuan Wu , Zheng Liu , Yong Chen , Chao Su , Dezhong Peng , Xu Wang

The utilization of large foundational models has a dilemma: while fine-tuning downstream tasks from them holds promise for making use of the well-generalized knowledge in practical applications, their open accessibility also poses threats…

Machine Learning · Computer Science 2025-04-22 Song Xia , Wenhan Yang , Yi Yu , Xun Lin , Henghui Ding , Ling-Yu Duan , Xudong Jiang

Vision Transformers (ViT) have recently demonstrated the significant potential of transformer architectures for computer vision. To what extent can image-based deep reinforcement learning also benefit from ViT architectures, as compared to…

Machine Learning · Computer Science 2022-05-17 Tianxin Tao , Daniele Reda , Michiel van de Panne

In recent years, vision transformers (ViTs) have emerged as powerful and promising techniques for computer vision tasks such as image classification, object detection, and segmentation. Unlike convolutional neural networks (CNNs), which…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Shaibal Saha , Lanyu Xu

Token compression techniques have recently emerged as powerful tools for accelerating Vision Transformer (ViT) inference in computer vision. Due to the quadratic computational complexity with respect to the token sequence length, these…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Phat Nguyen , Ngai-Man Cheung

Neural networks are known to be vulnerable to carefully crafted adversarial examples, and these malicious samples often transfer, i.e., they remain adversarial even against other models. Although great efforts have been delved into the…

Image and Video Processing · Electrical Eng. & Systems 2019-11-27 Yantao Lu , Yunhan Jia , Jianyu Wang , Bai Li , Weiheng Chai , Lawrence Carin , Senem Velipasalar