English
Related papers

Related papers: Backdoor Attack Against Vision Transformers via At…

200 papers

Vision Transformers (ViTs) have become a dominant architecture in computer vision, yet their prediction process remains difficult to interpret because information is propagated through complex interactions across layers and attention heads.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Sehyeong Jo , Gangjae Jang , Haesol Park

Vision Transformers (ViTs) have recently dominated a range of computer vision tasks, yet it suffers from low training data efficiency and inferior local semantic representation capability without appropriate inductive bias. Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Cong Wang , Hongmin Xu , Xiong Zhang , Li Wang , Zhitong Zheng , Haifeng Liu

The Vision Transformer (ViT) leverages the Transformer's encoder to capture global information by dividing images into patches and achieves superior performance across various computer vision tasks. However, the self-attention mechanism of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Tianxiao Zhang , Wenju Xu , Bo Luo , Guanghui Wang

Pre-trained vision models (PVMs) have become a dominant component due to their exceptional performance when fine-tuned for downstream tasks. However, the presence of backdoors within PVMs poses significant threats. Unfortunately, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Aishan Liu , Xinwei Zhang , Yisong Xiao , Yuguang Zhou , Siyuan Liang , Jiakai Wang , Xianglong Liu , Xiaochun Cao , Dacheng Tao

We present a new type of backdoor attack that exploits a vulnerability of convolutional neural networks (CNNs) that has been previously unstudied. In particular, we examine the application of facial recognition. Deep learning techniques are…

Computer Vision and Pattern Recognition · Computer Science 2018-12-10 Jacob Dumford , Walter Scheirer

Vision Transformer (ViT) has prevailed in computer vision tasks due to its strong long-range dependency modelling ability. \textcolor{blue}{However, its large model size and weak local feature modeling ability hinder its application in real…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Yi Zhang , Lingxiao Wei , Bowei Zhang , Ziwei Liu , Kai Yi , Shu Hu

Deep Neural Networks (DNNs) are well-known to be vulnerable to Adversarial Examples (AEs). A large amount of efforts have been spent to launch and heat the arms race between the attackers and defenders. Recently, advanced gradient-based…

Cryptography and Security · Computer Science 2020-05-29 Han Qiu , Yi Zeng , Qinkai Zheng , Tianwei Zhang , Meikang Qiu , Gerard Memmi

Despite the remarkable success of Vision Transformers (ViTs) across a wide range of vision tasks, recent studies have revealed that they remain vulnerable to adversarial examples, much like Convolutional Neural Networks (CNNs). A common…

Machine Learning · Computer Science 2026-04-22 Jiaming Zhang , Meng Ding , Shaopeng Fu , Jingfeng Zhang , Di Wang

While transformer-based models dominate NLP and vision applications, their underlying mechanisms to map the input space to the label space semantically are not well understood. In this paper, we study the sources of known representation…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Chashi Mahiul Islam , Samuel Jacob Chacko , Mao Nishino , Xiuwen Liu

Age estimation from facial images is a complex and multifaceted challenge in computer vision. In this study, we present a novel hybrid architecture that combines ConvNeXt, a state-of-the-art advancement of convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Gaby Maroun , Salah Eddine Bekhouche , Fadi Dornaika

Given the power of vision transformers, a new learning paradigm, pre-training and then prompting, makes it more efficient and effective to address downstream visual recognition tasks. In this paper, we identify a novel security threat…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Sheng Yang , Jiawang Bai , Kuofeng Gao , Yong Yang , Yiming Li , Shu-tao Xia

Recent researches demonstrate that Deep Neural Networks (DNN) models are vulnerable to backdoor attacks. The backdoored DNN model will behave maliciously when images containing backdoor triggers arrive. To date, existing backdoor attacks…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Mingfu Xue , Shifeng Ni , Yinghao Wu , Yushu Zhang , Jian Wang , Weiqiang Liu

Deep learning models have consistently outperformed traditional machine learning models in various classification tasks, including image classification. As such, they have become increasingly prevalent in many real world applications…

Cryptography and Security · Computer Science 2018-08-31 Cong Liao , Haoti Zhong , Anna Squicciarini , Sencun Zhu , David Miller

Deep neural networks (DNNs) have made tremendous progress in the past ten years and have been applied in various critical applications. However, recent studies have shown that deep neural networks are vulnerable to backdoor attacks. By…

Cryptography and Security · Computer Science 2023-05-19 Xinrui Liu , Yajie Wang , Yu-an Tan , Kefan Qiu , Yuanzhang Li

Deep Neural Networks (DNNs) have been widely used in many areas such as autonomous driving and face recognition. However, DNN model is fragile to backdoor attack. A backdoor in the DNN model can be activated by a poisoned input with trigger…

Cryptography and Security · Computer Science 2024-07-16 Qi Zhou , Zipeng Ye , Yubo Tang , Wenjian Luo , Yuhui Shi , Yan Jia

Vision Transformers (ViTs) have achieved state-of-the-art performance for various vision tasks. One reason behind the success lies in their ability to provide plausible innate explanations for the behavior of neural architectures. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Lijie Hu , Yixin Liu , Ninghao Liu , Mengdi Huai , Lichao Sun , Di Wang

Automated liver segmentation from radiology scans (CT, MRI) can improve surgery and therapy planning and follow-up assessment in addition to conventional use for diagnosis and prognosis. Although convolutional neural networks (CNNs) have…

Image and Video Processing · Electrical Eng. & Systems 2022-05-31 Ugur Demir , Zheyuan Zhang , Bin Wang , Matthew Antalek , Elif Keles , Debesh Jha , Amir Borhani , Daniela Ladner , Ulas Bagci

Vision transformers (ViTs) have found only limited practical use in processing images, in spite of their state-of-the-art accuracy on certain benchmarks. The reason for their limited use include their need for larger training datasets and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-26 Pranav Jeevan , Amit sethi

Recent Vision-Language Models (VLMs) have demonstrated remarkable multimodal understanding capabilities, yet the redundant visual tokens incur prohibitive computational overhead and degrade inference efficiency. Prior studies typically…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Qiankun Ma , Ziyao Zhang , Haofei Wang , Jie Chen , Zhen Song , Hairong Zheng

Deep neural networks used in computer vision have been shown to exhibit many social biases such as gender bias. Vision Transformers (ViTs) have become increasingly popular in computer vision applications, outperforming Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Abhishek Mandal , Susan Leavy , Suzanne Little