English
Related papers

Related papers: On enhancing the robustness of Vision Transformers…

200 papers

Vision Transformer (ViT) is emerging as the state-of-the-art architecture for image recognition. While recent studies suggest that ViTs are more robust than their convolutional counterparts, our experiments find that ViTs trained on…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Chengzhi Mao , Lu Jiang , Mostafa Dehghani , Carl Vondrick , Rahul Sukthankar , Irfan Essa

Vision Transformer (ViT) has recently gained significant attention in solving computer vision (CV) problems due to its capability of extracting informative features and modeling long-range dependencies through the attention mechanism.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Yao Qiang , Chengyin Li , Prashant Khanduri , Dongxiao Zhu

Diffusion models have shown to be strong representation learners, showcasing state-of-the-art performance across multiple domains. Aside from accelerated sampling, DDIM also enables the inversion of real images back to their latent codes. A…

Artificial Intelligence · Computer Science 2025-10-02 Seunghoo Hong , Geonho Son , Juhun Lee , Simon S. Woo

Face recognition systems are increasingly used in biometric security for convenience and effectiveness. However, they remain vulnerable to spoofing attacks, where attackers use photos, videos, or masks to impersonate legitimate users. This…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Arman Keresh , Pakizar Shamoi

Vision Transformer (ViT) is known to be highly nonlinear like other classical neural networks and could be easily fooled by both natural and adversarial patch perturbations. This limitation could pose a threat to the deployment of ViT in…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yuheng Huang , Lei Ma , Yuanchun Li

Growing leakage and misuse of visual information raise security and privacy concerns, which promotes the development of information protection. Existing adversarial perturbations-based methods mainly focus on the de-identification against…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Zhigang Su , Dawei Zhou , Nannan Wangu , Decheng Li , Zhen Wang , Xinbo Gao

Vision transformer (ViT) models, when coupled with interpretation models, are regarded as secure and challenging to deceive, making them well-suited for security-critical domains such as medical applications, autonomous vehicles, drones,…

Cryptography and Security · Computer Science 2025-07-22 Eldor Abdukhamidov , Mohammed Abuhamad , Simon S. Woo , Hyoungshick Kim , Tamer Abuhmed

This work aims to reproduce the results of Faithful Vision Transformers (FViTs) proposed by arXiv:2311.17983 alongside interpretability methods for Vision Transformers from arXiv:2012.09838 and Xu (2022) et al. We investigate claims made by…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Izabela Kurek , Wojciech Trejter , Stipe Frkovic , Andro Erdelez

Adversarial purification is a successful defense mechanism against adversarial attacks without requiring knowledge of the form of the incoming attack. Generally, adversarial purification aims to remove the adversarial perturbations…

Computation and Language · Computer Science 2023-05-04 Linyang Li , Demin Song , Xipeng Qiu

Vision transformers (ViTs) have demonstrated impressive performance in various computer vision tasks. However, the adversarial examples generated by ViTs are challenging to transfer to other networks with different structures. Recent attack…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Huipeng Zhou , Yu-an Tan , Yajie Wang , Haoran Lyu , Shangbo Wu , Yuanzhang Li

Vision Transformers (ViTs) have recently achieved competitive performance in broad vision tasks. Unfortunately, on popular threat models, naturally trained ViTs are shown to provide no more adversarial robustness than convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Yichuan Mo , Dongxian Wu , Yifei Wang , Yiwen Guo , Yisen Wang

This paper explores the security aspects of federated learning applications in medical image analysis. Current robustness-oriented methods like adversarial training, secure aggregation, and homomorphic encryption often risk privacy…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Erfan Darzi , Nanna M. Sijtsema , P. M. A van Ooijen

Deep neural networks (DNNs) are well known to be vulnerable to adversarial examples (AEs). In addition, AEs have adversarial transferability, which means AEs generated for a source model can fool another black-box model (target model) with…

Cryptography and Security · Computer Science 2023-07-27 Ryota Iijima , Miki Tanaka , Sayaka Shiota , Hitoshi Kiya

Transformer models have excelled in natural language tasks, prompting the vision community to explore their implementation in computer vision problems. However, these models are still influenced by adversarial examples. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Jialin Wu , Kaikai Pan , Yanjiao Chen , Jiangyi Deng , Shengyuan Pang , Wenyuan Xu

Adversarial transferability remains a critical challenge in evaluating the robustness of deep neural networks. In security-critical applications, transferability enables black-box attacks without access to model internals, making it a key…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Amira Guesmi , Bassem Ouni , Muhammad Shafique

Removing noise from images is a challenging and fundamental problem in the field of computer vision. Images captured by modern cameras are inevitably degraded by noise which limits the accuracy of any quantitative measurements on those…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Nikhil Verma , Deepkamal Kaur , Lydia Chau

In this paper, we propose a privacy-preserving image classification method that is based on the combined use of encrypted images and the vision transformer (ViT). The proposed method allows us not only to apply images without visual…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Zheng Qi , AprilPyone MaungMaung , Yuma Kinoshita , Hitoshi Kiya

As a defense strategy against adversarial attacks, adversarial detection aims to identify and filter out adversarial data from the data flow based on discrepancies in distribution and noise patterns between natural and adversarial data.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Qian Wang , Chen Li , Yuchen Luo , Hefei Ling , Shijuan Huang , Ruoxi Jia , Ning Yu

The rapid growth of social media has led to the widespread sharing of individual portrait images, which pose serious privacy risks due to the capabilities of automatic face recognition (AFR) systems for mass surveillance. Hence, protecting…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ali Salar , Qing Liu , Yingli Tian , Guoying Zhao

Neural Networks are infamously sensitive to small perturbations in their inputs, making them vulnerable to adversarial attacks. This project evaluates the performance of Denoising Diffusion Probabilistic Models (DDPM) as a purification…

Machine Learning · Computer Science 2023-01-18 Lars Lien Ankile , Anna Midgley , Sebastian Weisshaar