English
Related papers

Related papers: On enhancing the robustness of Vision Transformers…

200 papers

Existing diffusion-based purification methods aim to disrupt adversarial perturbations by introducing a certain amount of noise through a forward diffusion process, followed by a reverse process to recover clean examples. However, this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Gaozheng Pei , Shaojie Lyu , Gong Chen , Ke Ma , Qianqian Xu , Yingfei Sun , Qingming Huang

Thanks to their remarkable denoising capabilities, diffusion models are increasingly being employed as defensive tools to reinforce the security of other models, notably in purifying adversarial examples and certifying adversarial…

Cryptography and Security · Computer Science 2024-06-17 Changjiang Li , Ren Pang , Bochuan Cao , Jinghui Chen , Fenglong Ma , Shouling Ji , Ting Wang

Vision Transformers (ViTs) have emerged as a fundamental architecture and serve as the backbone of modern vision-language models. Despite their impressive performance, ViTs exhibit notable vulnerability to evasion attacks, necessitating the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Xiaoyun Xu , Shujian Yu , Zhuoran Liu , Stjepan Picek

This work presents an end-to-end pipeline for generating, refining, and evaluating adversarial patches to compromise facial biometric systems, with applications in forensic analysis and security testing. We utilize FGSM to generate…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Shahrzad Sayyafzadeh , Hongmei Chi , Shonda Bernadin

Adversarial purification refers to a class of defense methods that remove adversarial perturbations using a generative model. These methods do not make assumptions on the form of attack and the classification model, and thus can defend…

Machine Learning · Computer Science 2022-05-17 Weili Nie , Brandon Guo , Yujia Huang , Chaowei Xiao , Arash Vahdat , Anima Anandkumar

Deep neural networks (DNNs) are well known to be vulnerable to adversarial examples (AEs). In previous studies, the use of models encrypted with a secret key was demonstrated to be robust against white-box attacks, but not against black-box…

Artificial Intelligence · Computer Science 2024-02-13 Ryota Iijima , Sayaka Shiota , Hitoshi Kiya

While transformer-based models dominate NLP and vision applications, their underlying mechanisms to map the input space to the label space semantically are not well understood. In this paper, we study the sources of known representation…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Chashi Mahiul Islam , Samuel Jacob Chacko , Mao Nishino , Xiuwen Liu

The diffusion-based adversarial purification methods attempt to drown adversarial perturbations into a part of isotropic noise through the forward process, and then recover the clean images through the reverse process. Due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Gaozheng Pei , Ke Ma , Yingfei Sun , Qianqian Xu , Qingming Huang

Image generation technology has brought significant advancements across various fields but has also raised concerns about data misuse and potential rights infringements, particularly with respect to creating visual artworks. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Jingdan Kang , Haoxin Yang , Yan Cai , Huaidong Zhang , Xuemiao Xu , Yong Du , Shengfeng He

Diffusion models have achieved outstanding image generation by reversing a forward noising process to approximate true data distributions. During training, these models predict diffusion scores from noised versions of true samples in a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Dazhong Shen , Guanglu Song , Yi Zhang , Bingqi Ma , Lujundong Li , Dongzhi Jiang , Zhuofan Zong , Yu Liu

Vision Transformers (ViT) have recently demonstrated exemplary performance on a variety of vision tasks and are being used as an alternative to CNNs. Their design is based on a self-attention mechanism that processes images as a sequence of…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Akshayvarun Subramanya , Aniruddha Saha , Soroush Abbasi Koohpayegani , Ajinkya Tejankar , Hamed Pirsiavash

Pretrained language models have significantly advanced performance across various natural language processing tasks. However, adversarial attacks continue to pose a critical challenge to systems built using these models, as they can be…

Computation and Language · Computer Science 2025-05-20 Zhenhao Li , Huichi Zhou , Marek Rei , Lucia Specia

Leveraging the visual priors of pre-trained text-to-image diffusion models offers a promising solution to enhance zero-shot generalization in dense prediction tasks. However, existing methods often uncritically use the original diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Jing He , Haodong Li , Wei Yin , Yixun Liang , Leheng Li , Kaiqiang Zhou , Hongbo Zhang , Bingbing Liu , Ying-Cong Chen

Vision Transformers (ViTs) are becoming a very popular paradigm for vision tasks as they achieve state-of-the-art performance on image classification. However, although early works implied that this network structure had increased…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Hugo Lemarchant , Liangzi Li , Yiming Qian , Yuta Nakashima , Hajime Nagahara

Vision Transformer (ViT) is becoming widely popular in automating accurate disease diagnosis in medical imaging owing to its robust self-attention mechanism. However, ViTs remain vulnerable to adversarial attacks that may thwart the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Neha A S , Vivek Chaturvedi , Muhammad Shafique

Adversarial training and adversarial purification are two widely used defense strategies for enhancing model robustness against adversarial attacks. However, adversarial training requires costly retraining, while adversarial purification…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Xuelong Dai , Dong Wang , Xiuzhen Cheng , Bin Xiao

In this paper, we ask whether Vision Transformers (ViTs) can serve as an underlying architecture for improving the adversarial robustness of machine learning models against evasion attacks. While earlier works have focused on improving…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Edoardo Debenedetti , Vikash Sehwag , Prateek Mittal

Deep Neural Networks (DNNs) are highly sensitive to imperceptible malicious perturbations, known as adversarial attacks. Following the discovery of this vulnerability in real-world imaging and vision applications, the associated safety…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Tsachi Blau , Roy Ganz , Bahjat Kawar , Alex Bronstein , Michael Elad

Recent studies have revealed that vision transformers (ViTs) face similar security risks from adversarial attacks as deep convolutional neural networks (CNNs). However, directly applying attack methodology on CNNs to ViTs has been…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Chao Zhou , Xiaowen Shi , Yuan-Gen Wang

Although deep learning-based visual tracking methods have made significant progress, they exhibit vulnerabilities when facing carefully designed adversarial attacks, which can lead to a sharp decline in tracking performance. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Long Xu , Peng Gao , Wen-Jia Tang , Fei Wang , Ru-Yue Yuan