English
Related papers

Related papers: PatchCensor: Patch Robustness Certification for Tr…

200 papers

Adversarial patch attacks pose a severe threat to deep neural networks, yet most existing approaches rely on unrealistic white-box assumptions, untargeted objectives, or produce visually conspicuous patches that limit real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Roie Kazoom , Alon Goldberg , Hodaya Cohen , Ofer Hadar

Vision Transformer (ViT) has emerged as a powerful architecture in the realm of modern computer vision. However, its application in certain imaging fields, such as microscopy and satellite imaging, presents unique challenges. In these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yujia Bao , Srinivasan Sivanandan , Theofanis Karaletsos

Certifiably robust defenses against adversarial patches for image classifiers ensure correct prediction against any changes to a constrained neighborhood of pixels. PatchCleanser arXiv:2108.09135 [cs.CV], the state-of-the-art certified…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Aniruddha Saha , Shuhua Yu , Arash Norouzzadeh , Wan-Yi Lin , Chaithanya Kumar Mummadi

Adversarial training (AT) can help improve the robustness of Vision Transformers (ViT) against adversarial attacks by intentionally injecting adversarial examples into the training data. However, this way of adversarial injection inevitably…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Fudong Lin , Jiadong Lou , Xu Yuan , Nian-Feng Tzeng

Patch adversarial attacks on images, in which the attacker can distort pixels within a region of bounded size, are an important threat model since they provide a quantitative model for physical adversarial attacks. In this paper, we…

Machine Learning · Computer Science 2021-01-11 Alexander Levine , Soheil Feizi

Vision Transformers (ViTs) are increasingly used in computer vision due to their high performance, but their vulnerability to adversarial attacks is a concern. Existing methods lack a solid theoretical basis, focusing mainly on empirical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Xixu Hu , Runkai Zheng , Jindong Wang , Cheuk Hang Leung , Qi Wu , Xing Xie

State-of-the-art defenses against adversarial patch attacks can now achieve strong certifiable robustness with a marginal drop in model utility. However, this impressive performance typically comes at the cost of 10-100x more inference-time…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Chong Xiang , Tong Wu , Sihui Dai , Jonathan Petit , Suman Jana , Prateek Mittal

Adversarial patches are optimized contiguous pixel blocks in an input image that cause a machine-learning model to misclassify it. However, their optimization is computationally demanding, and requires careful hyperparameter tuning,…

Cryptography and Security · Computer Science 2025-01-16 Maura Pintor , Daniele Angioni , Angelo Sotgiu , Luca Demetrio , Ambra Demontis , Battista Biggio , Fabio Roli

Convolutional Neural Networks (CNNs) have become the de facto gold standard in computer vision applications in the past years. Recently, however, new model architectures have been proposed challenging the status quo. The Vision Transformer…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Philipp Benz , Soomin Ham , Chaoning Zhang , Adil Karjauv , In So Kweon

Vision transformers (ViTs) have demonstrated impressive performance and stronger adversarial robustness compared to Convolutional Neural Networks (CNNs). On the one hand, ViTs' focus on global interaction between individual patches reduces…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Yucheng Shi , Yahong Han , Yu-an Tan , Xiaohui Kuang

Adversarial patch attacks that craft the pixels in a confined region of the input images show their powerful attack effectiveness in physical environments even with noises or deformations. Existing certified defenses towards adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Husheng Han , Kaidi Xu , Xing Hu , Xiaobing Chen , Ling Liang , Zidong Du , Qi Guo , Yanzhi Wang , Yunji Chen

This paper studies the efficiency problem for visual transformers by excavating redundant calculation in given networks. The recent transformer architecture has demonstrated its effectiveness for achieving excellent performance on a series…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Yehui Tang , Kai Han , Yunhe Wang , Chang Xu , Jianyuan Guo , Chao Xu , Dacheng Tao

Although convolutional networks have been the dominant architecture for vision tasks for many years, recent experiments have shown that Transformer-based models, most notably the Vision Transformer (ViT), may exceed their performance in…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Asher Trockman , J. Zico Kolter

Recent studies show that Vision Transformers(ViTs) exhibit strong robustness against various corruptions. Although this property is partly attributed to the self-attention mechanism, there is still a lack of systematic understanding. In…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Daquan Zhou , Zhiding Yu , Enze Xie , Chaowei Xiao , Anima Anandkumar , Jiashi Feng , Jose M. Alvarez

Vision transformers (ViTs) have gained increasing popularity as they are commonly believed to own higher modeling capacity and representation flexibility, than traditional convolutional networks. However, it is questionable whether such…

Machine Learning · Computer Science 2022-03-15 Tianlong Chen , Zhenyu Zhang , Yu Cheng , Ahmed Awadallah , Zhangyang Wang

3D vision with real-time LiDAR-based point cloud data became a vital part of autonomous system research, especially perception and prediction modules use for object classification, segmentation, and detection. Despite their success, point…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Arup Kumar Sarker , Farzana Yasmin Ahmad , Matthew B. Dwyer

Previous studies have shown the vulnerability of vision transformers to adversarial patches, but these studies all rely on a critical assumption: the attack patches must be perfectly aligned with the patches used for linear projection in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Mingzhen Shao

Vision transformers (ViTs) have achieved promising results on a variety of Computer Vision tasks, however their quadratic complexity in the number of input tokens has limited their application specially in resource-constrained settings.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Wentao Zhu

Vision Transformers (ViTs) that leverage self-attention mechanism have shown superior performance on many classical vision tasks compared to convolutional neural networks (CNNs) and gain increasing popularity recently. Existing ViTs works…

Cryptography and Security · Computer Science 2024-04-29 Xinghua Xue , Cheng Liu , Ying Wang , Bing Yang , Tao Luo , Lei Zhang , Huawei Li , Xiaowei Li

Adversarial patches are physically realizable localized noise, which are able to hijack Vision Transformers (ViT) self-attention, pulling focus toward a small, high-contrast region and corrupting the class token to force confident…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Nandish Chattopadhyay , Anadi Goyal , Chandan Karfa , Anupam Chattopadhyay