English
Related papers

Related papers: Towards Robust Vision Transformer via Masked Adapt…

200 papers

Patch attacks, one of the most threatening forms of physical attack in adversarial examples, can lead networks to induce misclassification by modifying pixels arbitrarily in a continuous region. Certifiable patch defense can guarantee…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Zhaoyu Chen , Bo Li , Jianghe Xu , Shuang Wu , Shouhong Ding , Wenqiang Zhang

Vision Transformers are increasingly embedded in industrial systems due to their superior performance, but their memory and power requirements make deploying them to edge devices a challenging task. Hence, model compression techniques are…

Machine Learning · Computer Science 2022-09-29 Swapnil Parekh , Devansh Shah , Pratyush Shukla

Adversarial Training (AT), which is commonly accepted as one of the most effective approaches defending against adversarial examples, can largely harm the standard performance, thus has limited usefulness on industrial-scale production and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Xiaofeng Mao , Yuefeng Chen , Ranjie Duan , Yao Zhu , Gege Qi , Shaokai Ye , Xiaodan Li , Rong Zhang , Hui Xue

Object detection is a central downstream task used to test if pre-trained network parameters confer benefits, such as improved accuracy or training speed. The complexity of object detection methods can make this benchmarking non-trivial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Yanghao Li , Saining Xie , Xinlei Chen , Piotr Dollar , Kaiming He , Ross Girshick

With rich visual data, such as images, becoming readily associated with items, visually-aware recommendation systems (VARS) have been widely used in different applications. Recent studies have shown that VARS are vulnerable to item-image…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Minglei Yin , Bin Liu , Neil Zhenqiang Gong , Xin Li

Adversarial transferability remains a critical challenge in evaluating the robustness of deep neural networks. In security-critical applications, transferability enables black-box attacks without access to model internals, making it a key…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Amira Guesmi , Bassem Ouni , Muhammad Shafique

Large pre-trained Vision Language Models (VLMs) demonstrate excellent generalization capabilities but remain highly susceptible to adversarial examples, posing potential security risks. To improve the robustness of VLMs against adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Shiji Zhao , Qihui Zhu , Shukun Xiong , Shouwei Ruan , Maoxun Yuan , Jialing Tao , Jiexi Liu , Ranjie Duan , Jie Zhang , Jie Zhang , Xingxing Wei

Recently, foundation models based on Vision Transformers (ViTs) have become widely available. However, their fine-tuning process is highly resource-intensive, and it hinders their adoption in several edge or low-energy applications. To this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Alessio Devoto , Federico Alvetreti , Jary Pomponi , Paolo Di Lorenzo , Pasquale Minervini , Simone Scardapane

Vision transformers (ViTs) have been successfully deployed in a variety of computer vision tasks, but they are still vulnerable to adversarial samples. Transfer-based attacks use a local model to generate adversarial samples and directly…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Jianping Zhang , Yizhan Huang , Weibin Wu , Michael R. Lyu

Adversarial training (AT) is a widely recognized defense mechanism to gain the robustness of deep neural networks against adversarial attacks. It is built on min-max optimization (MMO), where the minimizer (i.e., defender) seeks a robust…

Machine Learning · Computer Science 2022-10-06 Yihua Zhang , Guanhua Zhang , Prashant Khanduri , Mingyi Hong , Shiyu Chang , Sijia Liu

Although attention mechanisms have been applied to a variety of deep learning models and have been shown to improve the prediction performance, it has been reported to be vulnerable to perturbations to the mechanism. To overcome the…

Computation and Language · Computer Science 2022-11-23 Shunsuke Kitada , Hitoshi Iyatomi

Due to great success of transformers in many applications such as natural language processing and computer vision, transformers have been successfully applied in automatic modulation classification. We have shown that transformer-based…

Machine Learning · Computer Science 2025-06-16 Lu Zhang , Sangarapillai Lambotharan , Gan Zheng , Guisheng Liao , Basil AsSadhan , Fabio Roli

Although the recent progress is substantial, deep learning methods can be vulnerable to the maliciously generated adversarial examples. In this paper, we present a novel training procedure and a thresholding test strategy, towards robust…

Machine Learning · Computer Science 2018-11-08 Tianyu Pang , Chao Du , Yinpeng Dong , Jun Zhu

Adversarial Training (AT) is one of the most effective methods for developing robust deep neural networks (DNNs). However, AT faces a trade-off problem between clean accuracy and adversarial robustness. In this work, we reveal a surprising…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Yanyun Wang , Qingqing Ye , Li Liu , Zi Liang , Haibo Hu

The vulnerability of deep neural networks to adversarial examples has motivated an increasing number of defense strategies for promoting model robustness. However, the progress is usually hampered by insufficient robustness evaluations. As…

Machine Learning · Computer Science 2021-10-19 Xiao Yang , Yinpeng Dong , Wenzhao Xiang , Tianyu Pang , Hang Su , Jun Zhu

The robustness of Vision-Language Models (VLMs) such as CLIP is critical for their deployment in safety-critical applications like autonomous driving, healthcare diagnostics, and security systems, where accurate interpretation of visual and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Yuhan Liang , Yijun Li , Yumeng Niu , Qianhe Shen , Hangyu Liu

Image stitching seamlessly integrates images captured from varying perspectives into a single wide field-of-view image. Such integration not only broadens the captured scene but also augments holistic perception in computer vision…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Zhiying Jiang , Xingyuan Li , Jinyuan Liu , Xin Fan , Risheng Liu

Understanding the vulnerability of large-scale pre-trained vision-language models like CLIP against adversarial attacks is key to ensuring zero-shot generalization capacity on various downstream tasks. State-of-the-art defense mechanisms…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Fan Yang , Mingxuan Xia , Sangzhou Xia , Chicheng Ma , Hui Hui

Adversarial training (AT) is proved to reliably improve network's robustness against adversarial data. However, current AT with a pre-specified perturbation budget has limitations in learning a robust network. Firstly, applying a…

Machine Learning · Computer Science 2022-10-05 Chaojian Yu , Dawei Zhou , Li Shen , Jun Yu , Bo Han , Mingming Gong , Nannan Wang , Tongliang Liu

Neural Machine Translation (NMT) models have been shown to be vulnerable to adversarial attacks, wherein carefully crafted perturbations of the input can mislead the target model. In this paper, we introduce ACT, a novel adversarial attack…

Computation and Language · Computer Science 2024-02-23 Sahar Sadrizadeh , Ljiljana Dolamic , Pascal Frossard