English
Related papers

Related papers: Towards Highly Transferable Vision-Language Attack…

200 papers

The vulnerability of deep neural networks to adversarial attacks has been widely demonstrated (e.g., adversarial example attacks). Traditional attacks perform unstructured pixel-wise perturbation to fool the classifier. An alternative…

Machine Learning · Computer Science 2022-05-23 Shuo Wang , Surya Nepal , Carsten Rudolph , Marthie Grobler , Shangyu Chen , Tianle Chen

Vision-language models (VLMs) are vulnerable to adversarial image perturbations. Existing works based on adversarial training against task-specific adversarial examples are computationally expensive and often fail to generalize to unseen…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Jingning Xu , Haochen Luo , Chen Liu

Current adversarial attack research reveals the vulnerability of learning-based classifiers against carefully crafted perturbations. However, most existing attack methods have inherent limitations in cross-dataset generalization as they…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Cheng Luo , Qinliang Lin , Weicheng Xie , Bizhu Wu , Jinheng Xie , Linlin Shen

Deep neural networks are vulnerable to adversarial examples that mislead models with imperceptible perturbations. In audio, although adversarial examples have achieved incredible attack success rates on white-box settings and black-box…

Sound · Computer Science 2022-10-13 Deng JiaCheng , Dong Li , Yan Diqun , Wang Rangding , Zeng Jiaming

Deep neural networks are susceptible to adversarial examples while suffering from incorrect predictions via imperceptible perturbations. Transfer-based attacks create adversarial examples for surrogate models and transfer these examples to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Jinjia Peng , Zeze Tao , Huibing Wang , Meng Wang , Yang Wang

Pretrained vision-language models (VLMs) like CLIP exhibit exceptional generalization across diverse downstream tasks. While recent studies reveal their vulnerability to adversarial attacks, research to date has primarily focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Wanqi Zhou , Shuanghao Bai , Danilo P. Mandic , Qibin Zhao , Badong Chen

Adversarial attacks, particularly \textbf{targeted} transfer-based attacks, can be used to assess the adversarial robustness of large visual-language models (VLMs), allowing for a more thorough examination of potential security flaws before…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Qi Guo , Shanmin Pang , Xiaojun Jia , Yang Liu , Qing Guo

In typical multimodal tasks, such as Visual Question Answering (VQA), adversarial attacks targeting a specific image and question can lead large vision-language models (LVLMs) to provide incorrect answers. However, it is common for a single…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Yudong Zhang , Ruobing Xie , Jiansheng Chen , Xingwu Sun , Zhanhui Kang , Yu Wang

Transfer adversarial attack is a non-trivial black-box adversarial attack that aims to craft adversarial perturbations on the surrogate model and then apply such perturbations to the victim model. However, the transferability of…

Machine Learning · Computer Science 2021-12-14 Shuman Fang , Jie Li , Xianming Lin , Rongrong Ji

As a general-purpose vision-language pretraining model, CLIP demonstrates strong generalization ability in image-text alignment tasks and has been widely adopted in downstream applications such as image classification and image-text…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Kuanrong Liu , Siyuan Liang , Cheng Qian , Ming Zhang , Xiaochun Cao

With Vision-Language Pre-training (VLP) models demonstrating powerful multimodal interaction capabilities, the application scenarios of neural networks are no longer confined to unimodal domains but have expanded to more complex multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Haonan Zheng , Xinyang Deng , Wen Jiang , Wenrui Li

Generative adversarial networks (GANs) have made remarkable achievements in synthesizing images in recent years. Typically, training GANs requires massive data, and the performance of GANs deteriorates significantly when training data is…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Mengping Yang , Zhe Wang , Ziqiu Chi , Dongdong Li , Wenli Du

With the advancement of vision transformers (ViTs) and self-supervised learning (SSL) techniques, pre-trained large ViTs have become the new foundation models for computer vision applications. However, studies have shown that, like…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Weijie Zheng , Xingjun Ma , Hanxun Huang , Zuxuan Wu , Yu-Gang Jiang

Traditional adversarial attacks typically produce adversarial examples under norm-constrained conditions, whereas unrestricted adversarial examples are free-form with semantically meaningful perturbations. Current unrestricted adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Wenyun Li , Zheng Zhang , Xiangyuan Lan , Dongmei Jiang

Adversarial attacks on Natural Language Processing (NLP) models expose vulnerabilities by introducing subtle perturbations to input text, often leading to misclassification while maintaining human readability. Existing methods typically…

Cryptography and Security · Computer Science 2025-06-12 Hetvi Waghela , Jaydip Sen , Sneha Rakshit , Subhasis Dasgupta

The growing misuse of Vision-Language Models (VLMs) has led providers to deploy multiple safeguards, including alignment tuning, system prompts, and content moderation. However, the real-world robustness of these defenses against…

Cryptography and Security · Computer Science 2025-11-21 Yijun Yang , Lichao Wang , Jianping Zhang , Chi Harold Liu , Lanqing Hong , Qiang Xu

Deep learning models can be fooled by small $l_p$-norm adversarial perturbations and natural perturbations in terms of attributes. Although the robustness against each perturbation has been explored, it remains a challenge to address the…

Machine Learning · Computer Science 2023-04-11 Dashan Gao , Yunce Zhao , Yinghua Yao , Zeqi Zhang , Bifei Mao , Xin Yao

Vision-Large-Language-Models (Vision-LLMs) are increasingly being integrated into autonomous driving (AD) systems due to their advanced visual-language reasoning capabilities, targeting the perception, prediction, planning, and control…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Nhat Chung , Sensen Gao , Tuan-Anh Vu , Jie Zhang , Aishan Liu , Yun Lin , Jin Song Dong , Qing Guo

Vision-Language Pre-training (VLP) models have exhibited unprecedented capability in many applications by taking full advantage of the multimodal alignment. However, previous studies have shown they are vulnerable to maliciously crafted…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Hao Fang , Jiawei Kong , Wenbo Yu , Bin Chen , Jiawei Li , Hao Wu , Shutao Xia , Ke Xu

Adversarial attacks have evolved from simply disrupting predictions on conventional task-specific models to the more complex goal of manipulating image semantics on Large Vision-Language Models (LVLMs). However, existing methods struggle…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Sen Nie , Jie Zhang , Jianxin Yan , Shiguang Shan , Xilin Chen