English
Related papers

Related papers: Set-level Guidance Attack: Boosting Adversarial Tr…

200 papers

Visual language pre-training (VLP) models have demonstrated significant success across various domains, yet they remain vulnerable to adversarial attacks. Addressing these adversarial vulnerabilities is crucial for enhancing security in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Dehong Kong , Siyuan Liang , Xiaopeng Zhu , Yuansheng Zhong , Wenqi Ren

Deep neural networks are vulnerable to adversarial examples that exhibit transferability across various models. Numerous approaches are proposed to enhance the transferability of adversarial examples, including advanced optimization, data…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Zhaoyu Chen , Haijing Guo , Kaixun Jiang , Jiyuan Fu , Xinyu Zhou , Dingkang Yang , Hao Tang , Bo Li , Wenqiang Zhang

Video-based multimodal large language models (V-MLLMs) have shown vulnerability to adversarial examples in video-text multimodal tasks. However, the transferability of adversarial videos to unseen models - a common and practical real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Linhao Huang , Xue Jiang , Zhiqiang Wang , Wentao Mo , Xi Xiao , Yong-Jie Yin , Bo Han , Feng Zheng

The growing misuse of Vision-Language Models (VLMs) has led providers to deploy multiple safeguards, including alignment tuning, system prompts, and content moderation. However, the real-world robustness of these defenses against…

Cryptography and Security · Computer Science 2025-11-21 Yijun Yang , Lichao Wang , Jianping Zhang , Chi Harold Liu , Lanqing Hong , Qiang Xu

Pre-trained vision-language models (VLMs) have showcased remarkable performance in image and natural language understanding, such as image captioning and response generation. As the practical applications of vision-language models become…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Peng Xie , Yequan Bie , Jianda Mao , Yangqiu Song , Yang Wang , Hao Chen , Kani Chen

Large Vision-Language Models (LVLMs) are foundational to modern multimodal applications, yet their susceptibility to adversarial attacks remains a critical concern. Prior white-box attacks rarely generalize across tasks, and black-box…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Hefei Mei , Zirui Wang , Chang Xu , Jianyuan Guo , Minjing Dong

Recent studies on AI security have highlighted the vulnerability of Vision-Language Pre-training (VLP) models to subtle yet intentionally designed perturbations in images and texts. Investigating multimodal systems' robustness via…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Haonan Zheng , Wen Jiang , Xinyang Deng , Wenrui Li

Vision-Language (VL) pre-trained models have shown their superiority on many multimodal tasks. However, the adversarial robustness of such models has not been fully explored. Existing approaches mainly focus on exploring the adversarial…

Cryptography and Security · Computer Science 2024-02-07 Ziyi Yin , Muchao Ye , Tianrong Zhang , Tianyu Du , Jinguo Zhu , Han Liu , Jinghui Chen , Ting Wang , Fenglong Ma

Vision-language pre-training (VLP) models excel at interpreting both images and text but remain vulnerable to multimodal adversarial examples (AEs). Advancing the generation of transferable AEs, which succeed across unseen models, is key to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Xiaojun Jia , Sensen Gao , Qing Guo , Ke Ma , Yihao Huang , Simeng Qin , Yang Liu , Ivor Tsang Fellow , Xiaochun Cao

Vision-language models (VLMs) are increasingly used in autonomous driving because they combine visual perception with language-based reasoning, supporting more interpretable decision-making, yet their robustness to physical adversarial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 David Fernandez , Pedram MohajerAnsari , Amir Salarpour , Mert D. Pese

Vision-Language Models (VLMs) are now a core part of modern AI. Recent work proposed several visual jailbreak attacks using single/ holistic images. However, contemporary VLMs demonstrate strong robustness against such attacks due to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Md Rafi Ur Rashid , MD Sadik Hossain Shanto , Vishnu Asutosh Dasu , Shagufta Mehnaz

While neural machine translation (NMT) models achieve success in our daily lives, they show vulnerability to adversarial attacks. Despite being harmful, these attacks also offer benefits for interpreting and enhancing NMT models, thus…

Computation and Language · Computer Science 2024-09-10 Yanni Xue , Haojie Hao , Jiakai Wang , Qiang Sheng , Renshuai Tao , Yu Liang , Pu Feng , Xianglong Liu

Vision-language pre-trained (VLP) models have been the foundation of numerous vision-language tasks. Given their prevalence, it becomes imperative to assess their adversarial robustness, especially when deploying them in security-crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-12 Peng-Fei Zhang , Zi Huang , Guangdong Bai

Neural networks are vulnerable to adversarial examples, malicious inputs crafted to fool trained models. Adversarial examples often exhibit black-box transfer, meaning that adversarial examples for one model can fool another model. However,…

Machine Learning · Computer Science 2020-03-02 Qian Huang , Isay Katsman , Horace He , Zeqi Gu , Serge Belongie , Ser-Nam Lim

Transfer adversarial attack is a non-trivial black-box adversarial attack that aims to craft adversarial perturbations on the surrogate model and then apply such perturbations to the victim model. However, the transferability of…

Machine Learning · Computer Science 2021-12-14 Shuman Fang , Jie Li , Xianming Lin , Rongrong Ji

Multimodal Large Language Models (MLLMs) demonstrate exceptional performance in cross-modality interaction, yet they also suffer adversarial vulnerabilities. In particular, the transferability of adversarial examples remains an ongoing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Hao Cheng , Erjia Xiao , Jiayan Yang , Jinhao Duan , Yichi Wang , Jiahang Cao , Qiang Zhang , Le Yang , Kaidi Xu , Jindong Gu , Renjing Xu

In recent years, research on adversarial attacks has become a hot spot. Although current literature on the transfer-based adversarial attack has achieved promising results for improving the transferability to unseen black-box models, it…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Zheng Yuan , Jie Zhang , Yunpei Jia , Chuanqi Tan , Tao Xue , Shiguang Shan

While Vision-Language-Action (VLA) models have emerged as powerful generalist policies, their severe vulnerability to adversarial patches significantly hinders their deployment in safety-critical domains. Moreover, existing patch attacks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Jiyuan Fu , Kaixun Jiang , Jingkai Jia , Zhaoyu Chen , Xueyao Chen , Lingyi Hong , Shuyong Gao , Chenzhi Tan , Dingkang Yang , Wenqiang Zhang

Vision-language alignment in Large Vision-Language Models (LVLMs) successfully enables LLMs to understand visual input. However, we find that existing vision-language alignment methods fail to transfer the existing safety mechanism for text…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Shicheng Xu , Liang Pang , Yunchang Zhu , Huawei Shen , Xueqi Cheng

Large Vision-Language Models (VLMs) have achieved remarkable success in understanding complex real-world scenarios and supporting data-driven decision-making processes. However, VLMs exhibit significant vulnerability against adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Xiaosen Wang , Shaokang Wang , Zhijin Ge , Yuyang Luo , Shudong Zhang