English
Related papers

Related papers: Prompt-driven Transferable Adversarial Attack on P…

200 papers

Adversarial example detection plays a vital role in adaptive cyber defense, especially in the face of rapidly evolving attacks. In adaptive cyber defense, the nature and characteristics of attacks continuously change, making it crucial to…

Cryptography and Security · Computer Science 2023-08-31 Atefeh Mahdavi , Neda Keivandarian , Marco Carvalho

Vision-language pre-training (VLP) models excel at interpreting both images and text but remain vulnerable to multimodal adversarial examples (AEs). Advancing the generation of transferable AEs, which succeed across unseen models, is key to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Xiaojun Jia , Sensen Gao , Qing Guo , Ke Ma , Yihao Huang , Simeng Qin , Yang Liu , Ivor Tsang Fellow , Xiaochun Cao

Vision foundation models are increasingly employed in autonomous driving systems due to their advanced capabilities. However, these models are susceptible to adversarial attacks, posing significant risks to the reliability and safety of…

Multimedia · Computer Science 2024-07-19 Jiyuan Fu , Zhaoyu Chen , Kaixun Jiang , Haijing Guo , Shuyong Gao , Wenqiang Zhang

The wide-ranging applications of large language models (LLMs), especially in safety-critical domains, necessitate the proper evaluation of the LLM's adversarial robustness. This paper proposes an efficient tool to audit the LLM's…

Cryptography and Security · Computer Science 2023-10-23 Xilie Xu , Keyi Kong , Ning Liu , Lizhen Cui , Di Wang , Jingfeng Zhang , Mohan Kankanhalli

Defending pre-trained vision-language models (VLMs), such as CLIP, against adversarial attacks is crucial, as these models are widely used in diverse zero-shot tasks, including image classification. However, existing adversarial training…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Futa Waseda , Saku Sugawara , Isao Echizen

As the AI systems become deeply embedded in social media platforms, we've uncovered a concerning security vulnerability that goes beyond traditional adversarial attacks. It becomes important to assess the risks of LLMs before the general…

Computation and Language · Computer Science 2025-05-30 Nilanjana Das , Edward Raff , Aman Chadha , Manas Gaur

Adversarial perturbations can mislead Multimodal Large Language Models (MLLMs) recognize a benign image as a specific target object, posing serious risks in safety-critical scenarios such as autonomous driving and medical diagnosis. This…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Haobo Wang , Xiaorong Ma , Weiqi Luo , Xiaojun Jia , Jiwu Huang

Most discussions about Large Language Model (LLM) safety have focused on single-agent settings but multi-agent LLM systems now create novel adversarial risks because their behavior depends on communication between agents and decentralized…

Multiagent Systems · Computer Science 2025-10-10 Rana Muhammad Shahroz Khan , Zhen Tan , Sukwon Yun , Charles Fleming , Tianlong Chen

Large vision-language models (LVLMs) have demonstrated their incredible capability in image understanding and response generation. However, this rich visual interaction also makes LVLMs vulnerable to adversarial examples. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Xunguang Wang , Zhenlan Ji , Pingchuan Ma , Zongjie Li , Shuai Wang

Large vision-language models (LVLMs) integrate visual information into large language models, showcasing remarkable multi-modal conversational capabilities. However, the visual modules introduces new challenges in terms of robustness for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yubo Wang , Chaohu Liu , Yanqiu Qu , Haoyu Cao , Deqiang Jiang , Linli Xu

Transferable adversarial attack has drawn increasing attention due to their practical threaten to real-world applications. In particular, the feature-level adversarial attack is one recent branch that can enhance the transferability via…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Xianglong , Yuezun Li , Haipeng Qu , Junyu Dong

As Contrastive Language-Image Pre-training (CLIP) models are increasingly adopted for diverse downstream tasks and integrated into large vision-language models (VLMs), their susceptibility to adversarial perturbations has emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Hanxun Huang , Sarah Erfani , Yige Li , Xingjun Ma , James Bailey

Text attribute person search aims to find specific pedestrians through given textual attributes, which is very meaningful in the scene of searching for designated pedestrians through witness descriptions. The key challenge is the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Xin Wang , Fangfang Liu , Zheng Li , Caili Guo

The conventional targeted adversarial attacks add a small perturbation to an image to make neural network models estimate the image as a predefined target class, even if it is not the correct target class. Recently, for visual-language…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Jonggyu Jang , Hyeonsu Lyu , Jungyeon Koh , Hyun Jong Yang

Multimodal Large Language Models (MLLMs), built upon LLMs, have recently gained attention for their capabilities in image recognition and understanding. However, while MLLMs are vulnerable to adversarial attacks, the transferability of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Chenhe Gu , Jindong Gu , Andong Hua , Yao Qin

Despite the substantial advancements in Vision-Language Pre-training (VLP) models, their susceptibility to adversarial attacks poses a significant challenge. Existing work rarely studies the transferability of attacks on VLP models,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jiyuan Fu , Zhaoyu Chen , Kaixun Jiang , Haijing Guo , Jiafeng Wang , Shuyong Gao , Wenqiang Zhang

Vision Large Language Models (VLLMs) are increasingly deployed to offer advanced capabilities on inputs comprising both text and images. While prior research has shown that adversarial attacks can transfer from open-source to proprietary…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Kai Hu , Weichen Yu , Li Zhang , Alexander Robey , Andy Zou , Chengming Xu , Haoqi Hu , Matt Fredrikson

Pre-trained vision-language models (VLMs) have showcased remarkable performance in image and natural language understanding, such as image captioning and response generation. As the practical applications of vision-language models become…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Peng Xie , Yequan Bie , Jianda Mao , Yangqiu Song , Yang Wang , Hao Chen , Kani Chen

Vision-language pre-trained (VLP) models have been the foundation of numerous vision-language tasks. Given their prevalence, it becomes imperative to assess their adversarial robustness, especially when deploying them in security-crucial…

Computer Vision and Pattern Recognition · Computer Science 2024-05-12 Peng-Fei Zhang , Zi Huang , Guangdong Bai

Vision-language models (VLMs) (e.g. CLIP, LLaVA) are trained on large-scale, lightly curated web datasets, leading them to learn unintended correlations between semantic concepts and unrelated visual signals. These associations degrade…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Maan Qraitem , Piotr Teterwak , Kate Saenko , Bryan A. Plummer