English
Related papers

Related papers: Adversarial attacks against Modern Vision-Language…

200 papers

The rapid advancement of Large Vision-Language Models (LVLMs) has enhanced capabilities offering potential applications from content creation to productivity enhancement. Despite their innovative potential, LVLMs exhibit vulnerabilities,…

Cryptography and Security · Computer Science 2025-01-17 Abdulkadir Erol , Trilok Padhi , Agnik Saha , Ugur Kursuncu , Mehmet Emin Aktas

Autonomous agents powered by large vision and language models (VLM) have demonstrated significant potential in completing daily computer tasks, such as browsing the web to book travel and operating desktop software, which requires agents to…

Computation and Language · Computer Science 2025-05-27 Yanzhe Zhang , Tao Yu , Diyi Yang

Multi-modal Large Language Models (MLLMs) have recently achieved enhanced performance across various vision-language tasks including visual grounding capabilities. However, the adversarial robustness of visual grounding remains unexplored…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Kuofeng Gao , Yang Bai , Jiawang Bai , Yong Yang , Shu-Tao Xia

With the advent of Large Vision-Language Models (LVLMs), new attack vectors, such as cognitive bias, prompt injection, and jailbreaking, have emerged. Understanding these attacks promotes system robustness improvement and neural networks…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Chiyu Zhang , Lu Zhou , Xiaogang Xu , Jiafei Wu , Zhe Liu

Large Vision-Language Models (VLMs) have achieved remarkable success in understanding complex real-world scenarios and supporting data-driven decision-making processes. However, VLMs exhibit significant vulnerability against adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Xiaosen Wang , Shaokang Wang , Zhijin Ge , Yuyang Luo , Shudong Zhang

Vision-Language Models (VLMs) are now a core part of modern AI. Recent work proposed several visual jailbreak attacks using single/ holistic images. However, contemporary VLMs demonstrate strong robustness against such attacks due to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Md Rafi Ur Rashid , MD Sadik Hossain Shanto , Vishnu Asutosh Dasu , Shagufta Mehnaz

Autonomous vehicles rely on deep neural networks (DNNs) for traffic sign recognition, lane centering, and vehicle detection, yet these models are vulnerable to attacks that induce misclassification and threaten safety. Existing defenses…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Pedram MohajerAnsari , Amir Salarpour , Michael Kühr , Siyu Huang , Mohammad Hamad , Sebastian Steinhorst , Habeeb Olufowobi , Bing Li , Mert D. Pesé

Large Vision-Language Models (LVLMs) can be vulnerable to adversarial images that subtly bias their outputs toward plausible yet incorrect responses. We introduce a general, efficient, and training-free defense that combines image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Nadav Kadvil , Malak Fares , Ayellet Tal

Large Language Models (LLMs) have revolutionized natural language processing, but their robustness against adversarial attacks remains a critical concern. We presents a novel white-box style attack approach that exposes vulnerabilities in…

Computation and Language · Computer Science 2024-09-16 Zeyu Yang , Zhao Meng , Xiaochen Zheng , Roger Wattenhofer

In typical multimodal tasks, such as Visual Question Answering (VQA), adversarial attacks targeting a specific image and question can lead large vision-language models (LVLMs) to provide incorrect answers. However, it is common for a single…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Yudong Zhang , Ruobing Xie , Jiansheng Chen , Xingwu Sun , Zhanhui Kang , Yu Wang

Visual Language Models (VLMs) are vulnerable to adversarial attacks, especially those from adversarial images, which is however under-explored in literature. To facilitate research on this critical safety problem, we first construct a new…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Youcheng Huang , Fengbin Zhu , Jingkun Tang , Pan Zhou , Wenqiang Lei , Jiancheng Lv , Tat-Seng Chua

Multi-modal Large Language Models (MLLMs) excel in vision-language tasks but remain vulnerable to visual adversarial perturbations that can induce hallucinations, manipulate responses, or bypass safety mechanisms. Existing methods seek to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Hashmat Shadab Malik , Fahad Shamshad , Muzammal Naseer , Karthik Nandakumar , Fahad Khan , Salman Khan

Large vision-language models (LVLMs) integrate visual information into large language models, showcasing remarkable multi-modal conversational capabilities. However, the visual modules introduces new challenges in terms of robustness for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yubo Wang , Chaohu Liu , Yanqiu Qu , Haoyu Cao , Deqiang Jiang , Linli Xu

Pretrained vision-language models (VLMs) like CLIP exhibit exceptional generalization across diverse downstream tasks. While recent studies reveal their vulnerability to adversarial attacks, research to date has primarily focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Wanqi Zhou , Shuanghao Bai , Danilo P. Mandic , Qibin Zhao , Badong Chen

Multimodal Artificial Intelligence (AI) systems, particularly Vision-Language Models (VLMs), have become integral to critical applications ranging from autonomous decision-making to automated document processing. As these systems scale,…

Artificial Intelligence · Computer Science 2025-12-05 M Zeeshan , Saud Satti

Large Language Model (LLM) agents are increasingly used to automate complex workflows, but integrating untrusted external data with privileged execution exposes them to severe security risks, particularly direct and indirect prompt…

Cryptography and Security · Computer Science 2026-04-28 Zonghao Ying , Haozheng Wang , Jiangfan Liu , Quanchen Zou , Aishan Liu , Jian Yang , Yaodong Yang , Xianglong Liu

Video Multimodal Large Language Models (V-MLLMs) have shown impressive capabilities in temporal reasoning and cross-modal understanding, yet their vulnerability to adversarial attacks remains underexplored due to unique challenges: complex…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jiaming Zhang , Rui Hu , Qing Guo , Wei Yang Bryan Lim

As powerful Large Language Models (LLMs) are now widely used for numerous practical applications, their safety is of critical importance. While alignment techniques have significantly improved overall safety, LLMs remain vulnerable to…

Machine Learning · Computer Science 2024-10-28 Samuel Jacob Chacko , Sajib Biswas , Chashi Mahiul Islam , Fatema Tabassum Liza , Xiuwen Liu

Vision-language models are emerging for autonomous driving, yet their robustness to physical adversarial attacks remains unexplored. This paper presents a systematic framework for comparative adversarial evaluation across three VLM…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 David Fernandez , Pedram MohajerAnsari , Amir Salarpour , Long Cheng , Abolfazl Razi , Mert D. Pesé

Recent advances in biometric systems have significantly improved the detection and prevention of fraudulent activities. However, as detection methods improve, attack techniques become increasingly sophisticated. Attacks on face recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Lazaro Janier Gonzalez-Soler , Maciej Salwowski , Christoph Busch