English
Related papers

Related papers: VRSA: Jailbreaking Multimodal Large Language Model…

200 papers

Large Reasoning Models (LRMs) have demonstrated strong capabilities in generating step-by-step reasoning chains alongside final answers, enabling their deployment in high-stakes domains such as healthcare and education. While prior…

Machine Learning · Computer Science 2026-04-20 Zehao Wang , Lanjun Wang

Vision-Language Models (VLMs) have achieved remarkable progress in multimodal reasoning tasks through enhanced chain-of-thought capabilities. However, this advancement also introduces novel safety risks, as these models become increasingly…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Yinan Xia , Yilei Jiang , Yingshui Tan , Xiaoyong Zhu , Xiangyu Yue , Bo Zheng

Multi-turn jailbreak attacks have proven effective against text-only large language models (LLMs), where malicious content is gradually introduced to bypass safety alignment. However, effectively extending such attacks to large…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 In Chong Choi , Jiacheng Zhang , Feng Liu , Yiliao Song

With the significant advancement of Large Vision-Language Models (VLMs), concerns about their potential misuse and abuse have grown rapidly. Previous studies have highlighted VLMs' vulnerability to jailbreak attacks, where carefully crafted…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Yu Wang , Xiaofei Zhou , Yichen Wang , Geyuan Zhang , Tianxing He

Recently, there has been a surge of interest in integrating vision into Large Language Models (LLMs), exemplified by Visual Language Models (VLMs) such as Flamingo and GPT-4. This paper sheds light on the security and safety implications of…

Cryptography and Security · Computer Science 2023-08-21 Xiangyu Qi , Kaixuan Huang , Ashwinee Panda , Peter Henderson , Mengdi Wang , Prateek Mittal

Large Vision-Language Models (LVLMs) demonstrate exceptional performance across multimodal tasks, yet remain vulnerable to jailbreak attacks that bypass built-in safety mechanisms to elicit restricted content generation. Existing black-box…

Computation and Language · Computer Science 2025-06-23 Lei Jiang , Zixun Zhang , Zizhou Wang , Xiaobing Sun , Zhen Li , Liangli Zhen , Xiaohua Xu

Multi-modal Large Language Models (MLLMs) excel in vision-language tasks but remain vulnerable to visual adversarial perturbations that can induce hallucinations, manipulate responses, or bypass safety mechanisms. Existing methods seek to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Hashmat Shadab Malik , Fahad Shamshad , Muzammal Naseer , Karthik Nandakumar , Fahad Khan , Salman Khan

Large Language Models (LLMs) and Vision Language Models (VLMs) have demonstrated impressive capabilities but remain vulnerable to jailbreaking attacks, where adversaries exploit textual or visual triggers to bypass safety guardrails. Recent…

Cryptography and Security · Computer Science 2026-05-15 Yi Wang , Hongye Qiu , Yue Xu , Sibei Yang , Zhan Qin , Minlie Huang , Wenjie Wang

While Multimodal Large Language Models (MLLMs) show remarkable capabilities, their safety alignments are susceptible to jailbreak attacks. Existing attack methods typically focus on text-image interplay, treating the visual modality as a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yuan Xiong , Ziqi Miao , Lijun Li , Chen Qian , Jie Li , Jing Shao

Jailbreak attacks against multimodal large language Models (MLLMs) are a significant research focus. Current research predominantly focuses on maximizing attack success rate (ASR), often overlooking whether the generated responses actually…

Vision-Language Models (VLMs) have garnered significant attention for their remarkable ability to interpret and generate multimodal content. However, securing these models against jailbreak attacks continues to be a substantial challenge.…

Cryptography and Security · Computer Science 2025-10-14 Aofan Liu , Lulu Tang

The visual modality of vision-language models (VLMs) is an underexplored attack surface for bypassing safety alignment. We introduce four jailbreak attacks exploiting the vision component: (1) encoding harmful instructions as visual symbol…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Aharon Azulay , Jan Dubiński , Zhuoyun Li , Atharv Mittal , Yossi Gandelsman

Vision language models (VLMs) extend the reasoning capabilities of large language models (LLMs) to cross-modal settings, yet remain highly vulnerable to multimodal jailbreak attacks. Existing defenses predominantly rely on safety…

Artificial Intelligence · Computer Science 2026-04-14 Mengxuan Wang , Yuxin Chen , Gang Xu , Tao He , Hongjie Jiang , Ming Li

Recent advances in Large Vision-Language Models (LVLMs) have showcased strong reasoning abilities across multiple modalities, achieving significant breakthroughs in various real-world applications. Despite this great success, the safety…

Computation and Language · Computer Science 2024-12-02 Chenhang Cui , Gelei Deng , An Zhang , Jingnan Zheng , Yicong Li , Lianli Gao , Tianwei Zhang , Tat-Seng Chua

Multimodal large language models (MLLMs) have achieved remarkable progress, yet remain critically vulnerable to adversarial attacks that exploit weaknesses in cross-modal processing. We present a systematic study of multimodal jailbreaks…

Cryptography and Security · Computer Science 2025-10-24 Divyanshu Kumar , Shreyas Jena , Nitin Aravind Birur , Tanay Baswa , Sahil Agarwal , Prashanth Harshangi

This paper provides a systematic survey of jailbreak attacks and defenses on Large Language Models (LLMs) and Vision-Language Models (VLMs), emphasizing that jailbreak vulnerabilities stem from structural factors such as incomplete training…

Cryptography and Security · Computer Science 2026-01-08 Zejian Chen , Chaozhuo Li , Chao Li , Xi Zhang , Litian Zhang , Yiming He

We introduce new jailbreak attacks on vision language models (VLMs), which use aligned LLMs and are resilient to text-only jailbreak attacks. Specifically, we develop cross-modality attacks on alignment where we pair adversarial images…

Cryptography and Security · Computer Science 2023-10-12 Erfan Shayegani , Yue Dong , Nael Abu-Ghazaleh

Safeguarding vision-language models (VLMs) is a critical challenge, as existing methods often suffer from over-defense, which harms utility, or rely on shallow alignment, failing to detect complex threats that require deep reasoning. To…

Cryptography and Security · Computer Science 2026-04-03 Nanxi Li , Zhengyue Zhao , G. Edward Suh , Marco Pavone , Chaowei Xiao

Vision-Language Models (VLMs) have shown remarkable performance, yet their security remains insufficiently understood. Existing adversarial studies focus almost exclusively on the digital setting, leaving physical-world threats largely…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Yingying Zhao , Chengyin Hu , Qike Zhang , Xin Li , Xin Wang , Yiwei Wei , Jiujiang Guo , Jiahuan Long , Tingsong Jiang , Wen Yao

Multimodal large language models (MLLMs) are widely used in vision-language reasoning tasks. However, their vulnerability to adversarial prompts remains a serious concern, as safety mechanisms often fail to prevent the generation of harmful…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Zuoou Li , Weitong Zhang , Jingyuan Wang , Shuyuan Zhang , Wenjia Bai , Bernhard Kainz , Mengyun Qiao