English
Related papers

Related papers: FORCE: Transferable Visual Jailbreaking Attacks vi…

200 papers

Multimodal large language models (MLLMs) are widely used in vision-language reasoning tasks. However, their vulnerability to adversarial prompts remains a serious concern, as safety mechanisms often fail to prevent the generation of harmful…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Zuoou Li , Weitong Zhang , Jingyuan Wang , Shuyuan Zhang , Wenjia Bai , Bernhard Kainz , Mengyun Qiao

Face morphing attacks threaten biometric verification, yet most morphing attack detection (MAD) systems require task-specific training and generalize poorly to unseen attack types. Meanwhile, open-source multimodal large language models…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Marija Ivanovska , Vitomir Štruc

Caution: This paper includes offensive words that could potentially cause unpleasantness. Language models (LMs) are vulnerable to exploitation for adversarial misuse. Training LMs for safety alignment is extensive and makes it hard to…

Machine Learning · Computer Science 2024-02-28 Heegyu Kim , Sehyun Yuk , Hyunsouk Cho

Multimodal Large Language Models (MLLMs) have achieved remarkable performance but remain vulnerable to jailbreak attacks that can induce harmful content and undermine their secure deployment. Previous studies have shown that introducing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yilian Liu , Xiaojun Jia , Guoshun Nan , Jiuyang Lyu , Zhican Chen , Tao Guan , Shuyuan Luo , Zhongyi Zhai , Yang Liu

Black-box adversarial attacks on Large Vision-Language Models (LVLMs) are challenging due to missing gradients and complex multimodal boundaries. While prior state-of-the-art transfer-based approaches like M-Attack perform well using local…

Machine Learning · Computer Science 2026-02-20 Xiaohan Zhao , Zhaoyi Li , Yaxin Luo , Jiacheng Cui , Zhiqiang Shen

Multimodal Large Language Models (MLLMs) are vulnerable to jailbreak attacks, which can elicit harmful responses from MLLMs. Many MLLMs support multi-image inputs, inadvertently introducing new vulnerabilities due to less efforts on…

Cryptography and Security · Computer Science 2026-05-20 Wenzhuo Xu , Zhipeng Wei , Zonghao Ying , Deyue Zhang , Dongdong Yang , Xiangzheng Zhang , Quanchen Zou

Large Vision-Language Models (LVLMs) are vulnerable to a growing array of multimodal jailbreak attacks, necessitating defenses that are both generalizable to novel threats and efficient for practical deployment. Many current strategies fall…

Cryptography and Security · Computer Science 2026-04-21 Peichun Hua , Hao Li , Shanghao Shi , Zhiyuan Yu , Ning Zhang

Large Language Models (LLMs) have become integral to many domains, making their safety a critical priority. Prior jailbreaking research has explored diverse approaches, including prompt optimization, automated red teaming, obfuscation, and…

Computation and Language · Computer Science 2026-02-09 Sung-Hoon Yoon , Ruizhi Qian , Minda Zhao , Weiyue Li , Mengyu Wang

Multimodal large language models (MLLMs) enable powerful cross-modal reasoning capabilities. However, the expanded input space introduces new attack surfaces. Previous jailbreak attacks often inject malicious instructions from text into…

Machine Learning · Computer Science 2025-05-23 Zhaoxin Wang , Handing Wang , Cong Tian , Yaochu Jin

Multimodal Large Language Models (MLLMs) bridge the gap between visual and textual data, enabling a range of advanced applications. However, complex internal interactions among visual elements and their alignment with text can introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Zuopeng Yang , Jiluan Fan , Anli Yan , Erdun Gao , Xin Lin , Tao Li , Kanghua Mo , Changyu Dong

Large Language Models (LLMs) have evolved into Multimodal Large Language Models (MLLMs), significantly enhancing their capabilities by integrating visual information and other types, thus aligning more closely with the nature of human…

Cryptography and Security · Computer Science 2025-06-03 Youze Wang , Wenbo Hu , Yinpeng Dong , Jing Liu , Hanwang Zhang , Richang Hong

As large language models (LLMs) are increasingly deployed, ensuring their safe use is paramount. Jailbreaking, adversarial prompts that bypass model alignment to trigger harmful outputs, present significant risks, with existing studies…

Cryptography and Security · Computer Science 2026-01-01 Yuan Xin , Dingfan Chen , Linyi Yang , Michael Backes , Xiao Zhang

Vision Large Language Models (VLLMs) integrate visual data processing, expanding their real-world applications, but also increasing the risk of generating unsafe responses. In response, leading companies have implemented Multi-Layered…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yijun Yang , Lichao Wang , Xiao Yang , Lanqing Hong , Jun Zhu

The rapid development of Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) has exposed vulnerabilities to various adversarial attacks. This paper provides a comprehensive overview of jailbreaking research targeting…

Computation and Language · Computer Science 2024-06-24 Siyuan Wang , Zhuohan Long , Zhihao Fan , Zhongyu Wei

Large Vision-Language Models (LVLMs) demonstrate exceptional performance across multimodal tasks, yet remain vulnerable to jailbreak attacks that bypass built-in safety mechanisms to elicit restricted content generation. Existing black-box…

Computation and Language · Computer Science 2025-06-23 Lei Jiang , Zixun Zhang , Zizhou Wang , Xiaobing Sun , Zhen Li , Liangli Zhen , Xiaohua Xu

The rise of API-only access to state-of-the-art LLMs highlights the need for effective black-box jailbreak methods to identify model vulnerabilities in real-world settings. Without a principled objective for gradient-based optimization,…

Cryptography and Security · Computer Science 2025-11-07 Anamika Lochab , Lu Yan , Patrick Pynadath , Xiangyu Zhang , Ruqi Zhang

Multimodal large language models (MLLMs) remain vulnerable to transfer-based targeted attacks, where perturbations optimized on open-source surrogate encoders can generalize to closed-source MLLMs. A key challenge for improving adversarial…

Cryptography and Security · Computer Science 2026-05-22 Leitao Yuan , Qinghua Mao , Daizong Liu , Kun Wang , Wenjie Wang , Yan Teng , Jing Shao , Dongrui Liu

There has been an increasing interest in the alignment of large language models (LLMs) with human values. However, the safety issues of their integration with a vision module, or vision language models (VLMs), remain relatively…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Xijia Tao , Shuai Zhong , Lei Li , Qi Liu , Lingpeng Kong

Large Language Models (LLMs) have transformed numerous fields by enabling advanced natural language interactions but remain susceptible to critical vulnerabilities, particularly jailbreak attacks. Current jailbreak techniques, while…

Cryptography and Security · Computer Science 2024-12-12 Yuxi Li , Zhibo Zhang , Kailong Wang , Ling Shi , Haoyu Wang

The field of adversarial robustness has long established that adversarial examples can successfully transfer between image classifiers and that text jailbreaks can successfully transfer between language models (LMs). However, a pair of…

Machine Learning · Computer Science 2025-10-06 Isha Gupta , Rylan Schaeffer , Joshua Kazdan , Ken Ziyu Liu , Sanmi Koyejo