中文
相关论文

相关论文: Jailbreaks on Vision Language Model via Multimodal…

200 篇论文

Jailbreak attacks can circumvent model safety guardrails and reveal critical blind spots. Prior attacks on text-to-video (T2V) models typically add adversarial perturbations to obviously unsafe prompts, which are often easy to detect and…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Zonghao Ying , Moyang Chen , Nizhang Li , Zhiqiang Wang , Wenxin Zhang , Quanchen Zou , Zonglei Jing , Aishan Liu , Xianglong Liu

Large Vision-Language Models (LVLMs) rely on attention-based retrieval of safety instructions to maintain alignment during generation. Existing attacks typically optimize image perturbations to maximize harmful output likelihood, but suffer…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Jingru Li , Wei Ren , Tianqing Zhu

The proliferation of large language models (LLMs) has underscored concerns regarding their security vulnerabilities, notably against jailbreak attacks, where adversaries design jailbreak prompts to circumvent safety mechanisms for potential…

密码学与安全 · 计算机科学 2025-06-10 Yingchaojie Feng , Zhizhang Chen , Zhining Kang , Sijia Wang , Haoyu Tian , Wei Zhang , Minfeng Zhu , Wei Chen

Vision-Language Models (VLMs) have achieved remarkable performance on a variety of tasks, yet they remain vulnerable to jailbreak attacks that compromise safety and reliability. In this paper, we provide an information-theoretic framework…

机器学习 · 计算机科学 2025-02-04 Ching-Chia Kao , Chia-Mu Yu , Chun-Shien Lu , Chu-Song Chen

The emergence of Multimodal Large Language Models (MLRMs) has enabled sophisticated visual reasoning capabilities by integrating reinforcement learning and Chain-of-Thought (CoT) supervision. However, while these enhanced reasoning…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Bingrui Sima , Linhua Cong , Wenxuan Wang , Kun He

Despite extensive alignment efforts, Large Vision-Language Models (LVLMs) remain vulnerable to jailbreak attacks, posing serious safety risks. To address this, existing detection methods either learn attack-specific parameters, which…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Shuang Liang , Zhihao Xu , Jialing Tao , Hui Xue , Xiting Wang

Text-to-Image(T2I) models typically deploy safety filters to prevent the generation of sensitive images. Unfortunately, recent jailbreaking attack methods manually design instructions for the LLM to generate adversarial prompts, which…

密码学与安全 · 计算机科学 2025-11-24 Chenyu Zhang , Lanjun Wang , Yiwen Ma , Wenhui Li , An-An Liu

Large Language Models (LLMs) remain susceptible to jailbreak exploits that bypass safety filters and induce harmful or unethical behavior. This work presents a systematic taxonomy of existing jailbreak defenses across prompt-level,…

密码学与安全 · 计算机科学 2025-11-25 Ryan Wong , Hosea David Yu Fei Ng , Dhananjai Sharma , Glenn Jun Jie Ng , Kavishvaran Srinivasan

Contextual priming, where earlier stimuli covertly bias later judgments, offers an unexplored attack surface for large language models (LLMs). We uncover a contextual priming vulnerability in which the previous response in the dialogue can…

计算与语言 · 计算机科学 2025-11-24 Ziqi Miao , Lijun Li , Yuan Xiong , Zhenhua Liu , Pengyu Zhu , Jing Shao

Text-to-image generative models are widely deployed in creative tools and online platforms. To mitigate misuse, these systems rely on safety filters and moderation pipelines that aim to block harmful or policy violating content. In this…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Ahmed B Mustafa , Zihan Ye , Yang Lu , Michael P Pound , Shreyank N Gowda

Multimodal large language models (MLLMs) are widely used in vision-language reasoning tasks. However, their vulnerability to adversarial prompts remains a serious concern, as safety mechanisms often fail to prevent the generation of harmful…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Zuoou Li , Weitong Zhang , Jingyuan Wang , Shuyuan Zhang , Wenjia Bai , Bernhard Kainz , Mengyun Qiao

Large language models (LLMs) are vital for a wide range of applications yet remain susceptible to jailbreak threats, which could lead to the generation of inappropriate responses. Conventional defenses, such as refusal and adversarial…

密码学与安全 · 计算机科学 2026-01-29 Xianglin Yang , Gelei Deng , Jieming Shi , Tianwei Zhang , Jin Song Dong

Large language models (LLMs) remain vulnerable to sophisticated prompt engineering attacks that exploit contextual framing to bypass safety mechanisms, posing significant risks in cybersecurity applications. We introduce Jailbreak Mimicry,…

密码学与安全 · 计算机科学 2025-10-28 Pavlos Ntais

The rapid advancement of Multimodal Large Language Models (MLLMs) has introduced complex security challenges, particularly at the intersection of textual and visual safety. While existing schemes have explored the security vulnerabilities…

计算机视觉与模式识别 · 计算机科学 2026-01-23 Mingyu Yu , Lana Liu , Zhehao Zhao , Wei Wang , Sujuan Qin

Multi-turn jailbreak attacks have proven effective against text-only large language models (LLMs), where malicious content is gradually introduced to bypass safety alignment. However, effectively extending such attacks to large…

计算机视觉与模式识别 · 计算机科学 2026-05-29 In Chong Choi , Jiacheng Zhang , Feng Liu , Yiliao Song

In deployment and application, large language models (LLMs) typically undergo safety alignment to prevent illegal and unethical outputs. However, the continuous advancement of jailbreak attack techniques, designed to bypass safety…

密码学与安全 · 计算机科学 2025-09-05 Chuhan Zhang , Ye Zhang , Bowen Shi , Yuyou Gan , Tianyu Du , Shouling Ji , Dazhan Deng , Yingcai Wu

Think-with-image reasoning is emerging as a new inference paradigm for large vision-language models, but its safety implications remain poorly understood. Existing systems already span multiple process designs, including direct response…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Yuan Tian , Bing Hu , Fang Wu , Xiaomin Li , Binghang Lu , Neil Zhenqiang Gong

Multimodal Large Language Models (MLLMs), which integrate vision and other modalities into Large Language Models (LLMs), significantly enhance AI capabilities but also introduce new security vulnerabilities. By exploiting the…

密码学与安全 · 计算机科学 2025-10-10 Aofan Liu , Lulu Tang , Ting Pan , Yuguo Yin , Bin Wang , Ao Yang

We discover a novel and surprising phenomenon of unintentional misalignment in reasoning language models (RLMs), which we call self-jailbreaking. Specifically, after benign reasoning training on math or code domains, RLMs will use multiple…

密码学与安全 · 计算机科学 2026-04-30 Zheng-Xin Yong , Stephen H. Bach

Vision language models (VLMs) extend the reasoning capabilities of large language models (LLMs) to cross-modal settings, yet remain highly vulnerable to multimodal jailbreak attacks. Existing defenses predominantly rely on safety…

人工智能 · 计算机科学 2026-04-14 Mengxuan Wang , Yuxin Chen , Gang Xu , Tao He , Hongjie Jiang , Ming Li