中文
相关论文

相关论文: Beyond Text: Multimodal Jailbreaking of Vision-Lan…

200 篇论文

Video Multimodal Large Language Models (V-MLLMs) have shown impressive capabilities in temporal reasoning and cross-modal understanding, yet their vulnerability to adversarial attacks remains underexplored due to unique challenges: complex…

计算机视觉与模式识别 · 计算机科学 2025-07-02 Jiaming Zhang , Rui Hu , Qing Guo , Wei Yang Bryan Lim

Large Language Models (LLMs) have seen rapid adoption in recent years, with industries increasingly relying on them to maintain a competitive advantage. These models excel at interpreting user instructions and generating human-like…

密码学与安全 · 计算机科学 2025-09-09 Andrew Yeo , Daeseon Choi

Multi-modal Large Language Models (MLLMs) have achieved remarkable performance across a wide range of visual reasoning tasks, yet their vulnerability to safety risks remains a pressing concern. While prior research primarily focuses on…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Ce Zhang , Jinxi He , Junyi He , Katia Sycara , Yaqi Xie

Large Language Models face security threats from jailbreak attacks. Existing research has predominantly focused on prompt-level attacks while largely ignoring the underexplored attack surface of user-controlled response prefilling. This…

密码学与安全 · 计算机科学 2025-08-27 Yakai Li , Jiekang Hu , Weiduan Sang , Luping Ma , Dongsheng Nie , Weijuan Zhang , Aimin Yu , Yi Su , Qingjia Huang , Qihang Zhou

Large Language Models (LLMs) are widely deployed in real-world systems. Given their broader applicability, prompt engineering has become an efficient tool for resource-scarce organizations to adopt LLMs for their own purposes. At the same…

密码学与安全 · 计算机科学 2026-02-27 Piyush Jaiswal , Aaditya Pratap , Shreyansh Saraswati , Harsh Kasyap , Somanath Tripathy

Multimodal Large Language Models (MLLMs) are vulnerable to jailbreak attacks, which can elicit harmful responses from MLLMs. Many MLLMs support multi-image inputs, inadvertently introducing new vulnerabilities due to less efforts on…

密码学与安全 · 计算机科学 2026-05-20 Wenzhuo Xu , Zhipeng Wei , Zonghao Ying , Deyue Zhang , Dongdong Yang , Xiangzheng Zhang , Quanchen Zou

Multi-modal Large Language Models (MLLMs) are increasingly deployed in interactive applications. However, their safety vulnerabilities become pronounced in multi-turn multi-modal scenarios, where harmful intent can be gradually…

计算与语言 · 计算机科学 2026-01-09 Han Zhu , Jiale Chen , Chengkun Cai , Shengjie Sun , Haoran Li , Yujin Zhou , Chi-Min Chan , Pengcheng Wen , Lei Li , Sirui Han , Yike Guo

Despite recent advances, Large Language Models remain vulnerable to jailbreak attacks that bypass alignment safeguards and elicit harmful outputs. While prior research has proposed various attack strategies differing in human readability…

计算与语言 · 计算机科学 2025-10-28 Havva Alizadeh Noughabi , Julien Serbanescu , Fattane Zarrinkalam , Ali Dehghantanha

With the rapid advancement of large language models (LLMs), ensuring their safe use becomes increasingly critical. Fine-tuning is a widely used method for adapting models to downstream tasks, yet it is vulnerable to jailbreak attacks.…

密码学与安全 · 计算机科学 2025-10-10 Xiangfang Li , Yu Wang , Bo Li

Large Language Models (LLMs) have revolutionized Artificial Intelligence (AI) services due to their exceptional proficiency in understanding and generating human-like text. LLM chatbots, in particular, have seen widespread adoption,…

密码学与安全 · 计算机科学 2024-02-14 Gelei Deng , Yi Liu , Yuekang Li , Kailong Wang , Ying Zhang , Zefeng Li , Haoyu Wang , Tianwei Zhang , Yang Liu

The vulnerability of Vision Large Language Models (VLLMs) to jailbreak attacks appears as no surprise. However, recent defense mechanisms against these attacks have reached near-saturation performance on benchmark evaluations, often with…

密码学与安全 · 计算机科学 2025-03-07 Yangyang Guo , Fangkai Jiao , Liqiang Nie , Mohan Kankanhalli

In deployment and application, large language models (LLMs) typically undergo safety alignment to prevent illegal and unethical outputs. However, the continuous advancement of jailbreak attack techniques, designed to bypass safety…

密码学与安全 · 计算机科学 2025-09-05 Chuhan Zhang , Ye Zhang , Bowen Shi , Yuyou Gan , Tianyu Du , Shouling Ji , Dazhan Deng , Yingcai Wu

Multimodal Large Language Models (MLLMs) have achieved remarkable success in cross-modal understanding and generation, yet their deployment is threatened by critical safety vulnerabilities. While prior works have demonstrated the…

密码学与安全 · 计算机科学 2026-04-22 Kun Wang , Cheng Qian , Miao Yu , Lilan Peng , Liang Lin , Jiaming Zhang , Tianyu Zhang , Yu Cheng , Yang Wang

Large Language Models (LLMs) have gained considerable popularity and protected by increasingly sophisticated safety mechanisms. However, jailbreak attacks continue to pose a critical security threat by inducing models to generate…

密码学与安全 · 计算机科学 2025-12-23 Zehao Liu , Xi Lin

Large language models (LLMs) are increasingly utilized in healthcare applications. However, their deployment in clinical practice raises significant safety concerns, including the potential spread of harmful information. This study…

密码学与安全 · 计算机科学 2025-03-05 Hang Zhang , Qian Lou , Yanshan Wang

There has been an increasing interest in the alignment of large language models (LLMs) with human values. However, the safety issues of their integration with a vision module, or vision language models (VLMs), remain relatively…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Xijia Tao , Shuai Zhong , Lei Li , Qi Liu , Lingpeng Kong

Vision-Language Models (VLMs) extend the capabilities of Large Language Models (LLMs) by incorporating visual information, yet they remain vulnerable to jailbreak attacks, especially when processing noisy or corrupted images. Although…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Jiawei Wang , Yushen Zuo , Yuanjun Chai , Zhendong Liu , Yicheng Fu , Yichun Feng , Kin-Man Lam

Large Audio Language Models (LALMs) have extended the capabilities of Large Language Models (LLMs) by enabling audio-based human interactions. However, recent research has revealed that LALMs remain vulnerable to harmful queries due to…

计算与语言 · 计算机科学 2025-05-27 Hao Yang , Lizhen Qu , Ehsan Shareghi , Gholamreza Haffari

The rapid development of Large Language Models (LLMs) has brought impressive advancements across various tasks. However, despite these achievements, LLMs still pose inherent safety risks, especially in the context of jailbreak attacks. Most…

密码学与安全 · 计算机科学 2025-06-19 Shi Lin , Hongming Yang , Rongchang Li , Xun Wang , Changting Lin , Wenpeng Xing , Meng Han

Current vision large language models (VLLMs) exhibit remarkable capabilities yet are prone to generate harmful content and are vulnerable to even the simplest jailbreaking attacks. Our initial analysis finds that this is due to the presence…

机器学习 · 计算机科学 2024-06-19 Yongshuo Zong , Ondrej Bohdal , Tingyang Yu , Yongxin Yang , Timothy Hospedales