中文
相关论文

相关论文: Jailbreaking Large Vision Language Models in Intel…

200 篇论文

Multi-modal large language models (MLLMs), capable of processing text, images, and audio, have been widely adopted in various AI applications. However, recent MLLMs integrating images and text remain highly vulnerable to coordinated…

密码学与安全 · 计算机科学 2025-12-19 Zihao Wang , Kar Wai Fok , Vrizlynn L. L. Thing

While safety-aligned large language models (LLMs) are increasingly used as the cornerstone for powerful systems such as multi-agent frameworks to solve complex real-world problems, they still suffer from potential adversarial queries, such…

密码学与安全 · 计算机科学 2025-01-03 Miao Yu , Junfeng Fang , Yingjie Zhou , Xing Fan , Kun Wang , Shirui Pan , Qingsong Wen

Large Language Diffusion Models (LLDMs) exhibit comparable performance to LLMs while offering distinct advantages in inference speed and mathematical reasoning tasks.The precise and rapid generation capabilities of LLDMs amplify concerns of…

计算与语言 · 计算机科学 2025-07-28 Yuanhe Zhang , Fangzhou Xie , Zhenhong Zhou , Zherui Li , Hao Chen , Kun Wang , Yufei Guo

Large Vision-Language Models (LVLMs) have shown remarkable capabilities across a wide range of multimodal tasks. However, their integration of visual inputs introduces expanded attack surfaces, thereby exposing them to novel security…

计算与语言 · 计算机科学 2025-05-29 Juan Ren , Mark Dras , Usman Naseem

Large language models (LLMs) have demonstrated remarkable capabilities, but their power comes with significant security considerations. While extensive research has been conducted on the safety of LLMs in chat mode, the security…

密码学与安全 · 计算机科学 2024-12-25 Zihui Wu , Haichang Gao , Jianping He , Ping Wang

The rapid development of Large Language Models (LLMs) has brought impressive advancements across various tasks. However, despite these achievements, LLMs still pose inherent safety risks, especially in the context of jailbreak attacks. Most…

密码学与安全 · 计算机科学 2025-06-19 Shi Lin , Hongming Yang , Rongchang Li , Xun Wang , Changting Lin , Wenpeng Xing , Meng Han

Large Vision-Language Models (VLMs) have achieved remarkable success in understanding complex real-world scenarios and supporting data-driven decision-making processes. However, VLMs exhibit significant vulnerability against adversarial…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Xiaosen Wang , Shaokang Wang , Zhijin Ge , Yuyang Luo , Shudong Zhang

Extensive efforts have been made before the public release of Large language models (LLMs) to align their behaviors with human values. However, even meticulously aligned LLMs remain vulnerable to malicious manipulations such as…

密码学与安全 · 计算机科学 2024-10-01 Zeguan Xiao , Yan Yang , Guanhua Chen , Yun Chen

Despite inheriting security measures from underlying language models, Vision-Language Models (VLMs) may still be vulnerable to safety alignment issues. Through empirical analysis, we uncover two critical findings: scenario-matched images…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Shuyang Hao , Bryan Hooi , Jun Liu , Kai-Wei Chang , Zi Huang , Yujun Cai

Large Language Models (LLMs) face prominent security risks from jailbreaking, a practice that manipulates models to bypass built-in security constraints and generate unethical or unsafe content. Among various jailbreak techniques,…

密码学与安全 · 计算机科学 2026-04-14 Yihao Zhang , Kai Wang , Jiangrong Wu , Haolin Wu , Yuxuan Zhou , Zeming Wei , Dongxian Wu , Xun Chen , Jun Sun , Meng Sun

Recent explorations with commercial Large Language Models (LLMs) have shown that non-expert users can jailbreak LLMs by simply manipulating their prompts; resulting in degenerate output behavior, privacy and security breaches, offensive…

计算与语言 · 计算机科学 2024-03-28 Abhinav Rao , Sachin Vashistha , Atharva Naik , Somak Aditya , Monojit Choudhury

Large language models (LLMs) are increasingly deployed in a wide range of applications, yet remain vulnerable to adversarial jailbreak attacks that circumvent their safety guardrails. Existing evaluation frameworks typically report binary…

密码学与安全 · 计算机科学 2026-05-14 Zvi Topol

Large Language Models (LLMs) and Vision Language Models (VLMs) have demonstrated impressive capabilities but remain vulnerable to jailbreaking attacks, where adversaries exploit textual or visual triggers to bypass safety guardrails. Recent…

密码学与安全 · 计算机科学 2026-05-15 Yi Wang , Hongye Qiu , Yue Xu , Sibei Yang , Zhan Qin , Minlie Huang , Wenjie Wang

Although large language models (LLMs) demonstrate impressive proficiency in various tasks, they present potential safety risks, such as `jailbreaks', where malicious inputs can coerce LLMs into generating harmful content bypassing safety…

计算与语言 · 计算机科学 2025-11-26 Isack Lee , Haebin Seong

Large Language Models (LLMs) continue to exhibit vulnerabilities to jailbreaking attacks: carefully crafted malicious inputs intended to circumvent safety guardrails and elicit harmful responses. As such, we present AutoAdv, a novel…

密码学与安全 · 计算机科学 2025-12-25 Aashray Reddy , Andrew Zagula , Nicholas Saban

Vision-Large-Language-Models (Vision-LLMs) are increasingly being integrated into autonomous driving (AD) systems due to their advanced visual-language reasoning capabilities, targeting the perception, prediction, planning, and control…

计算机视觉与模式识别 · 计算机科学 2024-05-24 Nhat Chung , Sensen Gao , Tuan-Anh Vu , Jie Zhang , Aishan Liu , Yun Lin , Jin Song Dong , Qing Guo

By incorporating visual inputs, Multimodal Large Language Models (MLLMs) extend LLMs to support visual reasoning. However, this integration also introduces new vulnerabilities, making MLLMs susceptible to multimodal jailbreak attacks and…

密码学与安全 · 计算机科学 2025-12-04 Beitao Chen , Xinyu Lyu , Lianli Gao , Jingkuan Song , Heng Tao Shen

Jailbreaks on large language models (LLMs) have recently received increasing attention. For a comprehensive assessment of LLM safety, it is essential to consider jailbreaks with diverse attributes, such as contextual coherence and…

机器学习 · 计算机科学 2024-06-10 Xingang Guo , Fangxu Yu , Huan Zhang , Lianhui Qin , Bin Hu

Large language models (LLMs) are vulnerable to jailbreak attacks - resulting in harmful, unethical, or biased text generations. However, existing jailbreaking methods are computationally costly. In this paper, we propose the weak-to-strong…

计算与语言 · 计算机科学 2025-07-25 Xuandong Zhao , Xianjun Yang , Tianyu Pang , Chao Du , Lei Li , Yu-Xiang Wang , William Yang Wang

We have uncovered a powerful jailbreak technique that leverages large language models' ability to diverge from prior context, enabling them to bypass safety constraints and generate harmful outputs. By simply instructing the LLM to deviate…

计算与语言 · 计算机科学 2025-05-13 Weiliang Zhao , Daniel Ben-Levi , Wei Hao , Junfeng Yang , Chengzhi Mao