English
Related papers

Related papers: Jailbreak Large Vision-Language Models Through Mul…

200 papers

Jailbreak attacks on large language models (LLMs) involve inducing these models to generate harmful content that violates ethics or laws, posing a significant threat to LLM security. Current jailbreak attacks face two main challenges: low…

Cryptography and Security · Computer Science 2024-07-12 Yuqi Zhou , Lin Lu , Hanchi Sun , Pan Zhou , Lichao Sun

Large language models (LLMs) are susceptible to a type of attack known as jailbreaking, which misleads LLMs to output harmful contents. Although there are diverse jailbreak attack strategies, there is no unified understanding on why some…

Computation and Language · Computer Science 2024-12-04 Yuping Lin , Pengfei He , Han Xu , Yue Xing , Makoto Yamada , Hui Liu , Jiliang Tang

Large language models (LLMs) have been increasingly applied to various domains, which triggers increasing concerns about LLMs' safety on specialized domains, e.g. medicine. Despite prior explorations on general jailbreaking attacks, there…

Computation and Language · Computer Science 2025-06-10 Shangqing Tu , Zhuoran Pan , Wenxuan Wang , Zhexin Zhang , Yuliang Sun , Jifan Yu , Hongning Wang , Lei Hou , Juanzi Li

The rapid evolution of artificial intelligence (AI) through developments in Large Language Models (LLMs) and Vision-Language Models (VLMs) has brought significant advancements across various technological domains. While these models enhance…

Computation and Language · Computer Science 2025-11-11 Haibo Jin , Leyang Hu , Xinnuo Li , Peiyan Zhang , Chonghan Chen , Jun Zhuang , Haohan Wang

Large Language Models (LLMs) and Vision Language Models (VLMs) have demonstrated impressive capabilities but remain vulnerable to jailbreaking attacks, where adversaries exploit textual or visual triggers to bypass safety guardrails. Recent…

Cryptography and Security · Computer Science 2026-05-15 Yi Wang , Hongye Qiu , Yue Xu , Sibei Yang , Zhan Qin , Minlie Huang , Wenjie Wang

Large Language Models (LLMs) have transformed numerous fields by enabling advanced natural language interactions but remain susceptible to critical vulnerabilities, particularly jailbreak attacks. Current jailbreak techniques, while…

Cryptography and Security · Computer Science 2024-12-12 Yuxi Li , Zhibo Zhang , Kailong Wang , Ling Shi , Haoyu Wang

Despite the implementation of safety alignment strategies, large language models (LLMs) remain vulnerable to jailbreak attacks, which undermine these safety guardrails and pose significant security threats. Some defenses have been proposed…

Cryptography and Security · Computer Science 2025-02-12 Shenyi Zhang , Yuchen Zhai , Keyan Guo , Hongxin Hu , Shengnan Guo , Zheng Fang , Lingchen Zhao , Chao Shen , Cong Wang , Qian Wang

Jailbreaking is an emerging adversarial attack that bypasses the safety alignment deployed in off-the-shelf large language models (LLMs). A considerable amount of research exists proposing more effective jailbreak attacks, including the…

Cryptography and Security · Computer Science 2024-03-05 Daoyuan Wu , Shuai Wang , Yang Liu , Ning Liu

We identify a structural weakness in current large language model (LLM) alignment: modern refusal mechanisms are fail-open. While existing approaches encode refusal behaviors across multiple latent features, suppressing a single dominant…

Machine Learning · Computer Science 2026-02-20 Zachary Coalson , Beth Sohler , Aiden Gabriel , Sanghyun Hong

Despite extensive pre-training in moral alignment to prevent generating harmful information, large language models (LLMs) remain vulnerable to jailbreak attacks. In this paper, we propose AutoDefense, a multi-agent defense framework that…

Machine Learning · Computer Science 2024-11-15 Yifan Zeng , Yiran Wu , Xiao Zhang , Huazheng Wang , Qingyun Wu

Benefiting from the powerful capabilities of Large Language Models (LLMs), pre-trained visual encoder models connected to an LLMs can realize Vision Language Models (VLMs). However, existing research shows that the visual modality of VLMs…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Zhendong Liu , Yuanbi Nie , Yingshui Tan , Xiangyu Yue , Qiushi Cui , Chongjun Wang , Xiaoyong Zhu , Bo Zheng

The emergence of Vision-Language Models (VLMs) is a significant advancement in integrating computer vision with Large Language Models (LLMs) to enhance multi-modal machine learning capabilities. However, this progress has also made VLMs…

Artificial Intelligence · Computer Science 2024-12-24 Zaitang Li , Pin-Yu Chen , Tsung-Yi Ho

Large Vision-Language Models (VLMs) are susceptible to jailbreak attacks: researchers have developed a variety of attack strategies that can successfully bypass the safety mechanisms of VLMs. Among these approaches, jailbreak methods based…

Cryptography and Security · Computer Science 2025-11-12 Yuxuan Zhou , Yuzhao Peng , Yang Bai , Kuofeng Gao , Yihao Zhang , Yechao Zhang , Xun Chen , Tao Yu , Tao Dai , Shu-Tao Xia

In recent years, the rapid development of large language models (LLMs) has achieved remarkable performance across various tasks. However, research indicates that LLMs are vulnerable to jailbreak attacks, where adversaries can induce the…

Cryptography and Security · Computer Science 2024-08-23 Jiawei Zhao , Kejiang Chen , Xiaojian Yuan , Weiming Zhang

Multi-Agent Debate (MAD), leveraging collaborative interactions among Large Language Models (LLMs), aim to enhance reasoning capabilities in complex tasks. However, the security implications of their iterative dialogues and role-playing…

Cryptography and Security · Computer Science 2025-04-24 Senmao Qi , Yifei Zou , Peng Li , Ziyi Lin , Xiuzhen Cheng , Dongxiao Yu

Large Language Models (LLMs), such as ChatGPT and GPT-4, are designed to provide useful and safe responses. However, adversarial prompts known as 'jailbreaks' can circumvent safeguards, leading LLMs to generate potentially harmful content.…

Computation and Language · Computer Science 2024-04-09 Peng Ding , Jun Kuang , Dan Ma , Xuezhi Cao , Yunsen Xian , Jiajun Chen , Shujian Huang

Recently, Large Language Models (LLMs) have made significant advancements and are now widely used across various domains. Unfortunately, there has been a rising concern that LLMs can be misused to generate harmful or malicious content.…

Computation and Language · Computer Science 2024-06-13 Bochuan Cao , Yuanpu Cao , Lu Lin , Jinghui Chen

Large language models (LLMs) are increasingly deployed in real-world applications, raising concerns about their security. While jailbreak attacks highlight failures under overtly harmful queries, they overlook a critical risk: incorrectly…

Cryptography and Security · Computer Science 2025-06-10 Yukai Zhou , Sibei Yang , Wenjie Wang

Large Language Models have shown impressive generative capabilities across diverse tasks, but their safety remains a critical concern. Existing post-training alignment methods, such as SFT and RLHF, reduce harmful outputs yet leave LLMs…

Cryptography and Security · Computer Science 2025-10-21 Zhengyue Zhao , Yingzi Ma , Somesh Jha , Marco Pavone , Patrick McDaniel , Chaowei Xiao

Vision-Language Models (VLMs) have garnered significant attention for their remarkable ability to interpret and generate multimodal content. However, securing these models against jailbreak attacks continues to be a substantial challenge.…

Cryptography and Security · Computer Science 2025-10-14 Aofan Liu , Lulu Tang