English
Related papers

Related papers: JPU: Bridging Jailbreak Defense and Unlearning via…

200 papers

Multimodal large language models (MLLMs) excel in vision-language tasks but also pose significant risks of generating harmful content, particularly through jailbreak attacks. Jailbreak attacks refer to intentional manipulations that bypass…

Cryptography and Security · Computer Science 2025-07-18 Yi Nian , Shenzhe Zhu , Yuehan Qin , Li Li , Ziyi Wang , Chaowei Xiao , Yue Zhao

Recently, Multimodal Large Language Models (MLLMs) have demonstrated their superior ability in understanding multimodal content. However, they remain vulnerable to jailbreak attacks, which exploit weaknesses in their safety alignment to…

Cryptography and Security · Computer Science 2025-08-29 Wenzhuo Xu , Zhipeng Wei , Xiongtao Sun , Zonghao Ying , Deyue Zhang , Dongdong Yang , Xiangzheng Zhang , Quanchen Zou

Large Language Models (LLMs) are widely applied in decision making, but their deployment is threatened by jailbreak attacks, where adversarial users manipulate model behavior to bypass safety measures. Existing defense mechanisms, such as…

Cryptography and Security · Computer Science 2025-05-30 Yi Wang , Fenghua Weng , Sibei Yang , Zhan Qin , Minlie Huang , Wenjie Wang

Defense in large language models (LLMs) is crucial to counter the numerous attackers exploiting these systems to generate harmful content through manipulated prompts, known as jailbreak attacks. Although many defense strategies have been…

Cryptography and Security · Computer Science 2024-12-11 Bocheng Chen , Hanqing Guo , Qiben Yan

Despite the implementation of safety alignment strategies, large language models (LLMs) remain vulnerable to jailbreak attacks, which undermine these safety guardrails and pose significant security threats. Some defenses have been proposed…

Cryptography and Security · Computer Science 2025-02-12 Shenyi Zhang , Yuchen Zhai , Keyan Guo , Hongxin Hu , Shengnan Guo , Zheng Fang , Lingchen Zhao , Chao Shen , Cong Wang , Qian Wang

Large Language Models (LLMs) are trained with safety alignment to prevent generating malicious content. Although some attacks have highlighted vulnerabilities in these safety-aligned LLMs, they typically have limitations, such as…

Machine Learning · Computer Science 2026-03-11 Jesson Wang , Zhanhao Hu , David Wagner

Large Language Models (LLMs) suffer from a range of vulnerabilities that allow malicious users to solicit undesirable responses through manipulation of the input text. These so-called jailbreak prompts are designed to trick the LLM into…

Computation and Language · Computer Science 2025-10-13 John Hawkins , Aditya Pramar , Rodney Beard , Rohitash Chandra

Large Language Models (LLMs) remain vulnerable to jailbreak attacks that bypass their safety mechanisms. Existing attack methods are fixed or specifically tailored for certain models and cannot flexibly adjust attack strength, which is…

Cryptography and Security · Computer Science 2024-10-08 Yiting Dong , Guobin Shen , Dongcheng Zhao , Xiang He , Yi Zeng

This paper provides a systematic survey of jailbreak attacks and defenses on Large Language Models (LLMs) and Vision-Language Models (VLMs), emphasizing that jailbreak vulnerabilities stem from structural factors such as incomplete training…

Cryptography and Security · Computer Science 2026-01-08 Zejian Chen , Chaozhuo Li , Chao Li , Xi Zhang , Litian Zhang , Yiming He

In recent years, the rapid development of large language models (LLMs) has achieved remarkable performance across various tasks. However, research indicates that LLMs are vulnerable to jailbreak attacks, where adversaries can induce the…

Cryptography and Security · Computer Science 2024-08-23 Jiawei Zhao , Kejiang Chen , Xiaojian Yuan , Weiming Zhang

Large language models (LLMs) possess strong semantic understanding, driving significant progress in data mining applications. This is further enhanced by large reasoning models (LRMs), which provide explicit multi-step reasoning traces. On…

Machine Learning · Computer Science 2026-04-07 Aobo Chen , Chenxu Zhao , Chenglin Miao , Mengdi Huai

Jailbreak attacks pose persistent threats to large language models (LLMs). Current safety alignment methods have attempted to address these issues, but they experience two significant limitations: insufficient safety alignment depth and…

Cryptography and Security · Computer Science 2025-09-19 Yuanbo Xie , Yingjie Zhang , Tianyun Liu , Duohe Ma , Tingwen Liu

Jailbreaking large language models (LLMs) has emerged as a critical security challenge with the widespread deployment of conversational AI systems. Adversarial users exploit these models through carefully crafted prompts to elicit…

Cryptography and Security · Computer Science 2026-02-23 Sri Durga Sai Sowmya Kadali , Evangelos E. Papalexakis

The study of large language models (LLMs) is a key area in open-world machine learning. Although LLMs demonstrate remarkable natural language processing capabilities, they also face several challenges, including consistency issues,…

Jailbreaking is an emerging adversarial attack that bypasses the safety alignment deployed in off-the-shelf large language models (LLMs) and has evolved into multiple categories: human-based, optimization-based, generation-based, and the…

Cryptography and Security · Computer Science 2025-02-06 Xunguang Wang , Daoyuan Wu , Zhenlan Ji , Zongjie Li , Pingchuan Ma , Shuai Wang , Yingjiu Li , Yang Liu , Ning Liu , Juergen Rahmel

We address jailbreaks, backdoors, and unlearning for large language models (LLMs). Unlike prior work, which trains LLMs based on their actions when given malign instructions, our method specifically trains the model to change how it…

Machine Learning · Computer Science 2026-04-14 Eric Easley , Sebastian Farquhar

Large Language Models (LLMs) are increasingly popular, powering a wide range of applications. Their widespread use has sparked concerns, especially through jailbreak attacks that bypass safety measures to produce harmful content. In this…

Cryptography and Security · Computer Science 2025-12-25 Zhengchun Shang , Wenlan Wei , Weiheng Bai

Jailbreaking large language models (LLMs) has emerged as a pressing concern with the increasing prevalence and accessibility of conversational LLMs. Adversarial users often exploit these models through carefully engineered prompts to elicit…

Computation and Language · Computer Science 2025-10-13 Sri Durga Sai Sowmya Kadali , Evangelos E. Papalexakis

Large language models (LLMs) are susceptible to a type of attack known as jailbreaking, which misleads LLMs to output harmful contents. Although there are diverse jailbreak attack strategies, there is no unified understanding on why some…

Computation and Language · Computer Science 2024-12-04 Yuping Lin , Pengfei He , Han Xu , Yue Xing , Makoto Yamada , Hui Liu , Jiliang Tang

Large language models (LLMs) have demonstrated remarkable capabilities across diverse applications, however, they remain critically vulnerable to jailbreak attacks that elicit harmful responses violating human values and safety guidelines.…

Cryptography and Security · Computer Science 2026-01-12 Zhaoqi Wang , Zijian Zhang , Daqing He , Pengtao Kou , Xin Li , Jiamou Liu , Jincheng An , Yong Liu