English
Related papers

Related papers: Jailbreak Distillation: Renewable Safety Benchmark…

200 papers

As Large Language Models (LLMs) are widely applied in various domains, the safety of LLMs is increasingly attracting attention to avoid their powerful capabilities being misused. Existing jailbreak methods create a forced…

Computation and Language · Computer Science 2025-06-02 Yuting Huang , Chengyuan Liu , Yifeng Feng , Yiquan Wu , Chao Wu , Fei Wu , Kun Kuang

As the development of large language models (LLMs) rapidly advances, securing these models effectively without compromising their utility has become a pivotal area of research. However, current defense strategies against jailbreak attacks…

Cryptography and Security · Computer Science 2024-12-25 Caishuang Huang , Wanxu Zhao , Rui Zheng , Huijie Lv , Wenyu Zhan , Shihan Dou , Sixian Li , Xiao Wang , Enyu Zhou , Junjie Ye , Yuming Yang , Tao Gui , Qi Zhang , Xuanjing Huang

The emergence of Vision-Language Models (VLMs) is a significant advancement in integrating computer vision with Large Language Models (LLMs) to enhance multi-modal machine learning capabilities. However, this progress has also made VLMs…

Artificial Intelligence · Computer Science 2024-12-24 Zaitang Li , Pin-Yu Chen , Tsung-Yi Ho

Large language models are becoming pervasive core components in many real-world applications. As a consequence, security alignment represents a critical requirement for their safe deployment. Although previous related works focused…

Cryptography and Security · Computer Science 2026-03-24 Marco Arazzi , Vignesh Kumar Kembu , Antonino Nocera

Despite significant advancements in alignment and content moderation, large language models (LLMs) and text-to-image (T2I) systems remain vulnerable to prompt-based attacks known as jailbreaks. Unlike traditional adversarial examples…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Ahmed B Mustafa , Zihan Ye , Yang Lu , Michael P Pound , Shreyank N Gowda

Jailbreaking large language models (LLMs) has emerged as a pressing concern with the increasing prevalence and accessibility of conversational LLMs. Adversarial users often exploit these models through carefully engineered prompts to elicit…

Computation and Language · Computer Science 2025-10-13 Sri Durga Sai Sowmya Kadali , Evangelos E. Papalexakis

Large Language Models (LLMs) often exhibit misalignment between the quality of their generated responses and the confidence estimates they assign to them. Bayesian treatments, such as marginalizing over a reliable weight posterior or over…

Despite the widespread application of large language models (LLMs) across various tasks, recent studies indicate that they are susceptible to jailbreak attacks, which can render their defense mechanisms ineffective. However, previous…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Jiawei Chen , Xiao Yang , Zhengwei Fang , Yu Tian , Yinpeng Dong , Zhaoxia Yin , Hang Su

This paper provides a systematic survey of jailbreak attacks and defenses on Large Language Models (LLMs) and Vision-Language Models (VLMs), emphasizing that jailbreak vulnerabilities stem from structural factors such as incomplete training…

Cryptography and Security · Computer Science 2026-01-08 Zejian Chen , Chaozhuo Li , Chao Li , Xi Zhang , Litian Zhang , Yiming He

Uncovering the mechanisms behind "jailbreaks" in large language models (LLMs) is crucial for enhancing their safety and reliability, yet these mechanisms remain poorly understood. Existing studies predominantly analyze jailbreak prompts by…

Machine Learning · Computer Science 2026-02-06 Licheng Pan , Yunsheng Lu , Jiexi Liu , Jialing Tao , Haozhe Feng , Hui Xue , Zhixuan Chu , Kui Ren

Application designers have moved to integrate large language models (LLMs) into their products. However, many LLM-integrated applications are vulnerable to prompt injections. While attempts have been made to address this problem by building…

Cryptography and Security · Computer Science 2025-04-15 Dennis Jacob , Hend Alzahrani , Zhanhao Hu , Basel Alomair , David Wagner

Large Language Models (LLMs) face threats from jailbreak prompts. Existing methods for detecting jailbreak prompts are primarily online moderation APIs or finetuned LLMs. These strategies, however, often require extensive and…

Computation and Language · Computer Science 2024-05-31 Yueqi Xie , Minghong Fang , Renjie Pi , Neil Gong

Jailbreak attacks designed to bypass safety mechanisms pose a serious threat by prompting LLMs to generate harmful or inappropriate content, despite alignment with ethical guidelines. Crafting universal filtering rules remains difficult due…

Cryptography and Security · Computer Science 2025-12-01 Lama Sleem , Jerome Francois , Lujun Li , Nathan Foucher , Niccolo Gentile , Radu State

Large Language Models (LLMs) are widely deployed in diverse real-world settings, yet remain vulnerable to jailbreaking, where prompt-based attacks bypass safety filters. We present THREAT (Targeted Harmful generation via Reframing and…

Cryptography and Security · Computer Science 2026-05-22 Shahnewaz Karim Sakib , Swati Kar , Anindya Bijoy Das

In the past few years, Language Models (LMs) have shown par-human capabilities in several domains. Despite their practical applications and exceeding user consumption, they are susceptible to jailbreaks when malicious input exploits the…

Computation and Language · Computer Science 2025-04-18 Charlotte Siska , Anush Sankaran

The rapid expansion of research on Large Language Model (LLM) safety and robustness has produced a fragmented and oftentimes buggy ecosystem of implementations, datasets, and evaluation methods. This fragmentation makes reproducibility and…

Artificial Intelligence · Computer Science 2025-11-07 Tim Beyer , Jonas Dornbusch , Jakob Steimle , Moritz Ladenburger , Leo Schwinn , Stephan Günnemann

Large language models (LLMs) have gained widespread recognition for their superior comprehension and have been deployed across numerous domains. Building on Chain-of-Thought (CoT) ideology, Large Reasoning models (LRMs) further exhibit…

Computers and Society · Computer Science 2025-09-03 Shiji Zhao , Ranjie Duan , Jiexi Liu , Xiaojun Jia , Fengxiang Wang , Cheng Wei , Ruoxi Cheng , Yong Xie , Chang Liu , Qing Guo , Jialing Tao , Hui Xue , Xingxing Wei

Despite extensive safety alignment, Large Language Models (LLMs) often fail against jailbreak attacks. While machine unlearning has emerged as a promising defense by erasing specific harmful parameters, current methods remain vulnerable to…

Cryptography and Security · Computer Science 2026-01-07 Xi Wang , Songlei Jian , Shasha Li , Xiaopeng Li , Zhaoye Li , Bin Ji , Baosheng Wang , Jie Yu

Large Language Models (LLMs) are increasingly deployed for task automation and content generation, yet their safety mechanisms remain vulnerable to circumvention through different jailbreaking techniques. In this paper, we introduce…

Cryptography and Security · Computer Science 2025-09-17 Johan Wahréus , Ahmed Hussain , Panos Papadimitratos

Jailbreaks have been a central focus of research regarding the safety and reliability of large language models (LLMs), yet the mechanisms underlying these attacks remain poorly understood. While previous studies have predominantly relied on…

Cryptography and Security · Computer Science 2025-11-04 Nathalie Kirch , Constantin Weisser , Severin Field , Helen Yannakoudakis , Stephen Casper