English
Related papers

Related papers: ForgeDAN: An Evolutionary Framework for Jailbreaki…

200 papers

Detecting jailbreak behaviour in large language models remains challenging, particularly when strongly aligned models produce harmful outputs only rarely. In this work, we present an empirical study of output based jailbreak detection under…

Computation and Language · Computer Science 2026-04-22 Hanrui Luo , Shreyank N Gowda

Extensive work has been devoted to improving the safety mechanism of Large Language Models (LLMs). However, LLMs still tend to generate harmful responses when faced with malicious instructions, a phenomenon referred to as "Jailbreak…

Computation and Language · Computer Science 2024-02-26 Yanrui Du , Sendong Zhao , Ming Ma , Yuhan Chen , Bing Qin

This paper proposes a jailbreaking prompt detection method for large language models (LLMs) to defend against jailbreak attacks. Although recent LLMs are equipped with built-in safeguards, it remains possible to craft jailbreaking prompts…

Cryptography and Security · Computer Science 2026-05-12 Zheng Lin , Zhenxing Niu , Haoxuan Ji , Yuzhe Huang , Haichang Gao

Large Language Models (LLMs) have become increasingly vulnerable to jailbreak attacks that circumvent their safety mechanisms. While existing defense methods either suffer from adaptive attacks or require computationally expensive auxiliary…

Computation and Language · Computer Science 2025-03-25 Xunguang Wang , Wenxuan Wang , Zhenlan Ji , Zongjie Li , Pingchuan Ma , Daoyuan Wu , Shuai Wang

Caution: This paper includes offensive words that could potentially cause unpleasantness. Language models (LMs) are vulnerable to exploitation for adversarial misuse. Training LMs for safety alignment is extensive and makes it hard to…

Machine Learning · Computer Science 2024-02-28 Heegyu Kim , Sehyun Yuk , Hyunsouk Cho

Large Language Models (LLMs) have revolutionized artificial intelligence, demonstrating remarkable computational power and linguistic capabilities. However, these models are inherently prone to various biases stemming from their training…

Computation and Language · Computer Science 2025-02-14 Riccardo Cantini , Giada Cosenza , Alessio Orsino , Domenico Talia

As the scale and complexity of jailbreaking attacks on large language models (LLMs) continue to escalate, their efficiency and practical applicability are constrained, posing a profound challenge to LLM security. Jailbreaking techniques…

Computation and Language · Computer Science 2025-12-23 Xiang Li , Chong Zhang , Jia Wang , Fangyu Wu , Yushi Li , Xiaobo Jin

Jailbreaking in Large Language Models (LLMs) threatens their safe use in sensitive domains like education by allowing users to bypass ethical safeguards. This study focuses on detecting jailbreaks in 2-Sigma, a clinical education platform…

While (multimodal) large language models (LLMs) have attracted widespread attention due to their exceptional capabilities, they remain vulnerable to jailbreak attacks. Various defense methods are proposed to defend against jailbreak…

Cryptography and Security · Computer Science 2025-05-29 Yongcan Yu , Yanbo Wang , Ran He , Jian Liang

The rapid evolution of artificial intelligence (AI) through developments in Large Language Models (LLMs) and Vision-Language Models (VLMs) has brought significant advancements across various technological domains. While these models enhance…

Computation and Language · Computer Science 2025-11-11 Haibo Jin , Leyang Hu , Xinnuo Li , Peiyan Zhang , Chonghan Chen , Jun Zhuang , Haohan Wang

Large Language Models (LLMs) are known to be susceptible to crafted adversarial attacks or jailbreaks that lead to the generation of objectionable content despite being aligned to human preferences using safety fine-tuning methods. While…

Computation and Language · Computer Science 2025-03-26 Sravanti Addepalli , Yerram Varun , Arun Suggala , Karthikeyan Shanmugam , Prateek Jain

Large language models (LLMs) undergo safety alignment after training and tuning, yet recent work shows that safety can be bypassed through jailbreak attacks. While many jailbreaks and defenses exist, their cross-lingual generalization…

Computation and Language · Computer Science 2025-11-05 Berk Atil , Rebecca J. Passonneau , Fred Morstatter

Jailbreak attacks to Large audio-language models (LALMs) are studied recently, but they exclusively focused on the attack scenario where the adversary can fully manipulate user prompts (named strong adversary) and limited in effectiveness,…

Cryptography and Security · Computer Science 2026-02-04 Guangke Chen , Fu Song , Zhe Zhao , Xiaojun Jia , Yang Liu , Yanchen Qiao , Weizhe Zhang , Weiping Tu , Yuhong Yang , Bo Du

Large language model (LLM) safety is a critical issue, with numerous studies employing red team testing to enhance model security. Among these, jailbreak methods explore potential vulnerabilities by crafting malicious prompts that induce…

Computation and Language · Computer Science 2025-03-07 Honglin Mu , Han He , Yuxin Zhou , Yunlong Feng , Yang Xu , Libo Qin , Xiaoming Shi , Zeming Liu , Xudong Han , Qi Shi , Qingfu Zhu , Wanxiang Che

Despite the implementation of safety alignment strategies, large language models (LLMs) remain vulnerable to jailbreak attacks, which undermine these safety guardrails and pose significant security threats. Some defenses have been proposed…

Cryptography and Security · Computer Science 2025-02-12 Shenyi Zhang , Yuchen Zhai , Keyan Guo , Hongxin Hu , Shengnan Guo , Zheng Fang , Lingchen Zhao , Chao Shen , Cong Wang , Qian Wang

Jailbreak attacks on large language models (LLMs) aim to induce LLMs to produce content that they are expected to refuse. Automated black-box jailbreak generation is especially important for safety evaluation, where the attacker observes…

Cryptography and Security · Computer Science 2026-05-29 Junke Zhang , Jianwei Wang , Sishuo Chen , Yizhang He , Qingshuai Feng , Zhengyi Yang

Jailbreaking in Large Language Models (LLMs) is a major security concern as it can deceive LLMs to generate harmful text. Yet, there is still insufficient understanding of how jailbreaking works, which makes it hard to develop effective…

Computation and Language · Computer Science 2025-05-22 Lang Gao , Jiahui Geng , Xiangliang Zhang , Preslav Nakov , Xiuying Chen

In the past few years, Language Models (LMs) have shown par-human capabilities in several domains. Despite their practical applications and exceeding user consumption, they are susceptible to jailbreaks when malicious input exploits the…

Computation and Language · Computer Science 2025-04-18 Charlotte Siska , Anush Sankaran

Despite extensive alignment efforts, Large Vision-Language Models (LVLMs) remain vulnerable to jailbreak attacks, posing serious safety risks. To address this, existing detection methods either learn attack-specific parameters, which…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Shuang Liang , Zhihao Xu , Jialing Tao , Hui Xue , Xiting Wang

Large Language Models (LLMs) have transformed task automation and content generation across various domains while incorporating safety filters to prevent misuse. We introduce a novel jailbreaking framework that employs distributed prompt…

Cryptography and Security · Computer Science 2025-04-01 Johan Wahréus , Ahmed Hussain , Panos Papadimitratos