English
Related papers

Related papers: Improved Large Language Model Jailbreak Detection …

200 papers

Large Language Models (LLMs) are vulnerable to adversarial attacks that bypass safety guidelines and generate harmful content. Mitigating these vulnerabilities requires defense mechanisms that are both robust and computationally efficient.…

Machine Learning · Computer Science 2025-11-18 Gil Goren , Shahar Katz , Lior Wolf

The increasing sophistication of large vision-language models (LVLMs) has been accompanied by advances in safety alignment mechanisms designed to prevent harmful content generation. However, these defenses remain vulnerable to sophisticated…

Cryptography and Security · Computer Science 2026-04-09 Quanchen Zou , Zonghao Ying , Moyang Chen , Wenzhuo Xu , Yisong Xiao , Yakai Li , Deyue Zhang , Dongdong Yang , Zhao Liu , Xiangzheng Zhang

Large Language Models (LLMs) have gained considerable popularity and protected by increasingly sophisticated safety mechanisms. However, jailbreak attacks continue to pose a critical security threat by inducing models to generate…

Cryptography and Security · Computer Science 2025-12-23 Zehao Liu , Xi Lin

Large Language Models (LLMs) are vulnerable to adversarial prompt based injects. These injects could jailbreak or exploit vulnerabilities within these models with explicit prompt requests leading to undesired responses. In the context of…

Cryptography and Security · Computer Science 2025-02-18 Jonathan Pan , Swee Liang Wong , Yidi Yuan , Xin Wei Chia

Text-to-Image models may generate harmful content, such as pornographic images, particularly when unsafe prompts are submitted. To address this issue, safety filters are often added on top of text-to-image models, or the models themselves…

Cryptography and Security · Computer Science 2026-01-09 Zhengyuan Jiang , Yuepeng Hu , Yuchen Yang , Yinzhi Cao , Neil Zhenqiang Gong

As large language models (LLMs) are becoming more capable and widespread, the study of their failure cases is becoming increasingly important. Recent advances in standardizing, measuring, and scaling test-time compute suggest new…

Machine Learning · Computer Science 2025-06-26 Mahdi Sabbaghi , Paul Kassianik , George Pappas , Yaron Singer , Amin Karbasi , Hamed Hassani

It has recently been shown that adversarial attacks on large language models (LLMs) can "jailbreak" the model into making harmful statements. In this work, we argue that the spectrum of adversarial attacks on LLMs is much larger than merely…

Machine Learning · Computer Science 2024-02-22 Jonas Geiping , Alex Stein , Manli Shu , Khalid Saifullah , Yuxin Wen , Tom Goldstein

As diverse linguistic communities and users adopt large language models (LLMs), assessing their safety across languages becomes critical. Despite ongoing efforts to make LLMs safe, they can still be made to behave unsafely with…

Computation and Language · Computer Science 2024-08-09 Fabio Pernisi , Dirk Hovy , Paul Röttger

While large language models (LLMs) have demonstrated increasing power, they have also given rise to a wide range of harmful behaviors. As representatives, jailbreak attacks can provoke harmful or unethical responses from LLMs, even after…

Computation and Language · Computer Science 2024-03-01 Nan Xu , Fei Wang , Ben Zhou , Bang Zheng Li , Chaowei Xiao , Muhao Chen

The growing integration of Large Language Models (LLMs) into critical societal domains has raised concerns about embedded biases that can perpetuate stereotypes and undermine fairness. Such biases may stem from historical inequalities in…

Computation and Language · Computer Science 2025-10-17 Riccardo Cantini , Alessio Orsino , Massimo Ruggiero , Domenico Talia

Large Language Models (LLMs), such as ChatGPT, encounter `jailbreak' challenges, wherein safeguards are circumvented to generate ethically harmful prompts. This study introduces a straightforward black-box method for efficiently crafting…

Computation and Language · Computer Science 2024-04-25 Kazuhiro Takemoto

Large Language Models (LLMs) have seen rapid adoption in recent years, with industries increasingly relying on them to maintain a competitive advantage. These models excel at interpreting user instructions and generating human-like…

Cryptography and Security · Computer Science 2025-09-09 Andrew Yeo , Daeseon Choi

Large Language Models (LLMs) face threats from jailbreak prompts. Existing methods for detecting jailbreak prompts are primarily online moderation APIs or finetuned LLMs. These strategies, however, often require extensive and…

Computation and Language · Computer Science 2024-05-31 Yueqi Xie , Minghong Fang , Renjie Pi , Neil Gong

Jailbreak attacks on Language Model Models (LLMs) entail crafting prompts aimed at exploiting the models to generate malicious content. Existing jailbreak attacks can successfully deceive the LLMs, however they cannot deceive the human.…

Cryptography and Security · Computer Science 2024-04-18 Zhilong Wang , Yebo Cao , Peng Liu

As large language models (LLMs) advance, ensuring AI safety and alignment is paramount. One popular approach is prompt guards, lightweight mechanisms designed to filter malicious queries while being easy to implement and update. In this…

Machine Learning · Computer Science 2025-10-08 Jaiden Fairoze , Sanjam Garg , Keewoo Lee , Mingyuan Wang

Large language models (LLMs) have demonstrated remarkable capabilities, but their power comes with significant security considerations. While extensive research has been conducted on the safety of LLMs in chat mode, the security…

Cryptography and Security · Computer Science 2024-12-25 Zihui Wu , Haichang Gao , Jianping He , Ping Wang

Large Language Models (LLMs) have been shown to be susceptible to jailbreak attacks, or adversarial attacks used to illicit high risk behavior from a model. Jailbreaks have been exploited by cybercriminals and blackhat actors to cause…

Computation and Language · Computer Science 2025-01-07 Joao Fonseca , Andrew Bell , Julia Stoyanovich

Large language models (LLMs) are widely applied in various fields of society due to their powerful reasoning, understanding, and generation capabilities. However, the security issues associated with these models are becoming increasingly…

Computation and Language · Computer Science 2025-05-30 Yanxu Mao , Peipei Liu , Tiehan Cui , Zhaoteng Yan , Congying Liu , Datao You

Speech Language Models (SLMs) enable natural interactions via spoken instructions, which more effectively capture user intent by detecting nuances in speech. The richer speech signal introduces new security risks compared to text-based…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-17 Amirbek Djanibekov , Nurdaulet Mukhituly , Kentaro Inui , Hanan Aldarmaki , Nils Lukas

Large Language Models (LLMs) demonstrate impressive zero-shot performance across a wide range of natural language processing tasks. Integrating various modality encoders further expands their capabilities, giving rise to Multimodal Large…

Sound · Computer Science 2026-01-13 Hao Cheng , Erjia Xiao , Jing Shao , Yichi Wang , Le Yang , Chao Shen , Philip Torr , Jindong Gu , Renjing Xu