English
Related papers

Related papers: Diversity Helps Jailbreak Large Language Models

200 papers

This paper introduces Jailbreak-Zero, a novel red teaming methodology that shifts the paradigm of Large Language Model (LLM) safety evaluation from a constrained example-based approach to a more expansive and effective policy-based…

Computation and Language · Computer Science 2026-01-08 Kai Hu , Abhinav Aggarwal , Mehran Khodabandeh , David Zhang , Eric Hsin , Li Chen , Ankit Jain , Matt Fredrikson , Akash Bharadwaj

Integrated Speech and Large Language Models (SLMs) that can follow speech instructions and generate relevant text responses have gained popularity lately. However, the safety and robustness of these models remains largely unclear. In this…

Multimodal large language models (MLLMs) exhibit remarkable capabilities but remain susceptible to jailbreak attacks exploiting cross-modal vulnerabilities. In this work, we introduce a novel method that leverages sequential comic-style…

Cryptography and Security · Computer Science 2025-10-20 Deyue Zhang , Dongdong Yang , Junjie Mu , Quancheng Zou , Zonghao Ying , Wenzhuo Xu , Zhao Liu , Xuan Wang , Xiangzheng Zhang

Deep learning-based approaches, particularly those leveraging pre-trained language models (PLMs), have shown promise in automated software vulnerability detection. However, existing methods are predominantly limited to specific programming…

Software Engineering · Computer Science 2025-05-13 Junji Yu , Honglin Shu , Michael Fu , Dong Wang , Chakkrit Tantithamthavorn , Yasutaka Kamei , Junjie Chen

Ensuring the security of large language models (LLMs) is an ongoing challenge despite their widespread popularity. Developers work to enhance LLMs security, but vulnerabilities persist, even in advanced versions like GPT-4. Attackers…

Cryptography and Security · Computer Science 2023-12-19 Aysan Esmradi , Daniel Wankit Yip , Chun Fai Chan

With the rapid advancements in Multimodal Large Language Models (MLLMs), securing these models against malicious inputs while aligning them with human values has emerged as a critical challenge. In this paper, we investigate an important…

Cryptography and Security · Computer Science 2024-11-26 Weidi Luo , Siyuan Ma , Xiaogeng Liu , Xiaoyu Guo , Chaowei Xiao

The misuse of large language models (LLMs) has drawn significant attention from the general public and LLM vendors. One particular type of adversarial prompt, known as jailbreak prompt, has emerged as the main attack vector to bypass the…

Cryptography and Security · Computer Science 2024-05-16 Xinyue Shen , Zeyuan Chen , Michael Backes , Yun Shen , Yang Zhang

While multimodal large language models (MLLMs) have achieved remarkable success in recent advancements, their susceptibility to jailbreak attacks has come to light. In such attacks, adversaries exploit carefully crafted prompts to coerce…

Cryptography and Security · Computer Science 2025-02-04 Ziyi Yin , Yuanpu Cao , Han Liu , Ting Wang , Jinghui Chen , Fenhlong Ma

Large language models (LLMs) are designed to align with human values in their responses. This study exploits LLMs with an iterative prompting technique where each prompt is systematically modified and refined across multiple iterations to…

Computation and Language · Computer Science 2025-03-27 Shih-Wen Ke , Guan-Yu Lai , Guo-Lin Fang , Hsi-Yuan Kao

As the integration of the Large Language Models (LLMs) into various applications increases, so does their susceptibility to misuse, raising significant security concerns. Numerous jailbreak attacks have been proposed to assess the security…

Cryptography and Security · Computer Science 2025-05-30 Bijoy Ahmed Saiem , MD Sadik Hossain Shanto , Rakib Ahsan , Md Rafi ur Rashid

Despite efforts to align large language models (LLMs) with human intentions, widely-used LLMs such as GPT, Llama, and Claude are susceptible to jailbreaking attacks, wherein an adversary fools a targeted LLM into generating objectionable…

Machine Learning · Computer Science 2024-06-17 Alexander Robey , Eric Wong , Hamed Hassani , George J. Pappas

Large language models (LLMs) are rapidly evolving from single-modal systems to multimodal LLMs and intelligent agents, significantly expanding their capabilities while introducing increasingly severe security risks. This paper presents a…

Cryptography and Security · Computer Science 2025-08-04 Yanxu Mao , Tiehan Cui , Peipei Liu , Datao You , Hongsong Zhu

Large Language Models (LLMs) are transforming cybersecurity by enabling intelligent, adaptive, and automated approaches to threat detection, vulnerability assessment, and incident response. With their advanced language understanding and…

Cryptography and Security · Computer Science 2025-07-21 Niveen O. Jaffal , Mohammed Alkhanafseh , David Mohaisen

Despite extensive safety measures, LLMs are vulnerable to adversarial inputs, or jailbreaks, which can elicit unsafe behaviors. In this work, we introduce bijection learning, a powerful attack algorithm which automatically fuzzes LLMs for…

Computation and Language · Computer Science 2025-05-13 Brian R. Y. Huang , Maximilian Li , Leonard Tang

In recent years, the rapid development of large language models (LLMs) has achieved remarkable performance across various tasks. However, research indicates that LLMs are vulnerable to jailbreak attacks, where adversaries can induce the…

Cryptography and Security · Computer Science 2024-08-23 Jiawei Zhao , Kejiang Chen , Xiaojian Yuan , Weiming Zhang

Large Language Models (LLMs) are typically harmless but remain vulnerable to carefully crafted prompts known as ``jailbreaks'', which can bypass protective measures and induce harmful behavior. Recent advancements in LLMs have incorporated…

Cryptography and Security · Computer Science 2024-06-03 Haibo Jin , Andy Zhou , Joe D. Menke , Haohan Wang

Despite various approaches being employed to detect vulnerabilities, the number of reported vulnerabilities shows an upward trend over the years. This suggests the problems are not caught before the code is released, which could be caused…

Cryptography and Security · Computer Science 2025-02-14 Karl Tamberg , Hayretdin Bahsi

Large language models (LLMs), such as ChatGPT, have achieved remarkable success across a wide range of fields. However, their trustworthiness remains a significant concern, as they are still susceptible to jailbreak attacks aimed at…

Cryptography and Security · Computer Science 2025-12-30 Zhen Liang , Hai Huang , Zhengkui Chen

Jailbreak attacks pose persistent threats to large language models (LLMs). Current safety alignment methods have attempted to address these issues, but they experience two significant limitations: insufficient safety alignment depth and…

Cryptography and Security · Computer Science 2025-09-19 Yuanbo Xie , Yingjie Zhang , Tianyun Liu , Duohe Ma , Tingwen Liu

Jailbreak attacks pose a serious threat to the safety of Large Language Models (LLMs) by crafting adversarial prompts that bypass alignment mechanisms, causing the models to produce harmful, restricted, or biased content. In this paper, we…

Machine Learning · Computer Science 2025-08-22 Xiangman Li , Xiaodong Wu , Qi Li , Jianbing Ni , Rongxing Lu