English
Related papers

Related papers: Diversity Helps Jailbreak Large Language Models

200 papers

Large language models (LLMs), designed to provide helpful and safe responses, often rely on alignment techniques to align with user intent and social guidelines. Unfortunately, this alignment can be exploited by malicious actors seeking to…

Computation and Language · Computer Science 2024-08-06 Raz Lapid , Ron Langberg , Moshe Sipper

Large language models (LLMs) have exhibited outstanding performance in engaging with humans and addressing complex questions by leveraging their vast implicit knowledge and robust reasoning capabilities. However, such models are vulnerable…

Computation and Language · Computer Science 2024-10-16 Hao Yang , Lizhen Qu , Ehsan Shareghi , Gholamreza Haffari

The rapid proliferation of Large Language Models (LLMs) has raised significant concerns about their security against adversarial attacks. In this work, we propose a novel approach to crafting universal jailbreaks and data extraction attacks…

Cryptography and Security · Computer Science 2025-11-04 Kayua Oleques Paim , Rodrigo Brandao Mansilha , Diego Kreutz , Muriel Figueredo Franco , Weverton Cordeiro

Despite rigorous safety alignment, Large Language Models (LLMs) remain vulnerable to jailbreak attacks. Existing black-box methods often rely on heuristic templates or exhaustive trials, lacking mechanistic interpretability and query…

Cryptography and Security · Computer Science 2026-05-19 Ziwei Wang , Jing Chen , Ruichao Liang , Zhi Wang , Yebo Feng , Ju Jia , Ruiying Du , Cong Wu , Yang Liu

Despite extensive pre-training in moral alignment to prevent generating harmful information, large language models (LLMs) remain vulnerable to jailbreak attacks. In this paper, we propose AutoDefense, a multi-agent defense framework that…

Machine Learning · Computer Science 2024-11-15 Yifan Zeng , Yiran Wu , Xiao Zhang , Huazheng Wang , Qingyun Wu

With the rapid advancement of Large Language Models (LLMs), the safety of LLMs has been a critical concern requiring precise assessment. Current benchmarks primarily concentrate on single-turn dialogues or a single jailbreak attack method…

Large language models (LLMs) are vulnerable to jailbreak attacks - resulting in harmful, unethical, or biased text generations. However, existing jailbreaking methods are computationally costly. In this paper, we propose the weak-to-strong…

Computation and Language · Computer Science 2025-07-25 Xuandong Zhao , Xianjun Yang , Tianyu Pang , Chao Du , Lei Li , Yu-Xiang Wang , William Yang Wang

Large language models (LLMs) are increasingly being adopted in a wide range of real-world applications. Despite their impressive performance, recent studies have shown that LLMs are vulnerable to deliberately crafted adversarial prompts…

Artificial Intelligence · Computer Science 2024-06-17 Wei Zhao , Zhe Li , Yige Li , Ye Zhang , Jun Sun

Warning: This paper contains content that may involve potentially harmful behaviours, discussed strictly for research purposes. Jailbreak attacks can hinder the safety of Large Language Model (LLM) applications, especially chatbots.…

Cryptography and Security · Computer Science 2025-08-26 Junchen Ding , Jiahao Zhang , Yi Liu , Ziqi Ding , Gelei Deng , Yuekang Li

The widespread adoption of Large Language Models (LLMs) has heightened concerns about their security, particularly their vulnerability to jailbreak attacks that leverage crafted prompts to generate malicious outputs. While prior research…

Cryptography and Security · Computer Science 2025-06-13 Haoyang Li , Huan Gao , Zhiyuan Zhao , Zhiyu Lin , Junyu Gao , Xuelong Li

Jailbreaking techniques pose a significant threat to the safety of Large Language Models (LLMs). Existing defenses typically focus on single-turn attacks, lack coverage across languages, and rely on limited taxonomies that either fail to…

Computation and Language · Computer Science 2026-02-05 Francesco Giarrusso , Olga E. Sorokoletova , Vincenzo Suriani , Daniele Nardi

While significant attention has been dedicated to exploiting weaknesses in LLMs through jailbreaking attacks, there remains a paucity of effort in defending against these attacks. We point out a pivotal factor contributing to the success of…

Computation and Language · Computer Science 2024-06-13 Zhexin Zhang , Junxiao Yang , Pei Ke , Fei Mi , Hongning Wang , Minlie Huang

Large language models trained for safety and harmlessness remain susceptible to adversarial misuse, as evidenced by the prevalence of "jailbreak" attacks on early releases of ChatGPT that elicit undesired behavior. Going beyond recognition…

Machine Learning · Computer Science 2023-07-06 Alexander Wei , Nika Haghtalab , Jacob Steinhardt

Extensive work has been devoted to improving the safety mechanism of Large Language Models (LLMs). However, LLMs still tend to generate harmful responses when faced with malicious instructions, a phenomenon referred to as "Jailbreak…

Computation and Language · Computer Science 2024-02-26 Yanrui Du , Sendong Zhao , Ming Ma , Yuhan Chen , Bing Qin

Safety alignment mechanism are essential for preventing large language models (LLMs) from generating harmful information or unethical content. However, cleverly crafted prompts can bypass these safety measures without accessing the model's…

Computation and Language · Computer Science 2025-01-31 Sunbowen Lee , Shiwen Ni , Chi Wei , Shuaimin Li , Liyang Fan , Ahmadreza Argha , Hamid Alinejad-Rokny , Ruifeng Xu , Yicheng Gong , Min Yang

Jailbreak attacks aim to exploit large language models (LLMs) by inducing them to generate harmful content, thereby revealing their vulnerabilities. Understanding and addressing these attacks is crucial for advancing the field of LLM…

Cryptography and Security · Computer Science 2026-03-26 Zheng Zhang , Peilin Zhao , Deheng Ye , Hao Wang

Machine learning is advancing rapidly, with applications bringing notable benefits, such as improvements in translation and code generation. Models like ChatGPT, powered by Large Language Models (LLMs), are increasingly integrated into…

Machine Learning · Computer Science 2025-06-10 Torsten Krauß , Hamid Dashtbani , Alexandra Dmitrienko

The rapid progress in open-source large language models (LLMs) is significantly advancing AI development. Extensive efforts have been made before model release to align their behavior with human values, with the primary goal of ensuring…

Computation and Language · Computer Science 2023-10-12 Yangsibo Huang , Samyak Gupta , Mengzhou Xia , Kai Li , Danqi Chen

Large language models (LLMs), known for their capability in understanding and following instructions, are vulnerable to adversarial attacks. Researchers have found that current commercial LLMs either fail to be "harmless" by presenting…

Cryptography and Security · Computer Science 2023-10-05 Bocheng Chen , Advait Paliwal , Qiben Yan

Large language models (LLMs) are increasingly utilized in healthcare applications. However, their deployment in clinical practice raises significant safety concerns, including the potential spread of harmful information. This study…

Cryptography and Security · Computer Science 2025-03-05 Hang Zhang , Qian Lou , Yanshan Wang