English
Related papers

Related papers: Many-Turn Jailbreaking

200 papers

While defenses against single-turn jailbreak attacks on Large Language Models (LLMs) have improved significantly, multi-turn jailbreaks remain a persistent vulnerability, often achieving success rates exceeding 70% against models optimized…

Machine Learning · Computer Science 2025-08-12 Xiaoxue Yang , Jaeha Lee , Anna-Katharina Dick , Jasper Timm , Fei Xie , Diogo Cruz

Large Language Models (LLMs) are susceptible to Jailbreaking attacks, which aim to extract harmful information by subtly modifying the attack query. As defense mechanisms evolve, directly obtaining harmful information becomes increasingly…

Machine Learning · Computer Science 2024-10-03 Yixin Cheng , Markos Georgopoulos , Volkan Cevher , Grigorios G. Chrysos

Large language models (LLMs) have become increasingly integrated with various applications. To ensure that LLMs do not generate unsafe responses, they are aligned with safeguards that specify what content is restricted. However, such…

Computation and Language · Computer Science 2024-05-08 Hongyu Cai , Arjun Arunasalam , Leo Y. Lin , Antonio Bianchi , Z. Berkay Celik

As diverse linguistic communities and users adopt large language models (LLMs), assessing their safety across languages becomes critical. Despite ongoing efforts to make LLMs safe, they can still be made to behave unsafely with…

Computation and Language · Computer Science 2024-08-09 Fabio Pernisi , Dirk Hovy , Paul Röttger

The adoption of large language models (LLMs) in many applications, from customer service chat bots and software development assistants to more capable agentic systems necessitates research into how to secure these systems. Attacks like…

Cryptography and Security · Computer Science 2024-12-03 Erick Galinkin , Martin Sablotny

In recent years, the security vulnerabilities of Multi-modal Large Language Models (MLLMs) have become a serious concern in the Generative Artificial Intelligence (GenAI) research. These highly intelligent models, capable of performing…

Cryptography and Security · Computer Science 2026-01-12 Badhan Chandra Das , Md Tasnim Jawad , Joaquin Molto , M. Hadi Amini , Yanzhao Wu

Large Language Models (LLMs) are increasingly vulnerable to a sophisticated form of adversarial prompting known as camouflaged jailbreaking. This method embeds malicious intent within seemingly benign language to evade existing safety…

Cryptography and Security · Computer Science 2025-09-09 Youjia Zheng , Mohammad Zandsalimy , Shanu Sushmita

Jailbreak attacks induce Large Language Models (LLMs) to generate harmful responses, posing severe misuse threats. Though research on jailbreak attacks and defenses is emerging, there is no consensus on evaluating jailbreaks, i.e., the…

Cryptography and Security · Computer Science 2025-02-05 Delong Ran , Jinyuan Liu , Yichen Gong , Jingyi Zheng , Xinlei He , Tianshuo Cong , Anyu Wang

The rapid progress of Large Language Models (LLMs) has opened up new opportunities across various domains and applications; yet it also presents challenges related to potential misuse. To mitigate such risks, red teaming has been employed…

Cryptography and Security · Computer Science 2025-06-10 Yifan Jiang , Kriti Aggarwal , Tanmay Laud , Kashif Munir , Jay Pujara , Subhabrata Mukherjee

Large Language Model (LLM) alignment aims to ensure that LLM outputs match with human values. Researchers have demonstrated the severity of alignment problems with a large spectrum of jailbreak techniques that can induce LLMs to produce…

Computation and Language · Computer Science 2024-02-06 Xiaolong Jin , Zhuo Zhang , Xiangyu Zhang

While large language models (LLMs) exhibit remarkable capabilities across a wide range of tasks, they pose potential safety concerns, such as the ``jailbreak'' problem, wherein malicious instructions can manipulate LLMs to exhibit…

Computation and Language · Computer Science 2024-03-05 Yue Deng , Wenxuan Zhang , Sinno Jialin Pan , Lidong Bing

Considerable research efforts have been devoted to ensuring that large language models (LLMs) align with human values and generate safe text. However, an excessive focus on sensitivity to certain topics can compromise the model's robustness…

Computation and Language · Computer Science 2023-08-29 Huachuan Qiu , Shuai Zhang , Anqi Li , Hongliang He , Zhenzhong Lan

Large language models (LLMs) are increasingly deployed in real-world applications, raising concerns about their security. While jailbreak attacks highlight failures under overtly harmful queries, they overlook a critical risk: incorrectly…

Cryptography and Security · Computer Science 2025-06-10 Yukai Zhou , Sibei Yang , Wenjie Wang

Multi-turn jailbreak attacks simulate real-world human interactions by engaging large language models (LLMs) in iterative dialogues, exposing critical safety vulnerabilities. However, existing methods often struggle to balance semantic…

Computation and Language · Computer Science 2025-03-12 Zonghao Ying , Deyue Zhang , Zonglei Jing , Yisong Xiao , Quanchen Zou , Aishan Liu , Siyuan Liang , Xiangzheng Zhang , Xianglong Liu , Dacheng Tao

Large Language Models (LLMs) rapidly reshape modern life, advancing fields from healthcare to education and beyond. However, alongside their remarkable capabilities lies a significant threat: the susceptibility of these models to…

Computation and Language · Computer Science 2025-05-16 Michael Fire , Yitzhak Elbazis , Adi Wasenstein , Lior Rokach

Large language models (LLMs) have exhibited outstanding performance in engaging with humans and addressing complex questions by leveraging their vast implicit knowledge and robust reasoning capabilities. However, such models are vulnerable…

Computation and Language · Computer Science 2024-10-16 Hao Yang , Lizhen Qu , Ehsan Shareghi , Gholamreza Haffari

Although Large Language Models (LLMs) have demonstrated significant capabilities in executing complex tasks in a zero-shot manner, they are susceptible to jailbreak attacks and can be manipulated to produce harmful outputs. Recently, a…

Cryptography and Security · Computer Science 2024-11-07 Zhao Xu , Fan Liu , Hao Liu

Jailbreak attacks cause large language models (LLMs) to generate harmful, unethical, or otherwise objectionable content. Evaluating these attacks presents a number of challenges, which the current collection of benchmarks and evaluation…

Large Language Models (LLMs) face a significant threat from multi-turn jailbreak attacks, where adversaries progressively steer conversations to elicit harmful outputs. However, the practical effectiveness of existing attacks is undermined…

Cryptography and Security · Computer Science 2026-01-12 Songze Li , Ruishi He , Xiaojun Jia , Jun Wang , Zhihui Fu

While large language models (LLMs) have demonstrated increasing power, they have also given rise to a wide range of harmful behaviors. As representatives, jailbreak attacks can provoke harmful or unethical responses from LLMs, even after…

Computation and Language · Computer Science 2024-03-01 Nan Xu , Fei Wang , Ben Zhou , Bang Zheng Li , Chaowei Xiao , Muhao Chen