English
Related papers

Related papers: State-Dependent Safety Failures in Multi-Turn Lang…

200 papers

Large language models (LLMs) are widely used in real-world applications, raising concerns about their safety and trustworthiness. While red-teaming with jailbreak prompts exposes the vulnerabilities of LLMs, current efforts focus primarily…

Computation and Language · Computer Science 2025-11-14 Yi Zhao , Youzhi Zhang

Larger language models (LLMs) have taken the world by storm with their massive multi-tasking capabilities simply by optimizing over a next-word prediction objective. With the emergence of their properties and encoded knowledge, the risk of…

Computation and Language · Computer Science 2023-08-31 Rishabh Bhardwaj , Soujanya Poria

Safety alignment in large language models (LLMs) and multimodal large language models (MLLMs) is commonly assumed to operate as a near-binary threshold mechanism. We challenge this assumption by revealing that safety behavior is governed by…

Cryptography and Security · Computer Science 2026-05-27 Tongxi Wu , Jian Zhang , Yang Gao

With the wide application of multimodal foundation models in intelligent agent systems, scenarios such as mobile device control, intelligent assistant interaction, and multimodal task execution are gradually relying on such large…

Artificial Intelligence · Computer Science 2025-07-02 Siyuan Liang , Tianmeng Fang , Zhe Liu , Aishan Liu , Yan Xiao , Jinyuan He , Ee-Chien Chang , Xiaochun Cao

In perpetrator treatment, a recurring observation is the dissociation between insight and action: offenders articulate remorse yet behavioral change does not follow. We report four preregistered studies (1,584 multi-agent simulations across…

Artificial Intelligence · Computer Science 2026-03-06 Hiroki Fukui

Large language models trained for safety and harmlessness remain susceptible to adversarial misuse, as evidenced by the prevalence of "jailbreak" attacks on early releases of ChatGPT that elicit undesired behavior. Going beyond recognition…

Machine Learning · Computer Science 2023-07-06 Alexander Wei , Nika Haghtalab , Jacob Steinhardt

Large language models, LLMs, are increasingly deployed in multiturn settings where earlier responses shape later ones, making reliability dependent on whether a conversation remains consistent over time. When this consistency degrades…

Computation and Language · Computer Science 2026-04-20 Wael Hafez , Amir Nazeri

Large Language Models (LLMs) have achieved strong performance on static reasoning benchmarks, yet their effectiveness as interactive agents operating in adversarial, time-sensitive environments remains poorly understood. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Yang Li , Xing Chen , Yutao Liu , Gege Qi , Yanxian BI , Zizhe Wang , Yunjian Zhang , Yao Zhu

MLLMs are increasingly deployed in multi-turn settings, where attackers can escalate unsafe intent through the evolving visual-text history and exploit long-context safety decay. Yet safety alignment is still dominated by single-turn data…

Machine Learning · Computer Science 2026-05-28 Haolong Hu , Hanyu Li , Tiancheng He , Huahui Yi , An Zhang , Qiankun Li , Kun Wang , Yang Liu , Zhigang Zeng

The inability of Large Language Models (LLMs) to modulate their personality expression in response to evolving dialogue dynamics hinders their performance in complex, interactive contexts. We propose a model-agnostic framework for dynamic…

Computation and Language · Computer Science 2026-02-26 Leon Pielage , Ole Hätscher , Mitja Back , Bernhard Marschall , Benjamin Risse

Large language models (LLMs) excel on static benchmarks, but their performance across multi-turn conversations, which better reflect real-world usage, remains understudied. Addressing this gap is critical in high-stakes settings like…

Computation and Language · Computer Science 2026-05-27 Kevin H. Guo , Chao Yan , Avinash Baidya , Katherine Brown , Xiang Gao , Juming Xiong , Zhijun Yin , Bradley A. Malin

As large language models (LLMs) constantly evolve, ensuring their safety remains a critical research problem. Previous red-teaming approaches for LLM safety have primarily focused on single prompt attacks or goal hijacking. To the best of…

Computation and Language · Computer Science 2024-06-26 Erxin Yu , Jing Li , Ming Liao , Siqi Wang , Zuchen Gao , Fei Mi , Lanqing Hong

AI is increasingly being used to assist fraud and cybercrime. However, it is unclear the extent to which current large language models can provide useful information for complex criminal activity. Working with law enforcement and policy…

Despite significant advances in alignment techniques, we demonstrate that state-of-the-art language models remain vulnerable to carefully crafted conversational scenarios that can induce various forms of misalignment without explicit…

Computation and Language · Computer Science 2025-08-07 Siddhant Panpatil , Hiskias Dingeto , Haon Park

While Large Language Model (LLM) capabilities have scaled, safety guardrails remain largely stateless, treating multi-turn dialogues as a series of disconnected events. This lack of temporal awareness facilitates a "Safety Gap" where…

Artificial Intelligence · Computer Science 2026-02-20 Justin Albrethsen , Yash Datta , Kunal Kumar , Sharath Rajasekar

Large Language Models (LLMs) remain susceptible to jailbreak exploits that bypass safety filters and induce harmful or unethical behavior. This work presents a systematic taxonomy of existing jailbreak defenses across prompt-level,…

Cryptography and Security · Computer Science 2025-11-25 Ryan Wong , Hosea David Yu Fei Ng , Dhananjai Sharma , Glenn Jun Jie Ng , Kavishvaran Srinivasan

We present MultiBreak, a scalable and diverse multi-turn jailbreak benchmark to evaluate large language model (LLM) safety. Multi-turn jailbreaks mimic natural conversational settings, making them easier to bypass safety-aligned LLM than…

Computation and Language · Computer Science 2026-05-05 Jialin Song , Xiaodong Liu , Weiwei Yang , Wuyang Chen , Mingqian Feng , Xuekai Zhu , Jianfeng Gao

Conversational large language models are trained to refuse to answer harmful questions. However, emergent jailbreaking techniques can still elicit unsafe outputs, presenting an ongoing challenge for model alignment. To better understand how…

Computation and Language · Computer Science 2024-10-08 Sarah Ball , Frauke Kreuter , Nina Panickssery

Current jailbreaking work on large language models (LLMs) aims to elicit unsafe outputs from given prompts. However, it only focuses on single-turn jailbreaking targeting one specific query. On the contrary, the advanced LLMs are designed…

Computation and Language · Computer Science 2025-08-12 Xianjun Yang , Liqiang Xiao , Shiyang Li , Faisal Ladhak , Hyokun Yun , Linda Ruth Petzold , Yi Xu , William Yang Wang

Multi-turn interaction in the dialogue system research refers to a system's ability to maintain context across multiple dialogue turns, enabling it to generate coherent and contextually relevant responses. Recent advancements in large…

Computation and Language · Computer Science 2025-01-20 Chen Zhang , Xinyi Dai , Yaxiong Wu , Qu Yang , Yasheng Wang , Ruiming Tang , Yong Liu