中文
相关论文

相关论文: Structured Semantic Cloaking for Jailbreak Attacks…

200 篇论文

Large Language Models (LLMs) are susceptible to Jailbreaking attacks, which aim to extract harmful information by subtly modifying the attack query. As defense mechanisms evolve, directly obtaining harmful information becomes increasingly…

机器学习 · 计算机科学 2024-10-03 Yixin Cheng , Markos Georgopoulos , Volkan Cevher , Grigorios G. Chrysos

While large language models (LLMs) have demonstrated increasing power, they have also given rise to a wide range of harmful behaviors. As representatives, jailbreak attacks can provoke harmful or unethical responses from LLMs, even after…

计算与语言 · 计算机科学 2024-03-01 Nan Xu , Fei Wang , Ben Zhou , Bang Zheng Li , Chaowei Xiao , Muhao Chen

Recent advances in large language models (LLMs) have demonstrated remarkable potential in the field of natural language processing. Unfortunately, LLMs face significant security and ethical risks. Although techniques such as safety…

密码学与安全 · 计算机科学 2025-05-27 Qingsong Zou , Jingyu Xiao , Qing Li , Zhi Yan , Yuhang Wang , Li Xu , Wenxuan Wang , Kuofeng Gao , Ruoyu Li , Yong Jiang

Large language models (LLMs) have made significant advancements across various tasks, but their safety alignment remain a major concern. Exploring jailbreak prompts can expose LLMs' vulnerabilities and guide efforts to secure them. Existing…

密码学与安全 · 计算机科学 2025-11-25 Xiaoning Dong , Wenbo Hu , Wei Xu , Tianxing He

Large Language Models (LLMs) are susceptible to generating harmful content when prompted with carefully crafted inputs, a vulnerability known as LLM jailbreaking. As LLMs become more powerful, studying jailbreak methods is critical to…

计算与语言 · 计算机科学 2025-01-07 Hao Wang , Hao Li , Junda Zhu , Xinyuan Wang , Chengwei Pan , MinLie Huang , Lei Sha

As the use of large language models (LLMs) continues to expand, ensuring their safety and robustness has become a critical challenge. In particular, jailbreak attacks that bypass built-in safety mechanisms are increasingly recognized as a…

密码学与安全 · 计算机科学 2025-11-19 Hajun Kim , Hyunsik Na , Daeseon Choi

Intent detection, a core component of natural language understanding, has considerably evolved as a crucial mechanism in safeguarding large language models (LLMs). While prior work has applied intent detection to enhance LLMs' moderation…

计算与语言 · 计算机科学 2025-08-26 Jun Zhuang , Haibo Jin , Ye Zhang , Zhengjian Kang , Wenbin Zhang , Gaby G. Dagher , Haohan Wang

Iterative jailbreak methods that repeatedly rewrite and input prompts into large language models (LLMs) to induce harmful outputs -- using the model's previous responses to guide each new iteration -- have been found to be a highly…

计算与语言 · 计算机科学 2025-10-21 Masahiro Kaneko , Zeerak Talat , Timothy Baldwin

Safety trained large language models (LLMs) can often be induced to answer harmful requests through jailbreak prompts. Because we lack a robust understanding of why LLMs are susceptible to jailbreaks, future frontier models operating more…

人工智能 · 计算机科学 2026-05-04 Shubham Kumar , Narendra Ahuja

Large Language Models (LLMs) have exhibited remarkable capabilities but remain vulnerable to jailbreaking attacks, which can elicit harmful content from the models by manipulating the input prompts. Existing black-box jailbreaking…

密码学与安全 · 计算机科学 2025-08-19 Weiwei Qi , Shuo Shao , Wei Gu , Tianhang Zheng , Puning Zhao , Zhan Qin , Kui Ren

Despite extensive efforts to align Large Language Models (LLMs) with human values and safety rules, jailbreak attacks that exploit certain vulnerabilities continuously emerge, highlighting the need to strengthen existing LLMs with…

机器学习 · 计算机科学 2025-09-30 Xuekang Wang , Shengyu Zhu , Xueqi Cheng

Large Reasoning Models (LRMs) have recently demonstrated impressive performances across diverse domains. However, how the safety of Large Language Models (LLMs) benefits from enhanced reasoning capabilities against jailbreak queries remains…

计算与语言 · 计算机科学 2025-09-23 Junda Zhu , Lingyong Yan , Shuaiqiang Wang , Dawei Yin , Lei Sha

While Large Language Models (LLMs) have achieved remarkable progress, they remain vulnerable to jailbreak attacks. Existing methods, primarily relying on discrete input optimization (e.g., GCG), often suffer from high computational costs…

计算与语言 · 计算机科学 2026-01-09 Wenpeng Xing , Mohan Li , Chunqiang Hu , Haitao Xu , Ningyu Zhang , Bo Lin , Meng Han

Large language models (LLMs) achieve strong performance by generating long chains of thought, but longer traces always introduce redundant or ineffective reasoning steps. One typical behavior is that they often perform unnecessary…

计算与语言 · 计算机科学 2026-01-13 Jinyi Han , Zixiang Di , Zishang Jiang , Ying Liao , Jiaqing Liang , Yongqi Wang , Yanghua Xiao

With the development of natural language processing (NLP), large language models (LLMs) are becoming increasingly popular. LLMs are integrating more into everyday life, raising public concerns about their security vulnerabilities.…

计算与语言 · 计算机科学 2024-06-27 Ziqiu Wang , Jun Liu , Shengkai Zhang , Yang Yang

The widespread applications of large language models (LLMs) have brought about concerns regarding their potential misuse. Although aligned with human preference data before release, LLMs remain vulnerable to various malicious attacks. In…

密码学与安全 · 计算机科学 2025-03-04 Yan Yang , Zeguan Xiao , Xin Lu , Hongru Wang , Xuetao Wei , Hailiang Huang , Guanhua Chen , Yun Chen

In this study, we disclose a worrying new vulnerability in Large Language Models (LLMs), which we term \textbf{involuntary jailbreak}. Unlike existing jailbreak attacks, this weakness is distinct in that it does not involve a specific…

密码学与安全 · 计算机科学 2025-12-30 Yangyang Guo , Yangyan Li , Mohan Kankanhalli

Large Language Models face security threats from jailbreak attacks. Existing research has predominantly focused on prompt-level attacks while largely ignoring the underexplored attack surface of user-controlled response prefilling. This…

密码学与安全 · 计算机科学 2025-08-27 Yakai Li , Jiekang Hu , Weiduan Sang , Luping Ma , Dongsheng Nie , Weijuan Zhang , Aimin Yu , Yi Su , Qingjia Huang , Qihang Zhou

Large Language Models (LLMs) have transformed task automation and content generation across various domains while incorporating safety filters to prevent misuse. We introduce a novel jailbreaking framework that employs distributed prompt…

密码学与安全 · 计算机科学 2025-04-01 Johan Wahréus , Ahmed Hussain , Panos Papadimitratos

Large Reasoning Models (LRMs) improve task performance through extended inference-time reasoning. Although previous studies suggest that longer reasoning should lead to more robust safety behavior, we find evidence to the contrary:…

人工智能 · 计算机科学 2026-05-26 Jianli Zhao , Tingchen Fu , Rylan Schaeffer , Mrinank Sharma , Fazl Barez