中文
相关论文

相关论文: Knowledge-to-Jailbreak: Investigating Knowledge-dr…

200 篇论文

Although large language models (LLMs) demonstrate impressive proficiency in various tasks, they present potential safety risks, such as `jailbreaks', where malicious inputs can coerce LLMs into generating harmful content bypassing safety…

计算与语言 · 计算机科学 2025-11-26 Isack Lee , Haebin Seong

Large language models (LLMs) undergo safety alignment after training and tuning, yet recent work shows that safety can be bypassed through jailbreak attacks. While many jailbreaks and defenses exist, their cross-lingual generalization…

计算与语言 · 计算机科学 2025-11-05 Berk Atil , Rebecca J. Passonneau , Fred Morstatter

While large language models (LLMs) have demonstrated increasing power, they have also given rise to a wide range of harmful behaviors. As representatives, jailbreak attacks can provoke harmful or unethical responses from LLMs, even after…

计算与语言 · 计算机科学 2024-03-01 Nan Xu , Fei Wang , Ben Zhou , Bang Zheng Li , Chaowei Xiao , Muhao Chen

The widespread adoption of Large Language Models (LLMs) has heightened concerns about their security, particularly their vulnerability to jailbreak attacks that leverage crafted prompts to generate malicious outputs. While prior research…

密码学与安全 · 计算机科学 2025-06-13 Haoyang Li , Huan Gao , Zhiyuan Zhao , Zhiyu Lin , Junyu Gao , Xuelong Li

Large Language Models (LLMs) suffer from a range of vulnerabilities that allow malicious users to solicit undesirable responses through manipulation of the input text. These so-called jailbreak prompts are designed to trick the LLM into…

计算与语言 · 计算机科学 2025-10-13 John Hawkins , Aditya Pramar , Rodney Beard , Rohitash Chandra

Although Large Language Models (LLMs) have demonstrated significant capabilities in executing complex tasks in a zero-shot manner, they are susceptible to jailbreak attacks and can be manipulated to produce harmful outputs. Recently, a…

密码学与安全 · 计算机科学 2024-11-07 Zhao Xu , Fan Liu , Hao Liu

Large Language Models (LLMs) are increasingly popular, powering a wide range of applications. Their widespread use has sparked concerns, especially through jailbreak attacks that bypass safety measures to produce harmful content. In this…

密码学与安全 · 计算机科学 2025-12-25 Zhengchun Shang , Wenlan Wei , Weiheng Bai

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks. Nevertheless, they still pose notable safety risks due to potential misuse for malicious purposes. Jailbreaking, which seeks to induce models to…

计算与语言 · 计算机科学 2025-09-30 Hua Tang , Lingyong Yan , Yukun Zhao , Shuaiqiang Wang , Jizhou Huang , Dawei Yin

Large Language Models (LLMs) have revolutionized Artificial Intelligence (AI) services due to their exceptional proficiency in understanding and generating human-like text. LLM chatbots, in particular, have seen widespread adoption,…

密码学与安全 · 计算机科学 2024-02-14 Gelei Deng , Yi Liu , Yuekang Li , Kailong Wang , Ying Zhang , Zefeng Li , Haoyu Wang , Tianwei Zhang , Yang Liu

Large Language Model (LLM) alignment aims to ensure that LLM outputs match with human values. Researchers have demonstrated the severity of alignment problems with a large spectrum of jailbreak techniques that can induce LLMs to produce…

计算与语言 · 计算机科学 2024-02-06 Xiaolong Jin , Zhuo Zhang , Xiangyu Zhang

Multimodal large language models (MLLMs) excel in vision-language tasks but also pose significant risks of generating harmful content, particularly through jailbreak attacks. Jailbreak attacks refer to intentional manipulations that bypass…

密码学与安全 · 计算机科学 2025-07-18 Yi Nian , Shenzhe Zhu , Yuehan Qin , Li Li , Ziyi Wang , Chaowei Xiao , Yue Zhao

Jailbreak attacks are crucial for identifying and mitigating the security vulnerabilities of Large Language Models (LLMs). They are designed to bypass safeguards and elicit prohibited outputs. However, due to significant differences among…

This paper provides a systematic survey of jailbreak attacks and defenses on Large Language Models (LLMs) and Vision-Language Models (VLMs), emphasizing that jailbreak vulnerabilities stem from structural factors such as incomplete training…

密码学与安全 · 计算机科学 2026-01-08 Zejian Chen , Chaozhuo Li , Chao Li , Xi Zhang , Litian Zhang , Yiming He

The jailbreak attack can bypass the safety measures of a Large Language Model (LLM), generating harmful content. This misuse of LLM has led to negative societal consequences. Currently, there are two main approaches to address jailbreak…

计算与语言 · 计算机科学 2024-03-25 Zezhong Wang , Fangkai Yang , Lu Wang , Pu Zhao , Hongru Wang , Liang Chen , Qingwei Lin , Kam-Fai Wong

As Large Language Models (LLMs) of Prompt Jailbreaking are getting more and more attention, it is of great significance to raise a generalized research paradigm to evaluate attack strengths and a basic model to conduct subtler experiments.…

密码学与安全 · 计算机科学 2024-04-15 Tianyu Zhang , Zixuan Zhao , Jiaqi Huang , Jingyu Hua , Sheng Zhong

Large Language Models (LLMs) remain susceptible to jailbreak exploits that bypass safety filters and induce harmful or unethical behavior. This work presents a systematic taxonomy of existing jailbreak defenses across prompt-level,…

密码学与安全 · 计算机科学 2025-11-25 Ryan Wong , Hosea David Yu Fei Ng , Dhananjai Sharma , Glenn Jun Jie Ng , Kavishvaran Srinivasan

In deployment and application, large language models (LLMs) typically undergo safety alignment to prevent illegal and unethical outputs. However, the continuous advancement of jailbreak attack techniques, designed to bypass safety…

密码学与安全 · 计算机科学 2025-09-05 Chuhan Zhang , Ye Zhang , Bowen Shi , Yuyou Gan , Tianyu Du , Shouling Ji , Dazhan Deng , Yingcai Wu

Jailbreaks on large language models (LLMs) have recently received increasing attention. For a comprehensive assessment of LLM safety, it is essential to consider jailbreaks with diverse attributes, such as contextual coherence and…

机器学习 · 计算机科学 2024-06-10 Xingang Guo , Fangxu Yu , Huan Zhang , Lianhui Qin , Bin Hu

Despite extensive alignment efforts, Large Vision-Language Models (LVLMs) remain vulnerable to jailbreak attacks, posing serious safety risks. To address this, existing detection methods either learn attack-specific parameters, which…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Shuang Liang , Zhihao Xu , Jialing Tao , Hui Xue , Xiting Wang

Jailbreak attacks reveal critical vulnerabilities in Large Language Models (LLMs) by causing them to generate harmful or unethical content. Evaluating these threats is particularly challenging due to the evolving nature of LLMs and the…

机器学习 · 计算机科学 2025-07-11 Peiyan Zhang , Haibo Jin , Liying Kang , Haohan Wang