中文
相关论文

相关论文: Can Large Language Models Automatically Jailbreak …

200 篇论文

In deployment and application, large language models (LLMs) typically undergo safety alignment to prevent illegal and unethical outputs. However, the continuous advancement of jailbreak attack techniques, designed to bypass safety…

密码学与安全 · 计算机科学 2025-09-05 Chuhan Zhang , Ye Zhang , Bowen Shi , Yuyou Gan , Tianyu Du , Shouling Ji , Dazhan Deng , Yingcai Wu

Security alignment enables the Large Language Model (LLM) to gain the protection against malicious queries, but various jailbreak attack methods reveal the vulnerability of this security mechanism. Previous studies have isolated LLM…

密码学与安全 · 计算机科学 2025-08-07 Xiaohu Li , Yunfeng Ning , Zepeng Bao , Mayi Xu , Jianhao Chen , Tieyun Qian

Large language models (LLMs) undergo safety alignment after training and tuning, yet recent work shows that safety can be bypassed through jailbreak attacks. While many jailbreaks and defenses exist, their cross-lingual generalization…

计算与语言 · 计算机科学 2025-11-05 Berk Atil , Rebecca J. Passonneau , Fred Morstatter

Despite efforts to align large language models (LLMs) with human intentions, widely-used LLMs such as GPT, Llama, and Claude are susceptible to jailbreaking attacks, wherein an adversary fools a targeted LLM into generating objectionable…

机器学习 · 计算机科学 2024-06-17 Alexander Robey , Eric Wong , Hamed Hassani , George J. Pappas

Large language models (LLMs) have demonstrated remarkable capabilities across diverse applications, however, they remain critically vulnerable to jailbreak attacks that elicit harmful responses violating human values and safety guidelines.…

密码学与安全 · 计算机科学 2026-01-12 Zhaoqi Wang , Zijian Zhang , Daqing He , Pengtao Kou , Xin Li , Jiamou Liu , Jincheng An , Yong Liu

Large Language Models (LLMs) are widely deployed in real-world systems. Given their broader applicability, prompt engineering has become an efficient tool for resource-scarce organizations to adopt LLMs for their own purposes. At the same…

密码学与安全 · 计算机科学 2026-02-27 Piyush Jaiswal , Aaditya Pratap , Shreyansh Saraswati , Harsh Kasyap , Somanath Tripathy

Warning: This paper contains content that may involve potentially harmful behaviours, discussed strictly for research purposes. Jailbreak attacks can hinder the safety of Large Language Model (LLM) applications, especially chatbots.…

密码学与安全 · 计算机科学 2025-08-26 Junchen Ding , Jiahao Zhang , Yi Liu , Ziqi Ding , Gelei Deng , Yuekang Li

The rapid proliferation of Large Language Models (LLMs) has heightened concerns regarding their exposure to jailbreak attacks, which craft adversarial inputs designed to elicit unsafe content. Although proprietary models such as GPT-4 have…

密码学与安全 · 计算机科学 2026-05-26 Xiaodong Wu , Xiangman Li , Qi Li , Lingshuang Liu , Jianbing Ni

Recently, Multimodal Large Language Model (MLLM) represented by GPT-4V has been a new rising research hotspot, which uses powerful Large Language Models (LLMs) as a brain to perform multimodal tasks. The surprising emergent capabilities of…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Shukang Yin , Chaoyou Fu , Sirui Zhao , Ke Li , Xing Sun , Tong Xu , Enhong Chen

Large Language Models (LLMs) have been shown to be susceptible to jailbreak attacks, or adversarial attacks used to illicit high risk behavior from a model. Jailbreaks have been exploited by cybercriminals and blackhat actors to cause…

计算与语言 · 计算机科学 2025-01-07 Joao Fonseca , Andrew Bell , Julia Stoyanovich

Jailbreaks on large language models (LLMs) have recently received increasing attention. For a comprehensive assessment of LLM safety, it is essential to consider jailbreaks with diverse attributes, such as contextual coherence and…

机器学习 · 计算机科学 2024-06-10 Xingang Guo , Fangxu Yu , Huan Zhang , Lianhui Qin , Bin Hu

Large Language Models (LLMs) such as ChatGPT and its competitors have caused a revolution in natural language processing, but their capabilities also introduce new security vulnerabilities. This survey provides a comprehensive overview of…

密码学与安全 · 计算机科学 2025-08-26 Miles Q. Li , Benjamin C. M. Fung

Large Language Models (LLMs) have revolutionized the field of Natural Language Processing thanks to their ability to reuse knowledge acquired on massive text corpora on a wide variety of downstream tasks, with minimal (if any) tuning steps.…

计算与语言 · 计算机科学 2024-07-12 Flavio Petruzzellis , Alberto Testolin , Alessandro Sperduti

Large Language Models (LLMs) aligned with human feedback have recently garnered significant attention. However, it remains vulnerable to jailbreak attacks, where adversaries manipulate prompts to induce harmful outputs. Exploring jailbreak…

密码学与安全 · 计算机科学 2024-12-23 Hongyi Li , Jiawei Ye , Jie Wu , Tianjie Yan , Chu Wang , Zhixin Li

Large Language Models (LLMS) have increasingly become central to generating content with potential societal impacts. Notably, these models have demonstrated capabilities for generating content that could be deemed harmful. To mitigate these…

密码学与安全 · 计算机科学 2024-05-20 Zihao Xu , Yi Liu , Gelei Deng , Yuekang Li , Stjepan Picek

As deep learning advances, Large Language Models (LLMs) and their multimodal counterparts, Multimodal Large Language Models (MLLMs), have shown exceptional performance in many real-world tasks. However, MLLMs face significant security…

密码学与安全 · 计算机科学 2024-10-23 Fenghua Weng , Yue Xu , Chengyan Fu , Wenjie Wang

This paper focuses on jailbreaking attacks against multi-modal large language models (MLLMs), seeking to elicit MLLMs to generate objectionable responses to harmful user queries. A maximum likelihood-based algorithm is proposed to find an…

机器学习 · 计算机科学 2024-02-07 Zhenxing Niu , Haodong Ren , Xinbo Gao , Gang Hua , Rong Jin

Large Language Models (LLMs) have demonstrated exceptional capabilities across various natural language processing tasks. Due to their training on internet-sourced datasets, LLMs can sometimes generate objectionable content, necessitating…

计算与语言 · 计算机科学 2024-11-15 Leyang Hu , Boran Wang

Recent advances in large language models (LLMs) have demonstrated remarkable potential in the field of natural language processing. Unfortunately, LLMs face significant security and ethical risks. Although techniques such as safety…

密码学与安全 · 计算机科学 2025-05-27 Qingsong Zou , Jingyu Xiao , Qing Li , Zhi Yan , Yuhang Wang , Li Xu , Wenxuan Wang , Kuofeng Gao , Ruoyu Li , Yong Jiang

Jailbreak attacks pose a serious threat to Large Language Models (LLMs) by bypassing their safety mechanisms. A truly advanced jailbreak is defined not only by its effectiveness but, more critically, by its stealthiness. However, existing…

密码学与安全 · 计算机科学 2026-03-13 Jianing Geng , Biao Yi , Zekun Fei , Ruiqi He , Lihai Nie , Tong Li , Zheli Liu