English
Related papers

Related papers: VERA: Variational Inference Framework for Jailbrea…

200 papers

Prompt injection (both direct and indirect) and jailbreaking are now recognized as significant issues for large language models (LLMs), particularly due to their potential for harm in application-integrated contexts. This extended abstract…

Cryptography and Security · Computer Science 2024-07-08 Simon Ostermann , Kevin Baum , Christoph Endres , Julia Masloh , Patrick Schramowski

In this paper, we investigate the safety mechanisms of instruction fine-tuned large language models (LLMs). We discover that re-weighting MLP neurons can significantly compromise a model's safety, especially for MLPs in end-of-sentence…

Computation and Language · Computer Science 2024-10-15 Yifan Luo , Zhennan Zhou , Meitan Wang , Bin Dong

Large language models (LLMs) are susceptible to a type of attack known as jailbreaking, which misleads LLMs to output harmful contents. Although there are diverse jailbreak attack strategies, there is no unified understanding on why some…

Computation and Language · Computer Science 2024-12-04 Yuping Lin , Pengfei He , Han Xu , Yue Xing , Makoto Yamada , Hui Liu , Jiliang Tang

Conversational large language models are trained to refuse to answer harmful questions. However, emergent jailbreaking techniques can still elicit unsafe outputs, presenting an ongoing challenge for model alignment. To better understand how…

Computation and Language · Computer Science 2024-10-08 Sarah Ball , Frauke Kreuter , Nina Panickssery

Jailbreak vulnerabilities in Large Language Models (LLMs), which exploit meticulously crafted prompts to elicit content that violates service guidelines, have captured the attention of research communities. While model owners can defend…

Cryptography and Security · Computer Science 2024-04-16 Dongyu Yao , Jianshu Zhang , Ian G. Harris , Marcel Carlsson

Jailbreak attacks induce Large Language Models (LLMs) to generate harmful responses, posing severe misuse threats. Though research on jailbreak attacks and defenses is emerging, there is no consensus on evaluating jailbreaks, i.e., the…

Cryptography and Security · Computer Science 2025-02-05 Delong Ran , Jinyuan Liu , Yichen Gong , Jingyi Zheng , Xinlei He , Tianshuo Cong , Anyu Wang

This paper focuses on jailbreaking attacks against multi-modal large language models (MLLMs), seeking to elicit MLLMs to generate objectionable responses to harmful user queries. A maximum likelihood-based algorithm is proposed to find an…

Machine Learning · Computer Science 2024-02-07 Zhenxing Niu , Haodong Ren , Xinbo Gao , Gang Hua , Rong Jin

With the introduction of the transformers architecture, LLMs have revolutionized the NLP field with ever more powerful models. Nevertheless, their development came up with several challenges. The exponential growth in computational power…

Computation and Language · Computer Science 2024-11-12 Yannis Belkhiter , Giulio Zizzo , Sergio Maffeis

Large Language Models (LLMs), especially their compact efficiency-oriented variants, remain susceptible to jailbreak attacks that can elicit harmful outputs despite extensive alignment efforts. Existing adversarial prompt generation…

As large language models (LLMs) become integrated into everyday applications, ensuring their robustness and security is increasingly critical. In particular, LLMs can be manipulated into unsafe behaviour by prompts known as jailbreaks. The…

Large language models (LLMs) have become increasingly integrated with various applications. To ensure that LLMs do not generate unsafe responses, they are aligned with safeguards that specify what content is restricted. However, such…

Computation and Language · Computer Science 2024-05-08 Hongyu Cai , Arjun Arunasalam , Leo Y. Lin , Antonio Bianchi , Z. Berkay Celik

The increasing use of Retrieval-Augmented Generation (RAG) systems in various applications necessitates stringent protocols to ensure RAG systems accuracy, safety, and alignment with user intentions. In this paper, we introduce VERA…

Information Retrieval · Computer Science 2024-09-09 Tianyu Ding , Adi Banerjee , Laurent Mombaerts , Yunhong Li , Tarik Borogovac , Juan Pablo De la Cruz Weinstein

Large Language Models (LLMs), such as ChatGPT and GPT-4, are designed to provide useful and safe responses. However, adversarial prompts known as 'jailbreaks' can circumvent safeguards, leading LLMs to generate potentially harmful content.…

Computation and Language · Computer Science 2024-04-09 Peng Ding , Jun Kuang , Dan Ma , Xuezhi Cao , Yunsen Xian , Jiajun Chen , Shujian Huang

Despite the outstanding performance of Large language Models (LLMs) in diverse tasks, they are vulnerable to jailbreak attacks, wherein adversarial prompts are crafted to bypass their security mechanisms and elicit unexpected responses.…

Cryptography and Security · Computer Science 2025-04-25 Zeqing He , Zhibo Wang , Zhixuan Chu , Huiyu Xu , Wenhui Zhang , Qinglong Wang , Rui Zheng

Aligning large language models (LLMs) with human values, particularly when facing complex and stealthy jailbreak attacks, presents a formidable challenge. Unfortunately, existing methods often overlook this intrinsic nature of jailbreaks,…

Computation and Language · Computer Science 2024-12-17 Yuqi Zhang , Liang Ding , Lefei Zhang , Dacheng Tao

As large language models (LLMs) grow in power and influence, ensuring their safety and preventing harmful output becomes critical. Automated red teaming serves as a tool to detect security vulnerabilities in LLMs without manual labor.…

Artificial Intelligence · Computer Science 2025-06-03 Weiyang Guo , Zesheng Shi , Zhuo Li , Yequan Wang , Xuebo Liu , Wenya Wang , Fangming Liu , Min Zhang , Jing Li

The emergence of Multimodal Large Language Models (MLRMs) has enabled sophisticated visual reasoning capabilities by integrating reinforcement learning and Chain-of-Thought (CoT) supervision. However, while these enhanced reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Bingrui Sima , Linhua Cong , Wenxuan Wang , Kun He

Large Vision-Language Models (VLMs) are susceptible to jailbreak attacks: researchers have developed a variety of attack strategies that can successfully bypass the safety mechanisms of VLMs. Among these approaches, jailbreak methods based…

Cryptography and Security · Computer Science 2025-11-12 Yuxuan Zhou , Yuzhao Peng , Yang Bai , Kuofeng Gao , Yihao Zhang , Yechao Zhang , Xun Chen , Tao Yu , Tao Dai , Shu-Tao Xia

The wide adoption of Large Language Models (LLMs) has attracted significant attention from $\textit{jailbreak}$ attacks, where adversarial prompts crafted through optimization or manual design exploit LLMs to generate malicious contents.…

Computation and Language · Computer Science 2025-10-01 Xurui Song , Zhixin Xie , Shuo Huai , Jiayi Kong , Jun Luo

Despite inheriting security measures from underlying language models, Vision-Language Models (VLMs) may still be vulnerable to safety alignment issues. Through empirical analysis, we uncover two critical findings: scenario-matched images…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Shuyang Hao , Bryan Hooi , Jun Liu , Kai-Wei Chang , Zi Huang , Yujun Cai