English
Related papers

Related papers: Learning to Detect Unknown Jailbreak Attacks in La…

200 papers

Jailbreak attacks induce Large Language Models (LLMs) to generate harmful responses, posing severe misuse threats. Though research on jailbreak attacks and defenses is emerging, there is no consensus on evaluating jailbreaks, i.e., the…

Cryptography and Security · Computer Science 2025-02-05 Delong Ran , Jinyuan Liu , Yichen Gong , Jingyi Zheng , Xinlei He , Tianshuo Cong , Anyu Wang

Jailbreaks have been a central focus of research regarding the safety and reliability of large language models (LLMs), yet the mechanisms underlying these attacks remain poorly understood. While previous studies have predominantly relied on…

Cryptography and Security · Computer Science 2025-11-04 Nathalie Kirch , Constantin Weisser , Severin Field , Helen Yannakoudakis , Stephen Casper

Large Language Models (LLMs) are powerful tools for answering user queries, yet they remain highly vulnerable to jailbreak attacks. Existing guardrail methods typically rely on internal features or textual responses to detect malicious…

Cryptography and Security · Computer Science 2026-05-29 Zikai Zhang , Rui Hu , Olivera Kotevska , Jiahao Xu

Despite extensive safety-tuning, large language models (LLMs) remain vulnerable to jailbreak attacks via adversarially crafted instructions, reflecting a persistent trade-off between safety and task performance. In this work, we propose…

Cryptography and Security · Computer Science 2025-08-26 Wei Jie Yeo , Ranjan Satapathy , Erik Cambria

We introduce new jailbreak attacks on vision language models (VLMs), which use aligned LLMs and are resilient to text-only jailbreak attacks. Specifically, we develop cross-modality attacks on alignment where we pair adversarial images…

Cryptography and Security · Computer Science 2023-10-12 Erfan Shayegani , Yue Dong , Nael Abu-Ghazaleh

Large language models (LLMs) undergo safety alignment after training and tuning, yet recent work shows that safety can be bypassed through jailbreak attacks. While many jailbreaks and defenses exist, their cross-lingual generalization…

Computation and Language · Computer Science 2025-11-05 Berk Atil , Rebecca J. Passonneau , Fred Morstatter

The rapid proliferation of Large Language Models (LLMs) has raised significant concerns about their security against adversarial attacks. In this work, we propose a novel approach to crafting universal jailbreaks and data extraction attacks…

Cryptography and Security · Computer Science 2025-11-04 Kayua Oleques Paim , Rodrigo Brandao Mansilha , Diego Kreutz , Muriel Figueredo Franco , Weverton Cordeiro

The increasing sophistication of large vision-language models (LVLMs) has been accompanied by advances in safety alignment mechanisms designed to prevent harmful content generation. However, these defenses remain vulnerable to sophisticated…

Cryptography and Security · Computer Science 2026-04-09 Quanchen Zou , Zonghao Ying , Moyang Chen , Wenzhuo Xu , Yisong Xiao , Yakai Li , Deyue Zhang , Dongdong Yang , Zhao Liu , Xiangzheng Zhang

Large language models (LLMs) possess strong semantic understanding, driving significant progress in data mining applications. This is further enhanced by large reasoning models (LRMs), which provide explicit multi-step reasoning traces. On…

Machine Learning · Computer Science 2026-04-07 Aobo Chen , Chenxu Zhao , Chenglin Miao , Mengdi Huai

Detecting jailbreak attempts in clinical training large language models (LLMs) requires accurate modeling of linguistic deviations that signal unsafe or off-task user behavior. Prior work on the 2-Sigma clinical simulation platform showed…

Artificial Intelligence · Computer Science 2026-02-17 Tri Nguyen , Huy Hoang Bao Le , Lohith Srikanth Pentapalli , Laurah Turner , Kelly Cohen

Despite careful safety alignment, current large language models (LLMs) remain vulnerable to various attacks. To further unveil the safety risks of LLMs, we introduce a Safety Concept Activation Vector (SCAV) framework, which effectively…

Computation and Language · Computer Science 2024-12-03 Zhihao Xu , Ruixuan Huang , Changyu Chen , Xiting Wang

Defending aligned Large Language Models (LLMs) against jailbreaking attacks is a challenging problem, with existing approaches requiring multiple requests or even queries to auxiliary LLMs, making them computationally heavy. Instead, we…

Machine Learning · Computer Science 2025-02-24 Leyla Naz Candogan , Yongtao Wu , Elias Abad Rocamora , Grigorios G. Chrysos , Volkan Cevher

Large Language Models (LLMs) have gained significant attention but also raised concerns due to the risk of misuse. Jailbreak prompts, a popular type of adversarial attack towards LLMs, have appeared and constantly evolved to breach the…

Human-Computer Interaction · Computer Science 2024-07-04 Zhihua Jin , Shiyi Liu , Haotian Li , Xun Zhao , Huamin Qu

Large Language Models (LLMs) are increasingly integrated into educational applications. However, they remain vulnerable to jailbreak and fine-tuning attacks, which can compromise safety alignment and lead to harmful outputs. Existing…

Computation and Language · Computer Science 2025-11-19 Xin Yi , Yue Li , Dongsheng Shi , Linlin Wang , Xiaoling Wang , Liang He

The emergence of Vision-Language Models (VLMs) represents a significant advancement in integrating computer vision with Large Language Models (LLMs) to generate detailed text descriptions from visual inputs. Despite their growing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Weimin Lyu , Jiachen Yao , Saumya Gupta , Lu Pang , Tao Sun , Lingjie Yi , Lijie Hu , Haibin Ling , Chao Chen

Jailbreak attacks in large language models (LLMs) entail inducing the models to generate content that breaches ethical and legal norm through the use of malicious prompts, posing a substantial threat to LLM security. Current strategies for…

Cryptography and Security · Computer Science 2024-06-07 Lin Lu , Hai Yan , Zenghui Yuan , Jiawen Shi , Wenqi Wei , Pin-Yu Chen , Pan Zhou

Large language models (LLMs) have demonstrated immense utility across various industries. However, as LLMs advance, the risk of harmful outputs increases due to incorrect or malicious instruction prompts. While current methods effectively…

Computation and Language · Computer Science 2025-06-19 Xinyi Zeng , Yuying Shang , Jiawei Chen , Jingyuan Zhang , Yu Tian

Recent advances in biometric systems have significantly improved the detection and prevention of fraudulent activities. However, as detection methods improve, attack techniques become increasingly sophisticated. Attacks on face recognition…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Lazaro Janier Gonzalez-Soler , Maciej Salwowski , Christoph Busch

Jailbreaking poses a significant risk to the deployment of Large Language Models (LLMs) and Vision Language Models (VLMs). VLMs are particularly vulnerable because they process both text and images, creating broader attack surfaces.…

Computation and Language · Computer Science 2026-02-23 Mirae Kim , Seonghun Jeong , Youngjun Kwak

Large Language Models (LLMs) have training corpora containing large amounts of program code, greatly improving the model's code comprehension and generation capabilities. However, sound comprehensive research on detecting program…

Cryptography and Security · Computer Science 2024-08-22 Yu Liu , Lang Gao , Mingxin Yang , Yu Xie , Ping Chen , Xiaojin Zhang , Wei Chen