English
Related papers

Related papers: Simulated Ensemble Attack: Transferring Jailbreaks…

200 papers

While Large Language Models (LLMs) have achieved remarkable progress, they remain vulnerable to jailbreak attacks. Existing methods, primarily relying on discrete input optimization (e.g., GCG), often suffer from high computational costs…

Computation and Language · Computer Science 2026-01-09 Wenpeng Xing , Mohan Li , Chunqiang Hu , Haitao Xu , Ningyu Zhang , Bo Lin , Meng Han

As large language models~(LLMs) become widely adopted, ensuring their alignment with human values is crucial to prevent jailbreaks where adversaries manipulate models to produce harmful content. While most defenses target single-turn…

Computation and Language · Computer Science 2025-09-19 Siyu Yan , Long Zeng , Xuecheng Wu , Chengcheng Han , Kongcheng Zhang , Chong Peng , Xuezhi Cao , Xunliang Cai , Chenjuan Guo

Large Language Models (LLMs) are widely deployed in real-world systems. Given their broader applicability, prompt engineering has become an efficient tool for resource-scarce organizations to adopt LLMs for their own purposes. At the same…

Cryptography and Security · Computer Science 2026-02-27 Piyush Jaiswal , Aaditya Pratap , Shreyansh Saraswati , Harsh Kasyap , Somanath Tripathy

Jailbreak attacks, where harmful prompts bypass generative models' built-in safety, raise serious concerns about model vulnerability. While many defense methods have been proposed, the trade-offs between safety and helpfulness, and their…

Cryptography and Security · Computer Science 2025-02-21 Zhuohang Long , Siyuan Wang , Shujun Liu , Yuhang Lai , Xuanjing Huang , Zhongyu Wei

The increasing sophistication of large vision-language models (LVLMs) has been accompanied by advances in safety alignment mechanisms designed to prevent harmful content generation. However, these defenses remain vulnerable to sophisticated…

Cryptography and Security · Computer Science 2026-04-09 Quanchen Zou , Zonghao Ying , Moyang Chen , Wenzhuo Xu , Yisong Xiao , Yakai Li , Deyue Zhang , Dongdong Yang , Zhao Liu , Xiangzheng Zhang

Vision-Language Models (VLMs) are powerful but remain vulnerable to multimodal jailbreak attacks. Existing attacks mainly rely on either explicit visual prompt attacks or gradient-based adversarial optimization. While the former is easier…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Yuqin Lan , Gen Li , Yuanze Hu , Weihao Shen , Zhaoxin Fan , Faguo Wu , Xiao Zhang , Laurence T. Yang , Zhiming Zheng

Despite extensive alignment efforts, Large Vision-Language Models (LVLMs) remain vulnerable to jailbreak attacks, posing serious safety risks. To address this, existing detection methods either learn attack-specific parameters, which…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Shuang Liang , Zhihao Xu , Jialing Tao , Hui Xue , Xiting Wang

Large Vision-Language Models (LVLMs) demonstrate exceptional performance across multimodal tasks, yet remain vulnerable to jailbreak attacks that bypass built-in safety mechanisms to elicit restricted content generation. Existing black-box…

Computation and Language · Computer Science 2025-06-23 Lei Jiang , Zixun Zhang , Zizhou Wang , Xiaobing Sun , Zhen Li , Liangli Zhen , Xiaohua Xu

Large language models have drawn significant attention to the challenge of safe alignment, especially regarding jailbreak attacks that circumvent security measures to produce harmful content. To address the limitations of existing methods…

Artificial Intelligence · Computer Science 2024-11-05 Hanqing Liu , Lifeng Zhou , Huanqian Yan

In deployment and application, large language models (LLMs) typically undergo safety alignment to prevent illegal and unethical outputs. However, the continuous advancement of jailbreak attack techniques, designed to bypass safety…

Cryptography and Security · Computer Science 2025-09-05 Chuhan Zhang , Ye Zhang , Bowen Shi , Yuyou Gan , Tianyu Du , Shouling Ji , Dazhan Deng , Yingcai Wu

Large Language Models (LLMs) aligned with human feedback have recently garnered significant attention. However, it remains vulnerable to jailbreak attacks, where adversaries manipulate prompts to induce harmful outputs. Exploring jailbreak…

Cryptography and Security · Computer Science 2024-12-23 Hongyi Li , Jiawei Ye , Jie Wu , Tianjie Yan , Chu Wang , Zhixin Li

On-device Vision-Language Models (VLMs) promise data privacy via local execution. However, we show that the architectural shift toward Dynamic High-Resolution preprocessing (e.g., AnyRes) introduces an inherent algorithmic side-channel.…

Cryptography and Security · Computer Science 2026-03-30 Eyal Hadad , Mordechai Guri

Large Language Models (LLMs) with safe-alignment training are powerful instruments with robust language comprehension capabilities. These models typically undergo meticulous alignment procedures involving human feedback to ensure the…

Machine Learning · Computer Science 2025-09-22 Maithili Joshi , Palash Nandi , Tanmoy Chakraborty

Multimodal large language models (MLLMs) have recently gained attention for their generalization and reasoning capabilities in Vision-and-Language Navigation (VLN) tasks, leading to the rise of MLLM-driven navigators. However, MLLMs are…

Robotics · Computer Science 2025-05-20 Wenqi Lyu , Zerui Li , Yanyuan Qiao , Qi Wu

The rapid progress in open-source large language models (LLMs) is significantly advancing AI development. Extensive efforts have been made before model release to align their behavior with human values, with the primary goal of ensuring…

Computation and Language · Computer Science 2023-10-12 Yangsibo Huang , Samyak Gupta , Mengzhou Xia , Kai Li , Danqi Chen

The visual modality of vision-language models (VLMs) is an underexplored attack surface for bypassing safety alignment. We introduce four jailbreak attacks exploiting the vision component: (1) encoding harmful instructions as visual symbol…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Aharon Azulay , Jan Dubiński , Zhuoyun Li , Atharv Mittal , Yossi Gandelsman

Vision-Language Models (VLMs) have gained considerable prominence in recent years due to their remarkable capability to effectively integrate and process both textual and visual information. This integration has significantly enhanced…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Aobotao Dai , Xinyu Ma , Lei Chen , Songze Li , Lin Wang

Recent advancements in Large Language Models (LLMs) have sparked widespread concerns about their safety. Recent work demonstrates that safety alignment of LLMs can be easily removed by fine-tuning with a few adversarially chosen…

Computation and Language · Computer Science 2025-03-03 Samuele Poppi , Zheng-Xin Yong , Yifei He , Bobbie Chern , Han Zhao , Aobo Yang , Jianfeng Chi

As the capabilities of Vision Language Models (VLMs) continue to improve, they are increasingly targeted by jailbreak attacks. Existing defense methods face two major limitations: (1) they struggle to ensure safety without compromising the…

Cryptography and Security · Computer Science 2025-09-29 Xiyu Zeng , Siyuan Liang , Liming Lu , Haotian Zhu , Enguang Liu , Jisheng Dang , Yongbin Zhou , Shuchao Pang

Large Language Models face security threats from jailbreak attacks. Existing research has predominantly focused on prompt-level attacks while largely ignoring the underexplored attack surface of user-controlled response prefilling. This…

Cryptography and Security · Computer Science 2025-08-27 Yakai Li , Jiekang Hu , Weiduan Sang , Luping Ma , Dongsheng Nie , Weijuan Zhang , Aimin Yu , Yi Su , Qingjia Huang , Qihang Zhou