中文
相关论文

相关论文: Toward Universal and Transferable Jailbreak Attack…

200 篇论文

Existing gradient-based jailbreak attacks on Large Language Models (LLMs) typically optimize adversarial suffixes to align the LLM output with predefined target responses. However, restricting the objective as inducing fixed targets…

密码学与安全 · 计算机科学 2026-03-03 Xinzhe Huang , Wenjing Hu , Tianhang Zheng , Kedong Xiu , Xiaojun Jia , Di Wang , Zhan Qin , Kui Ren

Vision-Language Models (VLMs) are increasingly used in clinical diagnostics, yet their robustness to adversarial attacks remains largely unexplored, posing serious risks. Existing medical attacks focus on secondary objectives such as model…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Akash Ghosh , Subhadip Baidya , Sriparna Saha , Xiuying Chen

Despite inheriting security measures from underlying language models, Vision-Language Models (VLMs) may still be vulnerable to safety alignment issues. Through empirical analysis, we uncover two critical findings: scenario-matched images…

计算机视觉与模式识别 · 计算机科学 2024-12-02 Shuyang Hao , Bryan Hooi , Jun Liu , Kai-Wei Chang , Zi Huang , Yujun Cai

Vision-language models (VLMs) have become central to tasks such as visual question answering, image captioning, and text-to-image generation. However, their outputs are highly sensitive to prompt variations, which can reveal vulnerabilities…

计算机视觉与模式识别 · 计算机科学 2026-02-02 Aarush Noheria , Yuguang Yao

The recent surge in jailbreaking attacks has revealed significant vulnerabilities in Large Language Models (LLMs) when exposed to malicious inputs. While various defense strategies have been proposed to mitigate these threats, there has…

计算与语言 · 计算机科学 2025-02-24 Tianlong Li , Zhenghua Wang , Wenhao Liu , Muling Wu , Shihan Dou , Changze Lv , Xiaohua Wang , Xiaoqing Zheng , Xuanjing Huang

Jailbreaking attacks on the vision modality typically rely on imperceptible adversarial perturbations, whereas attacks on the textual modality are generally assumed to require visible modifications (e.g., non-semantic suffixes). In this…

计算与语言 · 计算机科学 2025-10-07 Kuofeng Gao , Yiming Li , Chao Du , Xin Wang , Xingjun Ma , Shu-Tao Xia , Tianyu Pang

Despite the widespread application of large language models (LLMs) across various tasks, recent studies indicate that they are susceptible to jailbreak attacks, which can render their defense mechanisms ineffective. However, previous…

计算机视觉与模式识别 · 计算机科学 2024-05-31 Jiawei Chen , Xiao Yang , Zhengwei Fang , Yu Tian , Yinpeng Dong , Zhaoxia Yin , Hang Su

Jailbreaking attacks can effectively manipulate open-source large language models (LLMs) to produce harmful responses. However, these attacks exhibit limited transferability, failing to disrupt proprietary LLMs consistently. To reliably…

机器学习 · 计算机科学 2025-05-20 Runqi Lin , Bo Han , Fengwang Li , Tongling Liu

Understanding the vulnerabilities of Large Vision Language Models (LVLMs) to jailbreak attacks is essential for their responsible real-world deployment. Most previous work requires access to model gradients, or is based on human knowledge…

密码学与安全 · 计算机科学 2025-09-03 Ruoxi Cheng , Yizhong Ding , Shuirong Cao , Ranjie Duan , Xiaoshuang Jia , Shaowei Yuan , Simeng Qin , Zhiqiang Wang , Xiaojun Jia

Metaphor serves as an implicit approach to convey information, while enabling the generalized comprehension of complex subjects. However, metaphor can potentially be exploited to bypass the safety alignment mechanisms of Large Language…

计算与语言 · 计算机科学 2025-02-25 Yu Yan , Sheng Sun , Junqi Tong , Min Liu , Qi Li

As large language models (LLMs) are increasingly deployed in critical applications, ensuring their robustness and safety alignment remains a major challenge. Despite the overall success of alignment techniques such as reinforcement learning…

机器学习 · 计算机科学 2025-08-21 Sajib Biswas , Mao Nishino , Samuel Jacob Chacko , Xiuwen Liu

Large Language Models (LLMs) remain vulnerable to multi-turn jailbreak attacks. We introduce HarmNet, a modular framework comprising ThoughtNet, a hierarchical semantic network; a feedback-driven Simulator for iterative query refinement;…

密码学与安全 · 计算机科学 2025-10-22 Sidhant Narula , Javad Rafiei Asl , Mohammad Ghasemigol , Eduardo Blanco , Daniel Takabi

Security alignment enables the Large Language Model (LLM) to gain the protection against malicious queries, but various jailbreak attack methods reveal the vulnerability of this security mechanism. Previous studies have isolated LLM…

密码学与安全 · 计算机科学 2025-08-07 Xiaohu Li , Yunfeng Ning , Zepeng Bao , Mayi Xu , Jianhao Chen , Tieyun Qian

Jailbreaking large language models (LLMs) has emerged as a critical security challenge with the widespread deployment of conversational AI systems. Adversarial users exploit these models through carefully crafted prompts to elicit…

密码学与安全 · 计算机科学 2026-02-23 Sri Durga Sai Sowmya Kadali , Evangelos E. Papalexakis

Jailbreaks on large language models (LLMs) have recently received increasing attention. For a comprehensive assessment of LLM safety, it is essential to consider jailbreaks with diverse attributes, such as contextual coherence and…

机器学习 · 计算机科学 2024-06-10 Xingang Guo , Fangxu Yu , Huan Zhang , Lianhui Qin , Bin Hu

Multimodal large language models (MLLMs) have achieved remarkable progress, yet remain critically vulnerable to adversarial attacks that exploit weaknesses in cross-modal processing. We present a systematic study of multimodal jailbreaks…

密码学与安全 · 计算机科学 2025-10-24 Divyanshu Kumar , Shreyas Jena , Nitin Aravind Birur , Tanay Baswa , Sahil Agarwal , Prashanth Harshangi

Jailbreak attacks on large language models (LLMs) involve inducing these models to generate harmful content that violates ethics or laws, posing a significant threat to LLM security. Current jailbreak attacks face two main challenges: low…

密码学与安全 · 计算机科学 2024-07-12 Yuqi Zhou , Lin Lu , Hanchi Sun , Pan Zhou , Lichao Sun

Automatic adversarial prompt generation provides remarkable success in jailbreaking safely-aligned large language models (LLMs). Existing gradient-based attacks, while demonstrating outstanding performance in jailbreaking white-box LLMs,…

机器学习 · 计算机科学 2025-01-22 Qizhang Li , Xiaochen Yang , Wangmeng Zuo , Yiwen Guo

The rise of API-only access to state-of-the-art LLMs highlights the need for effective black-box jailbreak methods to identify model vulnerabilities in real-world settings. Without a principled objective for gradient-based optimization,…

密码学与安全 · 计算机科学 2025-11-07 Anamika Lochab , Lu Yan , Patrick Pynadath , Xiangyu Zhang , Ruqi Zhang

As the use of large language models (LLMs) continues to expand, ensuring their safety and robustness has become a critical challenge. In particular, jailbreak attacks that bypass built-in safety mechanisms are increasingly recognized as a…

密码学与安全 · 计算机科学 2025-11-19 Hajun Kim , Hyunsik Na , Daeseon Choi