English
Related papers

Related papers: Distraction is All You Need for Multimodal Large L…

200 papers

Despite the remarkable versatility of Large Language Models (LLMs) and Multimodal LLMs (MLLMs) to generalize across both language and vision tasks, LLMs and MLLMs have shown vulnerability to jailbreaking, generating textual outputs that…

Cryptography and Security · Computer Science 2025-03-28 Joonhyun Jeong , Seyun Bae , Yeonsung Jung , Jaeryong Hwang , Eunho Yang

The integration of additional modalities increases the susceptibility of large vision-language models (LVLMs) to safety risks, such as jailbreak attacks, compared to their language-only counterparts. While existing research primarily…

Computation and Language · Computer Science 2025-06-24 Yilei Jiang , Xinyan Gao , Tianshuo Peng , Yingshui Tan , Xiaoyong Zhu , Bo Zheng , Xiangyu Yue

Large Language Models (LLMs) are increasingly vulnerable to a sophisticated form of adversarial prompting known as camouflaged jailbreaking. This method embeds malicious intent within seemingly benign language to evade existing safety…

Cryptography and Security · Computer Science 2025-09-09 Youjia Zheng , Mohammad Zandsalimy , Shanu Sushmita

Distracted driving remains a significant global challenge with severe human and economic repercussions, demanding improved detection and intervention strategies. While previous studies have extensively explored single-modality approaches,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Anthony. Dontoh , Stephanie. Ivey , Logan. Sirbaugh , Armstrong. Aboah

The safety alignment of Large Language Models (LLMs) is vulnerable to both manual and automated jailbreak attacks, which adversarially trigger LLMs to output harmful content. However, current methods for jailbreaking LLMs, which nest entire…

Cryptography and Security · Computer Science 2024-11-13 Xirui Li , Ruochen Wang , Minhao Cheng , Tianyi Zhou , Cho-Jui Hsieh

Multimodal large language models (MLLMs) have achieved remarkable progress, yet remain critically vulnerable to adversarial attacks that exploit weaknesses in cross-modal processing. We present a systematic study of multimodal jailbreaks…

Cryptography and Security · Computer Science 2025-10-24 Divyanshu Kumar , Shreyas Jena , Nitin Aravind Birur , Tanay Baswa , Sahil Agarwal , Prashanth Harshangi

Jailbreak attacks are crucial for identifying and mitigating the security vulnerabilities of Large Language Models (LLMs). They are designed to bypass safeguards and elicit prohibited outputs. However, due to significant differences among…

Large Vision-Language Models (LVLMs) rely on attention-based retrieval of safety instructions to maintain alignment during generation. Existing attacks typically optimize image perturbations to maximize harmful output likelihood, but suffer…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jingru Li , Wei Ren , Tianqing Zhu

Large Language Models (LLMs) face prominent security risks from jailbreaking, a practice that manipulates models to bypass built-in security constraints and generate unethical or unsafe content. Among various jailbreak techniques,…

Cryptography and Security · Computer Science 2026-04-14 Yihao Zhang , Kai Wang , Jiangrong Wu , Haolin Wu , Yuxuan Zhou , Zeming Wei , Dongxian Wu , Xun Chen , Jun Sun , Meng Sun

Large Language Models (LLMs) remain vulnerable to jailbreak attacks that bypass their safety mechanisms. Existing attack methods are fixed or specifically tailored for certain models and cannot flexibly adjust attack strength, which is…

Cryptography and Security · Computer Science 2024-10-08 Yiting Dong , Guobin Shen , Dongcheng Zhao , Xiang He , Yi Zeng

In recent years, the security vulnerabilities of Multi-modal Large Language Models (MLLMs) have become a serious concern in the Generative Artificial Intelligence (GenAI) research. These highly intelligent models, capable of performing…

Cryptography and Security · Computer Science 2026-01-12 Badhan Chandra Das , Md Tasnim Jawad , Joaquin Molto , M. Hadi Amini , Yanzhao Wu

Multimodal Large Language Models (MLLMs), which integrate vision and other modalities into Large Language Models (LLMs), significantly enhance AI capabilities but also introduce new security vulnerabilities. By exploiting the…

Cryptography and Security · Computer Science 2025-10-10 Aofan Liu , Lulu Tang , Ting Pan , Yuguo Yin , Bin Wang , Ao Yang

As large language models (LLMs) are increasingly deployed, ensuring their safe use is paramount. Jailbreaking, adversarial prompts that bypass model alignment to trigger harmful outputs, present significant risks, with existing studies…

Cryptography and Security · Computer Science 2026-01-01 Yuan Xin , Dingfan Chen , Linyi Yang , Michael Backes , Xiao Zhang

Despite extensive alignment efforts, Large Vision-Language Models (LVLMs) remain vulnerable to jailbreak attacks, posing serious safety risks. To address this, existing detection methods either learn attack-specific parameters, which…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Shuang Liang , Zhihao Xu , Jialing Tao , Hui Xue , Xiting Wang

Despite inheriting security measures from underlying language models, Vision-Language Models (VLMs) may still be vulnerable to safety alignment issues. Through empirical analysis, we uncover two critical findings: scenario-matched images…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Shuyang Hao , Bryan Hooi , Jun Liu , Kai-Wei Chang , Zi Huang , Yujun Cai

In the past few years, Language Models (LMs) have shown par-human capabilities in several domains. Despite their practical applications and exceeding user consumption, they are susceptible to jailbreaks when malicious input exploits the…

Computation and Language · Computer Science 2025-04-18 Charlotte Siska , Anush Sankaran

Large language models (LLMs) have achieved impressive performance across natural language tasks and are increasingly deployed in real-world applications. Despite extensive safety alignment efforts, recent studies show that such alignment is…

Artificial Intelligence · Computer Science 2026-02-02 Yinzhi Zhao , Ming Wang , Shi Feng , Xiaocui Yang , Daling Wang , Yifei Zhang

Large Language Models (LLMs) have demonstrated remarkable performance across diverse tasks. Nevertheless, they still pose notable safety risks due to potential misuse for malicious purposes. Jailbreaking, which seeks to induce models to…

Computation and Language · Computer Science 2025-09-30 Hua Tang , Lingyong Yan , Yukun Zhao , Shuaiqiang Wang , Jizhou Huang , Dawei Yin

With the development of Large Language Models (LLMs), numerous efforts have revealed their vulnerabilities to jailbreak attacks. Although these studies have driven the progress in LLMs' safety alignment, it remains unclear whether LLMs have…

Cryptography and Security · Computer Science 2025-09-16 Yu Yan , Sheng Sun , Zhe Wang , Yijun Lin , Zenghao Duan , zhifei zheng , Min Liu , Zhiyi yin , Jianping Zhang

With the rapid advancement of large language models (LLMs), the safety of LLMs has become a critical concern. Despite significant efforts in safety alignment, current LLMs remain vulnerable to jailbreaking attacks. However, the root causes…

Artificial Intelligence · Computer Science 2026-03-10 Yonghong Deng , Zhen Yang , Ping Jian , Xinyue Zhang , Zhongbin Guo , Chengzhi Li