English
Related papers

Related papers: VRSA: Jailbreaking Multimodal Large Language Model…

200 papers

Large Language Models (LLMs) have demonstrated remarkable capabilities in various tasks. However, they remain exposed to jailbreak attacks, eliciting harmful responses. The nested scenario strategy has been increasingly adopted across…

Cryptography and Security · Computer Science 2025-11-18 Ning Xu , Bo Gao , Hui Dou

The recent surge in jailbreaking attacks has revealed significant vulnerabilities in Large Language Models (LLMs) when exposed to malicious inputs. While various defense strategies have been proposed to mitigate these threats, there has…

Computation and Language · Computer Science 2025-02-24 Tianlong Li , Zhenghua Wang , Wenhao Liu , Muling Wu , Shihan Dou , Changze Lv , Xiaohua Wang , Xiaoqing Zheng , Xuanjing Huang

Large language models (LLMs) are widely applied in various fields of society due to their powerful reasoning, understanding, and generation capabilities. However, the security issues associated with these models are becoming increasingly…

Computation and Language · Computer Science 2025-05-30 Yanxu Mao , Peipei Liu , Tiehan Cui , Zhaoteng Yan , Congying Liu , Datao You

With the rapid advancement of multimodal large language models (MLLMs), concerns regarding their security have increasingly captured the attention of both academia and industry. Although MLLMs are vulnerable to jailbreak attacks, designing…

Cryptography and Security · Computer Science 2025-08-19 Ma Teng , Jia Xiaojun , Duan Ranjie , Li Xinfeng , Huang Yihao , Jia Xiaoshuang , Chu Zhixuan , Ren Wenqi

The integration of new modalities into frontier AI systems offers exciting capabilities, but also increases the possibility such systems can be adversarially manipulated in undesirable ways. In this work, we focus on a popular class of…

Despite the implementation of safety alignment strategies, large language models (LLMs) remain vulnerable to jailbreak attacks, which undermine these safety guardrails and pose significant security threats. Some defenses have been proposed…

Cryptography and Security · Computer Science 2025-02-12 Shenyi Zhang , Yuchen Zhai , Keyan Guo , Hongxin Hu , Shengnan Guo , Zheng Fang , Lingchen Zhao , Chao Shen , Cong Wang , Qian Wang

By incorporating visual inputs, Multimodal Large Language Models (MLLMs) extend LLMs to support visual reasoning. However, this integration also introduces new vulnerabilities, making MLLMs susceptible to multimodal jailbreak attacks and…

Cryptography and Security · Computer Science 2025-12-04 Beitao Chen , Xinyu Lyu , Lianli Gao , Jingkuan Song , Heng Tao Shen

Vision-Language-Action (VLA) models with integrated reasoning have been proposed for end-to-end autonomous driving, assuming a tight coupling between reasoning and trajectory generation. However, the robustness of such systems under…

Cryptography and Security · Computer Science 2026-05-29 Mohammadreza Teymoorianfard , Jean-Philippe Monteuuis , Jonathan Petit , Amir Houmansadr

While large language models (LLMs) have demonstrated increasing power, they have also given rise to a wide range of harmful behaviors. As representatives, jailbreak attacks can provoke harmful or unethical responses from LLMs, even after…

Computation and Language · Computer Science 2024-03-01 Nan Xu , Fei Wang , Ben Zhou , Bang Zheng Li , Chaowei Xiao , Muhao Chen

As audio-visual multi-modal large language models (MLLMs) are increasingly deployed in safety-critical applications, understanding their vulnerabilities is crucial. To this end, we introduce Multi-Modal Typography, a systematic study…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Tianle Chen , Deepti Ghadiyaram

The deployment of multimodal large language models (MLLMs) has demonstrated remarkable success in engaging in conversations involving visual inputs, thanks to the superior power of large language models (LLMs). Those MLLMs are typically…

Computation and Language · Computer Science 2024-10-10 Jiahui Gao , Renjie Pi , Tianyang Han , Han Wu , Lanqing Hong , Lingpeng Kong , Xin Jiang , Zhenguo Li

Large language models (LLMs) have significantly enhanced the performance of numerous applications, from intelligent conversations to text generation. However, their inherent security vulnerabilities have become an increasingly significant…

Computation and Language · Computer Science 2024-08-12 Xiongtao Sun , Deyue Zhang , Dongdong Yang , Quanchen Zou , Hui Li

Large Language Models (LLMs) suffer from a range of vulnerabilities that allow malicious users to solicit undesirable responses through manipulation of the input text. These so-called jailbreak prompts are designed to trick the LLM into…

Computation and Language · Computer Science 2025-10-13 John Hawkins , Aditya Pramar , Rodney Beard , Rohitash Chandra

Multimodal large language models (MLLMs) have shown satisfactory effects in many autonomous driving tasks. In this paper, MLLMs are utilized to solve joint semantic scene understanding and risk localization tasks, while only relying on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Jiaqi Fan , Jianhua Wu , Jincheng Gao , Jianhao Yu , Yafei Wang , Hongqing Chu , Bingzhao Gao

In the field of multimodal chain-of-thought (CoT) reasoning, existing approaches predominantly rely on reasoning on pure language space, which inherently suffers from language bias and is largely confined to math or science domains. This…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Jiacong Wang , Zijian Kang , Haochen Wang , Haiyong Jiang , Jiawen Li , Bohong Wu , Ya Wang , Jiao Ran , Xiao Liang , Chao Feng , Jun Xiao

Large Language Models (LLMs) have transformed artificial intelligence by advancing natural language understanding and generation, enabling applications across fields beyond healthcare, software engineering, and conversational systems.…

We discover a novel and surprising phenomenon of unintentional misalignment in reasoning language models (RLMs), which we call self-jailbreaking. Specifically, after benign reasoning training on math or code domains, RLMs will use multiple…

Cryptography and Security · Computer Science 2026-04-30 Zheng-Xin Yong , Stephen H. Bach

The adoption of large language models (LLMs) in many applications, from customer service chat bots and software development assistants to more capable agentic systems necessitates research into how to secure these systems. Attacks like…

Cryptography and Security · Computer Science 2024-12-03 Erick Galinkin , Martin Sablotny

Uncovering the mechanisms behind "jailbreaks" in large language models (LLMs) is crucial for enhancing their safety and reliability, yet these mechanisms remain poorly understood. Existing studies predominantly analyze jailbreak prompts by…

Machine Learning · Computer Science 2026-02-06 Licheng Pan , Yunsheng Lu , Jiexi Liu , Jialing Tao , Haozhe Feng , Hui Xue , Zhixuan Chu , Kui Ren

The rapid evolution of Vision-Language Models (VLMs) has catalyzed unprecedented capabilities in artificial intelligence; however, this continuous modal expansion has inadvertently exposed a vastly broadened and unconstrained adversarial…

Artificial Intelligence · Computer Science 2026-04-15 Jianhao Chen , Haoyang Chen , Hanjie Zhao , Haozhe Liang , Tieyun Qian