English
Related papers

Related papers: VERA-V: Variational Inference Framework for Jailbr…

200 papers

Vision Language Models (VLMs) can produce unintended and harmful content when exposed to adversarial attacks, particularly because their vision capabilities create new vulnerabilities. Existing defenses, such as input preprocessing,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Han Wang , Gang Wang , Huan Zhang

Recent advancements in Large Vision-Language Models (VLMs) have underscored their superiority in various multimodal tasks. However, the adversarial robustness of VLMs has not been fully explored. Existing methods mainly assess robustness…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Ruofan Wang , Xingjun Ma , Hanxu Zhou , Chuanjun Ji , Guangnan Ye , Yu-Gang Jiang

Vision-language Models (VLMs), despite achieving strong performance on multimodal benchmarks, often misinterpret straightforward visual concepts that humans identify effortlessly, such as counting, spatial reasoning, and viewpoint…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Kanishk Jain , Qian Yang , Shravan Nayak , Parisa Kordjamshidi , Nishanth Anand , Aishwarya Agrawal

Vision-language models (VLMs) demonstrate strong multimodal capabilities but have been found to be more susceptible to generating harmful content compared to their backbone large language models (LLMs). Our investigation reveals that the…

Machine Learning · Computer Science 2025-01-29 Qing Li , Jiahui Geng , Zongxiong Chen , Kun Song , Lei Ma , Fakhri Karray

As vision-language models (VLMs) gain prominence, their multimodal interfaces also introduce new safety vulnerabilities, making the safety evaluation challenging and critical. Existing red-teaming efforts are either restricted to a narrow…

Artificial Intelligence · Computer Science 2025-10-06 Zhaorun Chen , Xun Liu , Mintong Kang , Jiawei Zhang , Minzhou Pan , Shuang Yang , Bo Li

Safety-aligned LLMs suffer from two failure modes: jailbreak (answering harmful inputs) and over-refusal (declining benign queries). Existing vector steering methods adjust the magnitude of answer vectors, but this creates a fundamental…

Machine Learning · Computer Science 2026-05-05 Haonan Zhang , Dongxia Wang , Yi Liu , Kexin Chen , Wenhai Wang

The rapid advancement of Vision-Language Models (VLMs) has brought their safety vulnerabilities into sharp focus. However, existing red teaming methods are fundamentally constrained by an inherent linear exploration paradigm, confining them…

Machine Learning · Computer Science 2026-03-25 Chunxiao Li , Lijun Li , Jing Shao

With the significant development of large models in recent years, Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities across a wide range of multimodal understanding and reasoning tasks. Compared to traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Daizong Liu , Mingyu Yang , Xiaoye Qu , Pan Zhou , Yu Cheng , Wei Hu

Despite extensive alignment efforts, Large Vision-Language Models (LVLMs) remain vulnerable to jailbreak attacks, posing serious safety risks. To address this, existing detection methods either learn attack-specific parameters, which…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Shuang Liang , Zhihao Xu , Jialing Tao , Hui Xue , Xiting Wang

With the advent and widespread deployment of Multimodal Large Language Models (MLLMs), ensuring their safety has become increasingly critical. To achieve this objective, it requires us to proactively discover the vulnerability of MLLMs by…

Cryptography and Security · Computer Science 2024-06-13 Siyuan Ma , Weidi Luo , Yu Wang , Xiaogeng Liu

Benefiting from the powerful capabilities of Large Language Models (LLMs), pre-trained visual encoder models connected to LLMs form Vision Language Models (VLMs). However, recent research shows that the visual modality in VLMs is highly…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Zhendong Liu , Yuanbi Nie , Yingshui Tan , Jiaheng Liu , Xiangyu Yue , Qiushi Cui , Chongjun Wang , Xiaoyong Zhu , Bo Zheng

Vision-Language Models (VLMs) have gained considerable prominence in recent years due to their remarkable capability to effectively integrate and process both textual and visual information. This integration has significantly enhanced…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Aobotao Dai , Xinyu Ma , Lei Chen , Songze Li , Lin Wang

In the realm of large vision language models (LVLMs), jailbreak attacks serve as a red-teaming approach to bypass guardrails and uncover safety implications. Existing jailbreaks predominantly focus on the visual modality, perturbing solely…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Zonghao Ying , Aishan Liu , Tianyuan Zhang , Zhengmin Yu , Siyuan Liang , Xianglong Liu , Dacheng Tao

Recently, there has been a surge of interest in integrating vision into Large Language Models (LLMs), exemplified by Visual Language Models (VLMs) such as Flamingo and GPT-4. This paper sheds light on the security and safety implications of…

Cryptography and Security · Computer Science 2023-08-21 Xiangyu Qi , Kaixuan Huang , Ashwinee Panda , Peter Henderson , Mengdi Wang , Prateek Mittal

Current vision-language models (VLMs) still exhibit inferior performance on knowledge-intensive tasks, primarily due to the challenge of accurately encoding all the associations between visual objects and scenes to their corresponding…

Computation and Language · Computer Science 2024-10-16 Jingyuan Qi , Zhiyang Xu , Rulin Shao , Yang Chen , Jin Di , Yu Cheng , Qifan Wang , Lifu Huang

Large Vision-Language Models (LVLMs) have shown remarkable capabilities across a wide range of multimodal tasks. However, their integration of visual inputs introduces expanded attack surfaces, thereby exposing them to novel security…

Computation and Language · Computer Science 2025-05-29 Juan Ren , Mark Dras , Usman Naseem

Vision-Language Models (VLMs) have garnered significant attention for their remarkable ability to interpret and generate multimodal content. However, securing these models against jailbreak attacks continues to be a substantial challenge.…

Cryptography and Security · Computer Science 2025-10-14 Aofan Liu , Lulu Tang

Large Vision-Language Models (LVLMs) have transformed multi-modal understanding, excelling in tasks like image captioning and visual question answering by integrating visual and textual inputs. However, their robustness against adversarial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Xiang Fang , Wanlong Fang , Changshuo Wang

The emergence of Multimodal Large Language Models (MLRMs) has enabled sophisticated visual reasoning capabilities by integrating reinforcement learning and Chain-of-Thought (CoT) supervision. However, while these enhanced reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Bingrui Sima , Linhua Cong , Wenxuan Wang , Kun He

Diffusion Vision-Language Models (dVLMs), built upon the non-causal foundations of Diffusion Large Language Models (dLLMs), have demonstrated remarkable efficacy in multimodal tasks by departing from the traditional autoregressive…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yu Pan , Andi Zhang , Yi Wang , Sibei Yang , Wenjie Wang