English
Related papers

Related papers: Mosaic: Multimodal Jailbreak against Closed-Source…

200 papers

The rapid evolution of Vision-Language Models (VLMs) has catalyzed unprecedented capabilities in artificial intelligence; however, this continuous modal expansion has inadvertently exposed a vastly broadened and unconstrained adversarial…

Artificial Intelligence · Computer Science 2026-04-15 Jianhao Chen , Haoyang Chen , Hanjie Zhao , Haozhe Liang , Tieyun Qian

Large Vision-Language Models (LVLMs) can be vulnerable to adversarial images that subtly bias their outputs toward plausible yet incorrect responses. We introduce a general, efficient, and training-free defense that combines image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Nadav Kadvil , Malak Fares , Ayellet Tal

Large Vision Language Models (LVLMs) have demonstrated remarkable capabilities, yet their proficiency in understanding and reasoning over multiple images remains largely unexplored. While existing benchmarks have initiated the evaluation of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Anurag Das , Adrian Bulat , Alberto Baldrati , Ioannis Maniadis Metaxas , Bernt Schiele , Georgios Tzimiropoulos , Brais Martinez

Despite extensive alignment efforts, Large Vision-Language Models (LVLMs) remain vulnerable to jailbreak attacks, posing serious safety risks. To address this, existing detection methods either learn attack-specific parameters, which…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Shuang Liang , Zhihao Xu , Jialing Tao , Hui Xue , Xiting Wang

We investigated visual reasoning limitations of both multimodal large language models (MLLMs) and image generation models (IGMs) by creating a novel benchmark to systematically compare failure modes across image-to-text and text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Aahana Basappa , Pranay Goel , Anusri Karra , Anish Karra , Asa Gilmore , Kevin Zhu

Multimodal Large Language Models (MLLMs) achieve strong reasoning and perception capabilities but are increasingly vulnerable to jailbreak attacks. While existing work focuses on explicit attacks, where malicious content resides in a single…

Cryptography and Security · Computer Science 2026-04-28 Xu Zhang , Hao Li , Zhichao Lu

Despite the remarkable progress achieved by recent efficient methods in accelerating multimodal understanding, they still suffer from noticeable performance degradation. Their emphasis on the high compression ratio of a single visual clue…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yinghao Wu , Zhuoyan Luo , Yiyao Yu , Zhaojian Yu , Yujiu Yang , Xiao-Ping Zhang

Vision-language models (VLMs) are essential to Embodied AI, enabling robots to perceive, reason, and act in complex environments. They also serve as the foundation for the recent Vision-Language-Action (VLA) models. Yet most evaluations of…

Multi-Agent Systems (MAS) powered by Large Language Models have unlocked advanced collaborative reasoning, yet they remain bottlenecked by discrete text communication, which imposes runtime overhead and information quantization loss. While…

Computation and Language · Computer Science 2026-05-29 Xiaoze Liu , Ruowang Zhang , Weichen Yu , Siheng Xiong , Liu He , Feijie Wu , Hoin Jung , Matt Fredrikson , Xiaoqian Wang , Jing Gao

Vision-Language Models (VLMs) are increasingly deployed in autonomous driving and embodied AI systems, where reliable perception is critical for safe semantic reasoning and decision-making. While recent VLMs demonstrate strong performance…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Guo Cheng

Vision-language models (VLMs) can couple visual perception with open-ended clinical reasoning, making them attractive for computational histopathology. However, fine-tuning billions of parameters on scarce, expert-annotated pathology data…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Franciskus Xaverius Erick , Johanna Paula Müller , Bernhard Kainz

Multimodal Large Language Models (MLLMs) represent the cutting edge of AI technology, with DeepSeek models emerging as a leading open-source alternative offering competitive performance to closed-source systems. While these models…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Chashi Mahiul Islam , Samuel Jacob Chacko , Preston Horne , Xiuwen Liu

Multi-modal large language models (MLLMs) have made significant progress, yet their safety alignment remains limited. Typically, current open-source MLLMs rely on the alignment inherited from their language module to avoid harmful…

Cryptography and Security · Computer Science 2025-04-15 Yanbo Wang , Jiyang Guan , Jian Liang , Ran He

The vulnerability of Vision Large Language Models (VLLMs) to jailbreak attacks appears as no surprise. However, recent defense mechanisms against these attacks have reached near-saturation performance on benchmark evaluations, often with…

Cryptography and Security · Computer Science 2025-03-07 Yangyang Guo , Fangkai Jiao , Liqiang Nie , Mohan Kankanhalli

Multi-modal Large Language Models (MLLMs) have recently achieved enhanced performance across various vision-language tasks including visual grounding capabilities. However, the adversarial robustness of visual grounding remains unexplored…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Kuofeng Gao , Yang Bai , Jiawang Bai , Yong Yang , Shu-Tao Xia

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in multimodal understanding and generation, yet their vulnerability to adversarial attacks raises significant robustness concerns. While existing effective…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Hefei Mei , Zirui Wang , Shen You , Minjing Dong , Chang Xu

Multimodal Large Language Models (MLLMs) show impressive vision-language benchmark performance, yet growing concerns about data contamination (test set exposure during training) risk masking true generalization. This concern extends to…

Artificial Intelligence · Computer Science 2025-06-10 Ming Liu , Wensheng Zhang

Multimodal large language models (MLLMs) have advanced the integration of visual and linguistic modalities, establishing themselves as the dominant paradigm for visual-language tasks. Current approaches like chain of thought (CoT) reasoning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Haojie Zheng , Tianyang Xu , Hanchi Sun , Shu Pu , Ruoxi Chen , Lichao Sun

Mobile robots have become indispensable for exploring hostile environments, such as in space or disaster relief scenarios, but often remain limited to teleoperation by a human operator. This restricts the deployment scale and requires…

Large Language Models (LLMs) and Vision Language Models (VLMs) have demonstrated impressive capabilities but remain vulnerable to jailbreaking attacks, where adversaries exploit textual or visual triggers to bypass safety guardrails. Recent…

Cryptography and Security · Computer Science 2026-05-15 Yi Wang , Hongye Qiu , Yue Xu , Sibei Yang , Zhan Qin , Minlie Huang , Wenjie Wang