中文
相关论文

相关论文: Mosaic: Multimodal Jailbreak against Closed-Source…

200 篇论文

The rapid evolution of Vision-Language Models (VLMs) has catalyzed unprecedented capabilities in artificial intelligence; however, this continuous modal expansion has inadvertently exposed a vastly broadened and unconstrained adversarial…

人工智能 · 计算机科学 2026-04-15 Jianhao Chen , Haoyang Chen , Hanjie Zhao , Haozhe Liang , Tieyun Qian

Large Vision-Language Models (LVLMs) can be vulnerable to adversarial images that subtly bias their outputs toward plausible yet incorrect responses. We introduce a general, efficient, and training-free defense that combines image…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Nadav Kadvil , Malak Fares , Ayellet Tal

Large Vision Language Models (LVLMs) have demonstrated remarkable capabilities, yet their proficiency in understanding and reasoning over multiple images remains largely unexplored. While existing benchmarks have initiated the evaluation of…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Anurag Das , Adrian Bulat , Alberto Baldrati , Ioannis Maniadis Metaxas , Bernt Schiele , Georgios Tzimiropoulos , Brais Martinez

Despite extensive alignment efforts, Large Vision-Language Models (LVLMs) remain vulnerable to jailbreak attacks, posing serious safety risks. To address this, existing detection methods either learn attack-specific parameters, which…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Shuang Liang , Zhihao Xu , Jialing Tao , Hui Xue , Xiting Wang

We investigated visual reasoning limitations of both multimodal large language models (MLLMs) and image generation models (IGMs) by creating a novel benchmark to systematically compare failure modes across image-to-text and text-to-image…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Aahana Basappa , Pranay Goel , Anusri Karra , Anish Karra , Asa Gilmore , Kevin Zhu

Multimodal Large Language Models (MLLMs) achieve strong reasoning and perception capabilities but are increasingly vulnerable to jailbreak attacks. While existing work focuses on explicit attacks, where malicious content resides in a single…

密码学与安全 · 计算机科学 2026-04-28 Xu Zhang , Hao Li , Zhichao Lu

Despite the remarkable progress achieved by recent efficient methods in accelerating multimodal understanding, they still suffer from noticeable performance degradation. Their emphasis on the high compression ratio of a single visual clue…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Yinghao Wu , Zhuoyan Luo , Yiyao Yu , Zhaojian Yu , Yujiu Yang , Xiao-Ping Zhang

Vision-language models (VLMs) are essential to Embodied AI, enabling robots to perceive, reason, and act in complex environments. They also serve as the foundation for the recent Vision-Language-Action (VLA) models. Yet most evaluations of…

Multi-Agent Systems (MAS) powered by Large Language Models have unlocked advanced collaborative reasoning, yet they remain bottlenecked by discrete text communication, which imposes runtime overhead and information quantization loss. While…

计算与语言 · 计算机科学 2026-05-29 Xiaoze Liu , Ruowang Zhang , Weichen Yu , Siheng Xiong , Liu He , Feijie Wu , Hoin Jung , Matt Fredrikson , Xiaoqian Wang , Jing Gao

Vision-Language Models (VLMs) are increasingly deployed in autonomous driving and embodied AI systems, where reliable perception is critical for safe semantic reasoning and decision-making. While recent VLMs demonstrate strong performance…

计算机视觉与模式识别 · 计算机科学 2026-01-16 Guo Cheng

Vision-language models (VLMs) can couple visual perception with open-ended clinical reasoning, making them attractive for computational histopathology. However, fine-tuning billions of parameters on scarce, expert-annotated pathology data…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Franciskus Xaverius Erick , Johanna Paula Müller , Bernhard Kainz

Multimodal Large Language Models (MLLMs) represent the cutting edge of AI technology, with DeepSeek models emerging as a leading open-source alternative offering competitive performance to closed-source systems. While these models…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Chashi Mahiul Islam , Samuel Jacob Chacko , Preston Horne , Xiuwen Liu

Multi-modal large language models (MLLMs) have made significant progress, yet their safety alignment remains limited. Typically, current open-source MLLMs rely on the alignment inherited from their language module to avoid harmful…

密码学与安全 · 计算机科学 2025-04-15 Yanbo Wang , Jiyang Guan , Jian Liang , Ran He

The vulnerability of Vision Large Language Models (VLLMs) to jailbreak attacks appears as no surprise. However, recent defense mechanisms against these attacks have reached near-saturation performance on benchmark evaluations, often with…

密码学与安全 · 计算机科学 2025-03-07 Yangyang Guo , Fangkai Jiao , Liqiang Nie , Mohan Kankanhalli

Multi-modal Large Language Models (MLLMs) have recently achieved enhanced performance across various vision-language tasks including visual grounding capabilities. However, the adversarial robustness of visual grounding remains unexplored…

计算机视觉与模式识别 · 计算机科学 2024-05-17 Kuofeng Gao , Yang Bai , Jiawang Bai , Yong Yang , Shu-Tao Xia

Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in multimodal understanding and generation, yet their vulnerability to adversarial attacks raises significant robustness concerns. While existing effective…

计算机视觉与模式识别 · 计算机科学 2026-02-05 Hefei Mei , Zirui Wang , Shen You , Minjing Dong , Chang Xu

Multimodal Large Language Models (MLLMs) show impressive vision-language benchmark performance, yet growing concerns about data contamination (test set exposure during training) risk masking true generalization. This concern extends to…

人工智能 · 计算机科学 2025-06-10 Ming Liu , Wensheng Zhang

Multimodal large language models (MLLMs) have advanced the integration of visual and linguistic modalities, establishing themselves as the dominant paradigm for visual-language tasks. Current approaches like chain of thought (CoT) reasoning…

计算机视觉与模式识别 · 计算机科学 2024-11-20 Haojie Zheng , Tianyang Xu , Hanchi Sun , Shu Pu , Ruoxi Chen , Lichao Sun

Mobile robots have become indispensable for exploring hostile environments, such as in space or disaster relief scenarios, but often remain limited to teleoperation by a human operator. This restricts the deployment scale and requires…

Large Language Models (LLMs) and Vision Language Models (VLMs) have demonstrated impressive capabilities but remain vulnerable to jailbreaking attacks, where adversaries exploit textual or visual triggers to bypass safety guardrails. Recent…

密码学与安全 · 计算机科学 2026-05-15 Yi Wang , Hongye Qiu , Yue Xu , Sibei Yang , Zhan Qin , Minlie Huang , Wenjie Wang