English
Related papers

Related papers: RedDiffuser: Auditing Multimodal Safety Failures i…

200 papers

Vision-language models (VLMs) demonstrate strong multimodal capabilities but have been found to be more susceptible to generating harmful content compared to their backbone large language models (LLMs). Our investigation reveals that the…

Machine Learning · Computer Science 2025-01-29 Qing Li , Jiahui Geng , Zongxiong Chen , Kun Song , Lei Ma , Fakhri Karray

While safety mechanisms have significantly progressed in filtering harmful text inputs, MLLMs remain vulnerable to multimodal jailbreaks that exploit their cross-modal reasoning capabilities. We present MIRAGE, a novel multimodal jailbreak…

Computation and Language · Computer Science 2025-03-26 Wenhao You , Bryan Hooi , Yiwei Wang , Youke Wang , Zong Ke , Ming-Hsuan Yang , Zi Huang , Yujun Cai

In this paper, we argue that current safety alignment research efforts for large language models are hindered by many intertwined sources of noise, such as small datasets, methodological inconsistencies, and unreliable evaluation setups.…

Cryptography and Security · Computer Science 2026-05-19 Tim Beyer , Sophie Xhonneux , Simon Geisler , Gauthier Gidel , Leo Schwinn , Stephan Günnemann

The Large Visual-Language Models (LVLMs) have significantly advanced image understanding. Their comprehension and reasoning capabilities enable promising applications in autonomous driving scenarios. However, existing research typically…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Zongchuang Zhao , Haoyu Fu , Dingkang Liang , Xin Zhou , Dingyuan Zhang , Hongwei Xie , Bing Wang , Xiang Bai

Though Large Vision-Language Models (LVLMs) are being actively explored in medicine, their ability to conduct complex real-world telemedicine consultations combining accurate diagnosis with professional dialogue remains underexplored. This…

Human-Computer Interaction · Computer Science 2025-11-12 Ivan Sviridov , Amina Miftakhova , Artemiy Tereshchenko , Galina Zubkova , Pavel Blinov , Andrey Savchenko

Despite the impressive advancements of Large Vision-Language Models (LVLMs), existing approaches suffer from a fundamental bottleneck: inefficient visual-language integration. Current methods either disrupt the model's inherent structure or…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Tongtian Yue , Longteng Guo , Yepeng Tang , Zijia Zhao , Xinxin Zhu , Hua Huang , Jing Liu

Vision Large Language Models (VLLMs) are increasingly deployed to offer advanced capabilities on inputs comprising both text and images. While prior research has shown that adversarial attacks can transfer from open-source to proprietary…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Kai Hu , Weichen Yu , Li Zhang , Alexander Robey , Andy Zou , Chengming Xu , Haoqi Hu , Matt Fredrikson

As large Vision-Language Models (VLMs) gain prominence, ensuring their safe deployment has become critical. Recent studies have explored VLM robustness against jailbreak attacks-techniques that exploit model vulnerabilities to elicit…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Ruofan Wang , Juncheng Li , Yixu Wang , Bo Wang , Xiaosen Wang , Yan Teng , Yingchun Wang , Xingjun Ma , Yu-Gang Jiang

Medical vision--language models (VLMs) are usually evaluated on intact image--question pairs, but trustworthy clinical use requires a stronger property: a model must recognise when the evidential basis for an answer has failed. We study…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Hanqi Jiang , Junhao Chen , Mingyu Kang , Hyeokjae Kwon , Yi Pan , Lifeng Chen , Weihang You , Haozhen Gong , Ruiyu Yan , Jinglei Lv , Lin Zhao , Hui Ren , Quanzheng Li , Tianming Liu , Xiang Li

The security concerns surrounding Large Language Models (LLMs) have been extensively explored, yet the safety of Multimodal Large Language Models (MLLMs) remains understudied. In this paper, we observe that Multimodal Large Language Models…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Xin Liu , Yichen Zhu , Jindong Gu , Yunshi Lan , Chao Yang , Yu Qiao

The increasing proliferation of misinformation and its alarming impact have motivated both industry and academia to develop approaches for misinformation detection and fact checking. Recent advances on large language models (LLMs) have…

Computation and Language · Computer Science 2024-07-22 Sahar Tahmasebi , Eric Müller-Budack , Ralph Ewerth

Autoregressive (AR) generation is the standard decoding paradigm for Large Language Models (LLMs), but its token-by-token nature limits parallelism at inference time. Diffusion Language Models (DLLMs) offer parallel decoding by recovering…

Computation and Language · Computer Science 2025-12-30 Aiwei Liu , Minghua He , Shaoxun Zeng , Sijun Zhang , Linhao Zhang , Chuhan Wu , Wei Jia , Yuan Liu , Xiao Zhou , Jie Zhou

Generating safety-critical driving scenarios is crucial for evaluating and improving autonomous driving systems, but long-tail risky situations are rarely observed in real-world data and difficult to specify through manual scenario design.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Hongyi Lin , Wenxiu Shi , Heye Huang , Dingyi Zhuang , Song Zhang , Yang Liu , Xiaobo Qu , Jinhua Zhao

Recent advances in large vision-language models (LVLMs) have amplified concerns about fairness, yet existing evaluations remain confined to demographic attributes and often conflate fairness with refusal behavior. This paper broadens the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Zaiying Zhao , Toshihiko Yamasaki

Recent advances in large vision-language models (VLMs) have demonstrated remarkable success across a wide range of visual understanding tasks. However, the robustness of these models against jailbreak attacks remains an open challenge. In…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xiangyu Yin , Jiaxu Liu , Zhen Chen , Jinwei Hu , Yi Dong , Xiaowei Huang , Wenjie Ruan

Retrieval Augmented Language Models (RALMs) have gained significant attention for their ability to generate accurate answer and improve efficiency. However, RALMs are inherently vulnerable to imperfect information due to their reliance on…

Computation and Language · Computer Science 2024-10-22 Seong-Il Park , Jay-Yoon Lee

Large diffusion vision-language models (LDVLMs) have recently emerged as a promising alternative to autoregressive models, enabling parallel decoding for efficient inference and leveraging bidirectional attention for global context. Despite…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Sujung Hong , Chanyong Yoon , Seong Jae Hwang

Large Audio-Language Models (LALMs) are increasingly deployed in real-world applications, yet their robustness against malicious audio injection attacks remains underexplored. This study systematically evaluates five leading LALMs across…

Computation and Language · Computer Science 2025-07-11 Guanyu Hou , Jiaming He , Yinhang Zhou , Ji Guo , Yitong Qiao , Rui Zhang , Wenbo Jiang

Multimodal Large Reasoning Models (MLRMs) demonstrate impressive cross-modal reasoning but often amplify safety risks under adversarial or unsafe prompts, a phenomenon we call the \textit{Reasoning Tax}. Existing defenses mainly act at the…

Machine Learning · Computer Science 2025-10-10 Huahui Yi , Kun Wang , Qiankun Li , Miao Yu , Liang Lin , Gongli Xi , Hao Wu , Xuming Hu , Kang Li , Yang Liu

Visual token compression is widely adopted to improve the inference efficiency of Large Vision-Language Models (LVLMs), enabling their deployment in latency-sensitive and resource-constrained scenarios. However, existing work has mainly…

Cryptography and Security · Computer Science 2026-01-21 Xiaomei Zhang , Zhaoxi Zhang , Leo Yu Zhang , Yanjun Zhang , Guanhong Tao , Shirui Pan
‹ Prev 1 8 9 10 Next ›