中文
相关论文

相关论文: Backdooring Vision-Language Models with Out-Of-Dis…

200 篇论文

Diffusion language models (DLMs) have recently emerged as an alternative modeling paradigm to autoregressive (AR) language models, enabling parallel generation and bidirectional context modeling. Yet their security implications,…

密码学与安全 · 计算机科学 2026-05-12 Shengfang Zhai , Xiaoyang Ji , Yuling Shi , Haoran Gao , Fanyu Meng , Yan Zeng , Yuejian Fang , Yinpeng Dong , Jiaheng Zhang

The deployment of autonomous vehicles controlled by machine learning techniques requires extensive testing in diverse real-world environments, robust handling of edge cases and out-of-distribution scenarios, and comprehensive safety…

机器学习 · 计算机科学 2024-11-26 Erfan Aasi , Phat Nguyen , Shiva Sreeram , Guy Rosman , Sertac Karaman , Daniela Rus

Large Language Models (LLMs), which bridge the gap between human language understanding and complex problem-solving, achieve state-of-the-art performance on several NLP tasks, particularly in few-shot and zero-shot settings. Despite the…

密码学与安全 · 计算机科学 2025-01-07 Shuai Zhao , Meihuizi Jia , Zhongliang Guo , Leilei Gan , Xiaoyu Xu , Xiaobao Wu , Jie Fu , Yichao Feng , Fengjun Pan , Luu Anh Tuan

Vision-language models (VLMs) have significantly advanced autonomous driving (AD) by enhancing reasoning capabilities. However, these models remain highly vulnerable to adversarial attacks. While existing research has primarily focused on…

计算机视觉与模式识别 · 计算机科学 2026-04-22 Tianyuan Zhang , Lu Wang , Xinwei Zhang , Yitong Zhang , Boyi Jia , Siyuan Liang , Shengshan Hu , Qiang Fu , Aishan Liu , Xianglong Liu

Vision-Language Models (VLMs) extend the capabilities of Large Language Models (LLMs) by incorporating visual information, yet they remain vulnerable to jailbreak attacks, especially when processing noisy or corrupted images. Although…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Jiawei Wang , Yushen Zuo , Yuanjun Chai , Zhendong Liu , Yicheng Fu , Yichun Feng , Kin-Man Lam

Detecting out-of-distribution (OOD) data is crucial in real-world machine learning applications, particularly in safety-critical domains. Existing methods often leverage language information from vision-language models (VLMs) to enhance OOD…

计算机视觉与模式识别 · 计算机科学 2025-01-22 Shu Zou , Xinyu Tian , Qinyu Zhao , Zhaoyuan Yang , Jing Zhang

Semantic communication is a promising technology for next-generation wireless networks. However, the out-of-distribution (OOD) problem, where a pre-trained machine learning (ML) model is applied to unseen tasks that are outside the…

信号处理 · 电气工程与系统科学 2024-07-23 Feifan Zhang , Yuyang Du , Kexin Chen , Yulin Shao , Soung Chang Liew

Vision-Language Models (VLMs) are now a core part of modern AI. Recent work proposed several visual jailbreak attacks using single/ holistic images. However, contemporary VLMs demonstrate strong robustness against such attacks due to…

计算机视觉与模式识别 · 计算机科学 2026-02-10 Md Rafi Ur Rashid , MD Sadik Hossain Shanto , Vishnu Asutosh Dasu , Shagufta Mehnaz

This work focuses on the potential of Vision LLMs (VLLMs) in visual reasoning. Different from prior studies, we shift our focus from evaluating standard performance to introducing a comprehensive safety evaluation suite, covering both…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Haoqin Tu , Chenhang Cui , Zijun Wang , Yiyang Zhou , Bingchen Zhao , Junlin Han , Wangchunshu Zhou , Huaxiu Yao , Cihang Xie

Visual language models (VLMs) have made significant progress in image captioning tasks, yet recent studies have found they are vulnerable to backdoor attacks. Attackers can inject undetectable perturbations into the data during inference,…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Shuhan Xu , Siyuan Liang , Hongling Zheng , Aishan Liu , Xinbiao Wang , Yong Luo , Fu Lin , Leszek Rutkowski , Dacheng Tao

Vision-Language Models (VLMs) have achieved impressive progress in multimodal text generation, yet their rapid adoption raises increasing concerns about security vulnerabilities. Existing backdoor attacks against VLMs primarily rely on…

密码学与安全 · 计算机科学 2025-12-08 Haoyu Shen , Weimin Lyu , Haotian Xu , Tengfei Ma

Aiming at identifying unexpected inputs from unknown classes, out-of-distribution (OOD) detection has emerged as a pivotal approach to enhancing the reliability of machine learning models. This paper focuses on the burgeoning paradigm of…

机器学习 · 计算机科学 2026-05-25 Bo Peng , Jie Lu , Guangquan Zhang , Zhen Fang

Vision-Language-Action (VLA) models have advanced robotic control by enabling end-to-end decision-making directly from multimodal inputs. However, their tightly coupled architectures expose novel security vulnerabilities. Unlike traditional…

密码学与安全 · 计算机科学 2025-05-23 Xueyang Zhou , Guiyao Tie , Guowen Zhang , Hechang Wang , Pan Zhou , Lichao Sun

Vision-Language Models (VLMs) have been integrated into autonomous driving systems to enhance reasoning capabilities through tasks such as Visual Question Answering (VQA). However, the robustness of these systems against backdoor attacks…

计算机视觉与模式识别 · 计算机科学 2025-05-13 Ming Liu , Siyuan Liang , Koushik Howlader , Liwen Wang , Dacheng Tao , Wensheng Zhang

Detecting anomalies or out-of-distribution (OOD) samples is critical for maintaining the reliability and trustworthiness of machine learning systems. Recently, Large Language Models (LLMs) have demonstrated their effectiveness not only in…

机器学习 · 计算机科学 2025-02-17 Ruiyao Xu , Kaize Ding

Large Vision-Language Models (VLMs) have achieved remarkable success in understanding complex real-world scenarios and supporting data-driven decision-making processes. However, VLMs exhibit significant vulnerability against adversarial…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Xiaosen Wang , Shaokang Wang , Zhijin Ge , Yuyang Luo , Shudong Zhang

Vision-Language Models (VLMs) are increasingly deployed in consumer applications where users seek recommendations about products, dining, and services. We introduce Hidden Ads, a new class of backdoor attacks that exploit this…

计算与语言 · 计算机科学 2026-03-31 Duanyi Yao , Changyue Li , Zhicong Huang , Cheng Hong , Songze Li

Vision-Language Models (VLMs) have demonstrated strong capabilities in aligning visual and textual modalities, enabling a wide range of applications in multimodal understanding and generation. While they excel in zero-shot and transfer…

计算机视觉与模式识别 · 计算机科学 2025-09-25 Hao Dong , Moru Liu , Jian Liang , Eleni Chatzi , Olga Fink

Multi-Modal Language Models (MLLMs) have transformed artificial intelligence by combining visual and text data, making applications like image captioning, visual question answering, and multi-modal content creation possible. This ability to…

密码学与安全 · 计算机科学 2024-11-11 Pete Janowczyk , Linda Laurier , Ave Giulietta , Arlo Octavia , Meade Cleti

Vision-Large-Language-models(VLMs) have great application prospects in autonomous driving. Despite the ability of VLMs to comprehend and make decisions in complex scenarios, their integration into safety-critical autonomous driving systems…

密码学与安全 · 计算机科学 2024-04-23 Zhenyang Ni , Rui Ye , Yuxi Wei , Zhen Xiang , Yanfeng Wang , Siheng Chen