中文
相关论文

相关论文: BadCLIP++: Stealthy and Persistent Backdoors in Mu…

200 篇论文

Multimodal contrastive pretraining, exemplified by models like CLIP, has been found to be vulnerable to backdoor attacks. While current backdoor defense methods primarily employ conventional data augmentation to create augmented samples…

计算机视觉与模式识别 · 计算机科学 2024-09-25 Junhao Kuang , Siyuan Liang , Jiawei Liang , Kuanrong Liu , Xiaochun Cao

Vision-Language models like CLIP have been shown to be highly effective at linking visual perception and natural language understanding, enabling sophisticated image-text capabilities, including strong retrieval and zero-shot classification…

机器学习 · 计算机科学 2026-04-08 Naman Deep Singh , Francesco Croce , Matthias Hein

Contrastive Language-Image Pre-training (CLIP) on large image-caption datasets has achieved remarkable success in zero-shot classification and enabled transferability to new domains. However, CLIP is extremely more vulnerable to targeted…

机器学习 · 计算机科学 2024-06-12 Wenhan Yang , Jingdong Gao , Baharan Mirzasoleiman

Recently, backdoor attacks have become an emerging threat to the security of machine learning models. From the adversary's perspective, the implanted backdoors should be resistant to defensive algorithms, but some recently proposed…

机器学习 · 计算机科学 2024-07-23 Hoang Pham , The-Anh Ta , Anh Tran , Khoa D. Doan

Backdoor attacks pose a severe threat to deep learning, yet their impact on object detection remains poorly understood compared to image classification. While attacks have been proposed, we identify critical weaknesses in existing…

计算机视觉与模式识别 · 计算机科学 2026-01-30 Kealan Dunnett , Reza Arablouei , Dimity Miller , Volkan Dedeoglu , Raja Jurdak

Prompt-based learning paradigm has demonstrated remarkable efficacy in enhancing the adaptability of pretrained language models (PLMs), particularly in few-shot scenarios. However, this learning paradigm has been shown to be vulnerable to…

机器学习 · 计算机科学 2024-04-02 Xiaopeng Xie , Ming Yan , Xiwen Zhou , Chenlong Zhao , Suli Wang , Yong Zhang , Joey Tianyi Zhou

Backdoor attacks pose severe security threats to deep neural networks by embedding malicious triggers that force misclassification. While machine unlearning techniques can remove backdoor behaviors, current methods lack transparency and…

密码学与安全 · 计算机科学 2025-11-27 Tien Dat Hoang

Multimodal contrastive learning aims to train a general-purpose feature extractor, such as CLIP, on vast amounts of raw, unlabeled paired image-text data. This can greatly benefit various complex downstream tasks, including cross-modal…

计算机视觉与模式识别 · 计算机科学 2023-08-15 Ziqi Zhou , Shengshan Hu , Minghui Li , Hangtao Zhang , Yechao Zhang , Hai Jin

Deep neural networks (DNNs) have progressed rapidly during the past decade and have been deployed in various real-world applications. Meanwhile, DNN models have been shown to be vulnerable to security and privacy attacks. One such attack…

密码学与安全 · 计算机科学 2021-10-06 Xiaoyi Chen , Ahmed Salem , Dingfan Chen , Michael Backes , Shiqing Ma , Qingni Shen , Zhonghai Wu , Yang Zhang

Self-supervised learning in computer vision aims to pre-train an image encoder using a large amount of unlabeled images or (image, text) pairs. The pre-trained image encoder can then be used as a feature extractor to build downstream…

密码学与安全 · 计算机科学 2021-08-03 Jinyuan Jia , Yupei Liu , Neil Zhenqiang Gong

Recent studies have shown that cooperative multi-agent deep reinforcement learning (c-MADRL) is under the threat of backdoor attacks. Once a backdoor trigger is observed, it will perform abnormal actions leading to failures or malicious…

人工智能 · 计算机科学 2024-09-13 Yinbo Yu , Saihao Yan , Jiajia Liu

As collaborative learning allows joint training of a model using multiple sources of data, the security problem has been a central concern. Malicious users can upload poisoned data to prevent the model's convergence or inject hidden…

密码学与安全 · 计算机科学 2021-01-21 Ximing Qiao , Yuhua Bai , Siping Hu , Ang Li , Yiran Chen , Hai Li

Due to the popularity of Artificial Intelligence (AI) techniques, we are witnessing an increasing number of backdoor injection attacks that are designed to maliciously threaten Deep Neural Networks (DNNs) causing misclassification. Although…

机器学习 · 计算机科学 2022-05-18 Zhihao Yue , Jun Xia , Zhiwei Ling , Ming Hu , Ting Wang , Xian Wei , Mingsong Chen

Self-supervised contrastive learning (CL) effectively learns transferable representations from unlabeled data containing images or image-text pairs but suffers vulnerability to data poisoning backdoor attacks (DPCLs). An adversary can…

计算机视觉与模式识别 · 计算机科学 2025-08-20 Tuo Chen , Jie Gui , Minjing Dong , Ju Jia , Lanting Fang , Jian Liu

Multimodal contrastive learning models (e.g., CLIP) can learn high-quality representations from large-scale image-text datasets, while they exhibit significant vulnerabilities to backdoor attacks, raising serious safety concerns. In this…

计算机视觉与模式识别 · 计算机科学 2025-10-31 Zhifang Zhang , Shuo He , Haobo Wang , Bingquan Shen , Lei Feng

Backdoor attacks pose a persistent security risk to deep neural networks (DNNs) due to their stealth and durability. While recent research has explored leveraging model unlearning mechanisms to enhance backdoor concealment, existing attack…

密码学与安全 · 计算机科学 2025-10-16 Baogang Song , Dongdong Zhao , Jianwen Xiang , Qiben Xu , Zizhuo Yu

The advent of clinical language models integrated into electronic health records (EHR) for clinical decision support has marked a significant advancement, leveraging the depth of clinical notes for improved decision-making. Despite their…

计算与语言 · 计算机科学 2024-07-09 Weimin Lyu , Zexin Bi , Fusheng Wang , Chao Chen

At present, backdoor attacks attract attention as they do great harm to deep learning models. The adversary poisons the training data making the model being injected with a backdoor after being trained unconsciously by victims using the…

密码学与安全 · 计算机科学 2023-03-06 Shengfang Zhai , Qingni Shen , Xiaoyi Chen , Weilong Wang , Cong Li , Yuejian Fang , Zhonghai Wu

Visual State Space Models (VSSM) have shown remarkable performance in various computer vision tasks. However, backdoor attacks pose significant security challenges, causing compromised models to predict target labels when specific triggers…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Cheng-Yi Lee , Yu-Hsuan Chiang , Zhong-You Wu , Chia-Mu Yu , Chun-Shien Lu

Prompt-driven Video Segmentation Foundation Models (VSFMs), such as SAM2, are increasingly used in applications including autonomous driving and digital pathology, yet their security risks remain underexplored. We study backdoor attacks…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Zongmin Zhang , Zhen Sun , Yifan Liao , Wenhan Dong , Xinlei He , Xingshuo Han , Shengmin Xu , Xinyi Huang