中文
相关论文

相关论文: BadCLIP: Dual-Embedding Guided Backdoor Attack on …

200 篇论文

Despite remarkable successes in unimodal learning tasks, backdoor attacks against cross-modal learning are still underexplored due to the limited generalization and inferior stealthiness when involving multiple modalities. Notably, since…

计算机视觉与模式识别 · 计算机科学 2024-10-04 Zheng Zhang , Xu Yuan , Lei Zhu , Jingkuan Song , Liqiang Nie

Federated Learning (FL) is a distributed learning paradigm that enables different parties to train a model together for high quality and strong privacy protection. In this scenario, individual participants may get compromised and perform…

Backdoor attacks embed hidden malicious behaviors into deep learning models, which only activate and cause misclassifications on model inputs containing a specific trigger. Existing works on backdoor attacks and defenses, however, mostly…

计算机视觉与模式识别 · 计算机科学 2021-09-08 Emily Wenger , Josephine Passananti , Arjun Bhagoji , Yuanshun Yao , Haitao Zheng , Ben Y. Zhao

Due to the popularity of Artificial Intelligence (AI) techniques, we are witnessing an increasing number of backdoor injection attacks that are designed to maliciously threaten Deep Neural Networks (DNNs) causing misclassification. Although…

机器学习 · 计算机科学 2022-05-18 Zhihao Yue , Jun Xia , Zhiwei Ling , Ming Hu , Ting Wang , Xian Wei , Mingsong Chen

Contrastive language-image pretraining (CLIP) has been found to be vulnerable to poisoning backdoor attacks where the adversary can achieve an almost perfect attack success rate on CLIP models by poisoning only 0.01\% of the training…

机器学习 · 计算机科学 2025-02-11 Hanxun Huang , Sarah Erfani , Yige Li , Xingjun Ma , James Bailey

Contrastive Learning (CL) has attracted enormous attention due to its remarkable capability in unsupervised representation learning. However, recent works have revealed the vulnerability of CL to backdoor attacks: the feature extractor…

密码学与安全 · 计算机科学 2024-04-12 Weiyu Sun , Xinyu Zhang , Hao Lu , Yingcong Chen , Ting Wang , Jinghui Chen , Lu Lin

In recent years, there has been an explosive growth in multimodal learning. Image captioning, a classical multimodal task, has demonstrated promising applications and attracted extensive research attention. However, recent studies have…

密码学与安全 · 计算机科学 2024-06-11 Wenshu Fan , Hongwei Li , Wenbo Jiang , Meng Hao , Shui Yu , Xiao Zhang

As collaborative learning allows joint training of a model using multiple sources of data, the security problem has been a central concern. Malicious users can upload poisoned data to prevent the model's convergence or inject hidden…

密码学与安全 · 计算机科学 2021-01-21 Ximing Qiao , Yuhua Bai , Siping Hu , Ang Li , Yiran Chen , Hai Li

Prompt-based tuning has emerged as a lightweight alternative to full fine-tuning in large vision-language models, enabling efficient adaptation via learned contextual prompts. This paradigm has recently been extended to federated learning…

机器学习 · 计算机科学 2025-09-09 Maozhen Zhang , Mengnan Zhao , Wei Wang , Bo Wang

Adversarial attacks constitute a notable threat to machine learning systems, given their potential to induce erroneous predictions and classifications. However, within real-world contexts, the essential specifics of the deployed model are…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Jingwen Ye , Ruonan Yu , Songhua Liu , Xinchao Wang

This paper finds that contrastive learning can produce superior sentence embeddings for pre-trained models but is also vulnerable to backdoor attacks. We present the first backdoor attack framework, BadCSE, for state-of-the-art sentence…

计算与语言 · 计算机科学 2022-10-21 Xiaoyi Chen , Baisong Xin , Shengfang Zhai , Shiqing Ma , Qingni Shen , Zhonghai Wu

Over the past few years, the emergence of backdoor attacks has presented significant challenges to deep learning systems, allowing attackers to insert backdoors into neural networks. When data with a trigger is processed by a backdoor…

密码学与安全 · 计算机科学 2025-03-07 Haiyang Yu , Tian Xie , Jiaping Gui , Pengyang Wang , Ping Yi , Yue Wu

Backdoor attacks are a kind of emergent security threat in deep learning. After being injected with a backdoor, a deep neural model will behave normally on standard inputs but give adversary-specified predictions once the input contains…

密码学与安全 · 计算机科学 2022-10-20 Yangyi Chen , Fanchao Qi , Hongcheng Gao , Zhiyuan Liu , Maosong Sun

Deep learning models have consistently outperformed traditional machine learning models in various classification tasks, including image classification. As such, they have become increasingly prevalent in many real world applications…

密码学与安全 · 计算机科学 2018-08-31 Cong Liao , Haoti Zhong , Anna Squicciarini , Sencun Zhu , David Miller

The Contrastive Language-Image Pretraining (CLIP) model has significantly advanced vision-language modeling by aligning image-text pairs from large-scale web data through self-supervised contrastive learning. Yet, its reliance on uncurated…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Xin Yao , Haiyang Zhao , Yimin Chen , Jiawei Guo , Kecheng Huang , Ming Zhao

Deep neural networks (DNNs) are vulnerable to backdoor attacks which can hide backdoor triggers in DNNs by poisoning training data. A backdoored model behaves normally on clean test images, yet consistently predicts a particular target…

计算机视觉与模式识别 · 计算机科学 2020-06-17 Shihao Zhao , Xingjun Ma , Xiang Zheng , James Bailey , Jingjing Chen , Yu-Gang Jiang

Self-supervised learning in computer vision aims to pre-train an image encoder using a large amount of unlabeled images or (image, text) pairs. The pre-trained image encoder can then be used as a feature extractor to build downstream…

密码学与安全 · 计算机科学 2021-08-03 Jinyuan Jia , Yupei Liu , Neil Zhenqiang Gong

The Internet of Things (IoT) systems increasingly depend on continual learning to adapt to non-stationary environments. These environments can include factors such as sensor drift, changing user behavior, device aging, and adversarial…

机器学习 · 计算机科学 2026-02-16 Alfous Tim , Kuniyilh Simi D

Vision-Language Models (VLMs) have achieved impressive progress in multimodal text generation, yet their rapid adoption raises increasing concerns about security vulnerabilities. Existing backdoor attacks against VLMs primarily rely on…

密码学与安全 · 计算机科学 2025-12-08 Haoyu Shen , Weimin Lyu , Haotian Xu , Tengfei Ma

In-context learning (ICL) has demonstrated remarkable success in large language models (LLMs) due to its adaptability and parameter-free nature. However, it also introduces a critical vulnerability to backdoor attacks, where adversaries can…

机器学习 · 计算机科学 2025-07-03 Zhiyao Ren , Siyuan Liang , Aishan Liu , Dacheng Tao