中文
相关论文

相关论文: Adversarial Backdoor Defense in CLIP

200 篇论文

Adversarial examples are perturbed inputs designed to fool machine learning models. Adversarial training injects such examples into training data to increase robustness. To scale this technique to large datasets, perturbations are crafted…

DNNs' demand for massive data forces practitioners to collect data from the Internet without careful check due to the unacceptable cost, which brings potential risks of backdoor attacks. A backdoored model always predicts a target class in…

机器学习 · 计算机科学 2022-02-23 Yinghua Gao , Dongxian Wu , Jingfeng Zhang , Guanhao Gan , Shu-Tao Xia , Gang Niu , Masashi Sugiyama

Denoising diffusion models have shown remarkable potential in various generation tasks. The open-source large-scale text-to-image model, Stable Diffusion, becomes prevalent as it can generate realistic artistic or facial images with…

计算机视觉与模式识别 · 计算机科学 2023-05-09 Ruijia Wu , Yuhang Wang , Huafeng Shi , Zhipeng Yu , Yichao Wu , Ding Liang

Recently researchers have proposed using deep learning-based systems for malware detection. Unfortunately, all deep learning classification systems are vulnerable to adversarial attacks. Previous work has studied adversarial attacks against…

密码学与安全 · 计算机科学 2017-12-19 Jack W. Stokes , De Wang , Mady Marinescu , Marc Marino , Brian Bussone

Convolutional neural networks (CNN) define the state-of-the-art solution on many perceptual tasks. However, current CNN approaches largely remain vulnerable against adversarial perturbations of the input that have been crafted specifically…

计算机视觉与模式识别 · 计算机科学 2024-03-04 Peter Lorenz , Margret Keuper , Janis Keuper

The decentralized and privacy-preserving nature of federated learning (FL) makes it vulnerable to backdoor attacks aiming to manipulate the behavior of the resulting model on specific adversary-chosen inputs. However, most existing defenses…

密码学与安全 · 计算机科学 2023-08-11 Siquan Huang , Yijiang Li , Chong Chen , Leyu Shi , Ying Gao

Despite recent success of self-supervised based contrastive learning model for 3D point clouds representation, the adversarial robustness of such pre-trained models raised concerns. Adversarial contrastive learning (ACL) is considered an…

计算机视觉与模式识别 · 计算机科学 2022-09-16 Junxuan Huang , Yatong An , Lu cheng , Bai Chen , Junsong Yuan , Chunming Qiao

Deep neural networks (DNNs) are recently shown to be vulnerable to backdoor attacks, where attackers embed hidden backdoors in the DNN model by injecting a few poisoned examples into the training dataset. While extensive efforts have been…

人工智能 · 计算机科学 2023-03-14 Zaixi Zhang , Qi Liu , Zhicai Wang , Zepu Lu , Qingyong Hu

We study the problem of adapting to a known sub-rational opponent during online play while remaining robust to rational opponents. We focus on large imperfect-information (zero-sum) games, which makes it impossible to inspect the whole game…

计算机科学与博弈论 · 计算机科学 2025-02-11 David Milec , Vojtěch Kovařík , Viliam Lisý

CLIP delivers strong zero-shot classification but remains highly vulnerable to adversarial attacks. Previous work of adversarial fine-tuning largely focuses on matching the predicted logits between clean and adversarial examples, which…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Wenjing lu , Zerui Tao , Dongping Zhang , Yuning Qiu , Yang Yang , Qibin Zhao

State-of-the-art defense mechanisms are typically evaluated in the context of white-box attacks, which is not realistic, as it assumes the attacker can access the gradients of the target network. To protect against this scenario,…

计算机视觉与模式识别 · 计算机科学 2025-03-03 Joana C. Costa , Tiago Roxo , Hugo Proença , Pedro R. M. Inácio

Contrastive learning (CL) has recently emerged as an effective approach to learning representation in a range of downstream tasks. Central to this approach is the selection of positive (similar) and negative (dissimilar) sets to provide the…

机器学习 · 计算机科学 2021-10-25 Anh Bui , Trung Le , He Zhao , Paul Montague , Seyit Camtepe , Dinh Phung

Vision-Language models like CLIP have been shown to be highly effective at linking visual perception and natural language understanding, enabling sophisticated image-text capabilities, including strong retrieval and zero-shot classification…

机器学习 · 计算机科学 2026-04-08 Naman Deep Singh , Francesco Croce , Matthias Hein

Adversarial examples derived from deliberately crafted perturbations on visual inputs can easily harm decision process of deep neural networks. To prevent potential threats, various adversarial training-based defense methods have grown…

机器学习 · 计算机科学 2023-07-19 Byung-Kwan Lee , Junho Kim , Yong Man Ro

Deep learning has achieved remarkable success in direction-of-arrival (DOA) estimation. However, recent studies have shown that adversarial perturbations can severely compromise the performance of such models. To address this vulnerability,…

信号处理 · 电气工程与系统科学 2025-12-12 Shilian Zheng , Xiaoxiang Wu , Luxin Zhang , Keqiang Yue , Peihan Qi , Zhijin Zhao

Contrastive vision-language representation learning has achieved state-of-the-art performance for zero-shot classification, by learning from millions of image-caption pairs crawled from the internet. However, the massive data that powers…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Wenhan Yang , Jingdong Gao , Baharan Mirzasoleiman

This paper is concerned with the defense of deep models against adversarial attacks. Inspired by the certificate defense approach, we propose a maximal adversarial distortion (MAD) optimization method for robustifying deep networks. MAD…

机器学习 · 计算机科学 2020-06-16 Shai Rozenberg , Gal Elidan , Ran El-Yaniv

Deep Neural Networks (DNNs) are vulnerable to backdoor attacks, where attackers implant hidden triggers during training to maliciously control model behavior. Topological Evolution Dynamics (TED) has recently emerged as a powerful tool for…

密码学与安全 · 计算机科学 2025-06-13 Xiaoxing Mo , Yuxuan Cheng , Nan Sun , Leo Yu Zhang , Wei Luo , Shang Gao

Backdoor attacks present a substantial security concern for deep learning models, especially those utilized in applications critical to safety and security. These attacks manipulate model behavior by embedding a hidden trigger during the…

机器学习 · 计算机科学 2024-01-09 Yujing Jiang , Xingjun Ma , Sarah Monazam Erfani , Yige Li , James Bailey

Prompt-based tuning has emerged as a lightweight alternative to full fine-tuning in large vision-language models, enabling efficient adaptation via learned contextual prompts. This paradigm has recently been extended to federated learning…

机器学习 · 计算机科学 2025-09-09 Maozhen Zhang , Mengnan Zhao , Wei Wang , Bo Wang