English
Related papers

Related papers: Adversarial Backdoor Defense in CLIP

200 papers

Convolutional neural networks have outperformed humans in image recognition tasks, but they remain vulnerable to attacks from adversarial examples. Since these data are crafted by adding imperceptible noise to normal images, their existence…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Heng Yin , Hengwei Zhang , Jindong Wang , Ruiyu Dou

Machine-learning models demand periodic updates to improve their average accuracy, exploiting novel architectures and additional data. However, a newly updated model may commit mistakes the previous model did not make. Such…

Machine Learning · Computer Science 2025-05-30 Daniele Angioni , Luca Demetrio , Maura Pintor , Luca Oneto , Davide Anguita , Battista Biggio , Fabio Roli

Image retrieval plays an important role in the Internet world. Usually, the core parts of mainstream visual retrieval systems include an online service of the embedding model and a large-scale vector database. For traditional model…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Tan Pan , Furong Xu , Xudong Yang , Sifeng He , Chen Jiang , Qingpei Guo , Feng Qian Xiaobo Zhang , Yuan Cheng , Lei Yang , Wei Chu

Adversarial training and adversarial purification are two widely used defense strategies for enhancing model robustness against adversarial attacks. However, adversarial training requires costly retraining, while adversarial purification…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Xuelong Dai , Dong Wang , Xiuzhen Cheng , Bin Xiao

Despite remarkable achievements in deep learning across various domains, its inherent vulnerability to adversarial examples still remains a critical concern for practical deployment. Adversarial training has emerged as one of the most…

Machine Learning · Computer Science 2024-11-06 Junhao Dong , Xinghua Qu , Z. Jane Wang , Yew-Soon Ong

Deep neural networks (DNNs) have been shown to be vulnerable to adversarial examples, which can produce erroneous predictions by injecting imperceptible perturbations. In this work, we study the transferability of adversarial examples,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Zeyu Qin , Yanbo Fan , Yi Liu , Li Shen , Yong Zhang , Jue Wang , Baoyuan Wu

Deep neural networks (DNNs) have achieved remarkable success in computer vision tasks such as image classification, segmentation, and object detection. However, they are vulnerable to adversarial attacks, which can cause incorrect…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Suklav Ghosh , Sonal Kumar , Arijit Sur

Adversarial learning methods are a promising approach to training robust deep networks, and can generate complex samples across diverse domains. They also can improve recognition despite the presence of domain shift or dataset bias: several…

Computer Vision and Pattern Recognition · Computer Science 2017-02-20 Eric Tzeng , Judy Hoffman , Kate Saenko , Trevor Darrell

Contrastive learning has emerged as an efficient framework to learn multimodal representations. CLIP, a seminal work in this area, achieved impressive results by training on paired image-text data using the contrastive loss. Recent work…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Enrico Fini , Pietro Astolfi , Adriana Romero-Soriano , Jakob Verbeek , Michal Drozdzal

Multimodal contrastive learning methods like CLIP train on noisy and uncurated training datasets. This is cheaper than labeling datasets manually, and even improves out-of-distribution robustness. We show that this practice makes backdoor…

Machine Learning · Computer Science 2022-03-29 Nicholas Carlini , Andreas Terzis

Though much work has been done in the domain of improving the adversarial robustness of facial recognition systems, a surprisingly small percentage of it has focused on self-supervised approaches. In this work, we present an approach that…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Nazmul Karim , Umar Khalid , Nick Meeker , Sarinda Samarasinghe

Deep learning models are vulnerable to adversarial examples and make incomprehensible mistakes, which puts a threat on their real-world deployment. Combined with the idea of adversarial training, preprocessing-based defenses are popular and…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Tao Bai , Jun Zhao , Lanqing Guo , Bihan Wen

Deep neural networks (DNNs) are found to be vulnerable against adversarial examples, which are carefully crafted inputs with a small magnitude of perturbation aiming to induce arbitrarily incorrect predictions. Recent studies show that…

Cryptography and Security · Computer Science 2019-07-12 Yulong Cao , Chaowei Xiao , Dawei Yang , Jing Fang , Ruigang Yang , Mingyan Liu , Bo Li

Adversarial examples cause neural networks to produce incorrect outputs with high confidence. Although adversarial training is one of the most effective forms of defense against adversarial examples, unfortunately, a large gap exists…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Saehyung Lee , Hyungyu Lee , Sungroh Yoon

Neural networks are known to be vulnerable to adversarial attacks -- slight but carefully constructed perturbations of the inputs which can drastically impair the network's performance. Many defense methods have been proposed for improving…

Adversarial training is an approach of increasing the robustness of models to adversarial attacks by including adversarial examples in the training set. One major challenge of producing adversarial examples is to contain sufficient…

Machine Learning · Computer Science 2021-10-13 Tianjin Huang , Vlado Menkovski , Yulong Pei , Mykola Pechenizkiy

The security of deep learning (DL) systems is an extremely important field of study as they are being deployed in several applications due to their ever-improving performance to solve challenging tasks. Despite overwhelming promises, the…

Machine Learning · Computer Science 2022-08-19 Manaar Alam , Shubhajit Datta , Debdeep Mukhopadhyay , Arijit Mondal , Partha Pratim Chakrabarti

Adversarial example detection, which can be conveniently applied in many scenarios, is important in the area of adversarial defense. Unfortunately, existing detection methods suffer from poor generalization performance, because their…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Heqi Peng , Yunhong Wang , Ruijie Yang , Beichen Li , Rui Wang , Yuanfang Guo

Many defenses against adversarial attacks (\eg robust classifiers, randomization, or image purification) use countermeasures put to work only after the attack has been crafted. We adopt a different perspective to introduce $A^5$…

Machine Learning · Computer Science 2023-05-24 Iuri Frosio , Jan Kautz

Recent works have demonstrated convolutional neural networks are vulnerable to adversarial examples, i.e., inputs to machine learning models that an attacker has intentionally designed to cause the models to make a mistake. To improve the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Xianxu Hou , Jingxin Liu , Bolei Xu , Xiaolong Wang , Bozhi Liu , Guoping Qiu