English
Related papers

Related papers: Exploring the Adversarial Robustness of CLIP for A…

200 papers

Deep neural networks (DNNs) are well known to be vulnerable to adversarial examples (AEs). In addition, AEs have adversarial transferability, which means AEs generated for a source model can fool another black-box model (target model) with…

Cryptography and Security · Computer Science 2023-07-27 Ryota Iijima , Miki Tanaka , Sayaka Shiota , Hitoshi Kiya

Convolutional neural networks (CNNs) have achieved beyond human-level accuracy in the image classification task and are widely deployed in real-world environments. However, CNNs show vulnerability to adversarial perturbations that are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Desheng Wang , Weidong Jin , Yunpu Wu , Aamir Khan

The vulnerability of convolutional neural networks (CNNs) to image perturbations such as common corruptions and adversarial perturbations has recently been investigated from the perspective of frequency. In this study, we investigate the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Chun Yang Tan , Kazuhiko Kawamoto , Hiroshi Kera

Contrastive language-image pretraining (CLIP) has been found to be vulnerable to poisoning backdoor attacks where the adversary can achieve an almost perfect attack success rate on CLIP models by poisoning only 0.01\% of the training…

Machine Learning · Computer Science 2025-02-11 Hanxun Huang , Sarah Erfani , Yige Li , Xingjun Ma , James Bailey

Given their substantial success in addressing a wide range of computer vision challenges, Convolutional Neural Networks (CNNs) are increasingly being used in smart home applications, with many of these applications relying on the automatic…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Utku Ozbulak , Baptist Vandersmissen , Azarakhsh Jalalvand , Ivo Couckuyt , Arnout Van Messem , Wesley De Neve

In this paper, we propose Code-Bridged Classifier (CBC), a framework for making a Convolutional Neural Network (CNNs) robust against adversarial attacks without increasing or even by decreasing the overall models' computational complexity.…

Large vision language models, such as CLIP, demonstrate impressive robustness to spurious features than single-modal models trained on ImageNet. However, existing test datasets are typically curated based on ImageNet-trained models, which…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Qizhou Wang , Yong Lin , Yongqiang Chen , Ludwig Schmidt , Bo Han , Tong Zhang

Adversarial input attacks can cause a significant shift of CLIP embeddings. This can affect the downstream robustness of models incorporating CLIP in the pipeline, such as text-to-image generative models or large vision language models.…

Machine Learning · Computer Science 2025-10-13 Elias Abad Rocamora , Christian Schlarmann , Naman Deep Singh , Yongtao Wu , Matthias Hein , Volkan Cevher

This paper examines the vulnerabilities of convolutional neural networks (CNNs) to adversarial attacks and explores a method for their safeguarding. In this study, CNNs were implemented on four of the most common image datasets, namely…

Machine Learning · Computer Science 2025-02-11 Koushik Chowdhury

The recent success of Vision Transformers is shaking the long dominance of Convolutional Neural Networks (CNNs) in image recognition for a decade. Specifically, in terms of robustness on out-of-distribution samples, recent research finds…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Zeyu Wang , Yutong Bai , Yuyin Zhou , Cihang Xie

In recent years, convolutional neural networks (CNNs) have been widely used by researchers to perform forensic tasks such as image tampering detection. At the same time, adversarial attacks have been developed that are capable of fooling…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Xinwei Zhao , Matthew C. Stamm

Vision-Language Models (VLMs), such as CLIP, have demonstrated remarkable zero-shot generalizability across diverse downstream tasks. However, recent studies have revealed that VLMs, including CLIP, are highly vulnerable to adversarial…

Cryptography and Security · Computer Science 2025-10-27 Jia Deng , Jin Li , Zhenhua Zhao , Shaowei Wang

Deep learning based image classification models are shown vulnerable to adversarial attacks by injecting deliberately crafted noises to clean images. To defend against adversarial attacks in a training-free and attack-agnostic manner, this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Li Ding , Yongwei Wang , Xin Ding , Kaiwen Yuan , Ping Wang , Hua Huang , Z. Jane Wang

This paper introduces DeeCLIP, a novel framework for detecting AI-generated images using CLIP-ViT and fusion learning. Despite significant advancements in generative models capable of creating highly photorealistic images, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Mamadou Keita , Wassim Hamidouche , Hessen Bougueffa Eutamene , Abdelmalik Taleb-Ahmed , Abdenour Hadid

Natural images are virtually surrounded by low-density misclassified regions that can be efficiently discovered by gradient-guided search --- enabling the generation of adversarial images. While many techniques for detecting these attacks…

Machine Learning · Computer Science 2019-12-05 Tao Yu , Shengyuan Hu , Chuan Guo , Wei-Lun Chao , Kilian Q. Weinberger

Contrast enhancement (CE) forensics has always been ofconcern to image forensics community. It can provide aneffective tool for recovering image history and identifyingtampered images. Although several CE forensic algorithmshave been…

Multimedia · Computer Science 2019-02-11 Pengpeng Yang , Rongrong Ni , Yao Zhao , Gang Cao , Wei Zhao

We present a novel method for generating robust adversarial image examples building upon the recent `deep image prior' (DIP) that exploits convolutional network architectures to enforce plausible texture in image synthesis. Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Thomas Gittings , Steve Schneider , John Collomosse

Deepfakes, created using advanced AI techniques such as Variational Autoencoder and Generative Adversarial Networks, have evolved from research and entertainment applications into tools for malicious activities, posing significant threats…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Yamini Sri Krubha , Aryana Hou , Braden Vester , Web Walker , Xin Wang , Li Lin , Shu Hu

The rapid progress of generative models, such as GANs and diffusion models, has facilitated the creation of highly realistic images, raising growing concerns over their misuse in security-sensitive domains. While existing detectors perform…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Jiazhen Yan , Fan Wang , Weiwei Jiang , Ziqiang Li , Zhangjie Fu

Convolutional Neural Networks (CNNs) have made remarkable strides; however, they remain susceptible to vulnerabilities, particularly in the face of minor image perturbations that humans can easily recognize. This weakness, often termed as…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Akshay Jain , Shiv Ram Dubey , Satish Kumar Singh , KC Santosh , Bidyut Baran Chaudhuri