English
Related papers

Related papers: Exploring the Adversarial Robustness of CLIP for A…

200 papers

Deep neural network-based image compression has been extensively studied. However, the model robustness which is crucial to practical application is largely overlooked. We propose to examine the robustness of prevailing learned image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Tong Chen , Zhan Ma

Deep learning has made tremendous advances in computer vision tasks such as image classification. However, recent studies have shown that deep learning models are vulnerable to specifically crafted adversarial inputs that are…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Kirthi Shankar Sivamani

Convolutional Neural Networks have achieved significant success across multiple computer vision tasks. However, they are vulnerable to carefully crafted, human-imperceptible adversarial noise patterns which constrain their deployment in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Aamir Mustafa , Salman H. Khan , Munawar Hayat , Jianbing Shen , Ling Shao

Deep neural networks (DNNs) are well known to be vulnerable to adversarial examples (AEs). In addition, AEs have adversarial transferability, which means AEs generated for a source model can fool another black-box model (target model) with…

Cryptography and Security · Computer Science 2024-01-08 Ryota Iijima , Sayaka Shiota , Hitoshi Kiya

Deep learning is found to be vulnerable to adversarial examples. However, its adversarial susceptibility in image caption generation is under-explored. We study adversarial examples for vision and language models, which typically adopt an…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Nayyer Aafaq , Naveed Akhtar , Wei Liu , Mubarak Shah , Ajmal Mian

With growing abilities of generative models, artificial content detection becomes an increasingly important and difficult task. However, all popular approaches to this problem suffer from poor generalization across domains and generative…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Tatiana Gaintseva , Laida Kushnareva , German Magai , Irina Piontkovskaya , Sergey Nikolenko , Martin Benning , Serguei Barannikov , Gregory Slabaugh

Recent studies have shown that Convolutional Neural Networks (CNN) are relatively easy to attack through the generation of so-called adversarial examples. Such vulnerability also affects CNN-based image forensic tools. Research in deep…

Cryptography and Security · Computer Science 2018-11-06 Mauro Barni , Kassem Kallas , Ehsan Nowroozi , Benedetta Tondi

Contrastive Language-Image Pretraining (CLIP) stands out as a prominent method for image representation learning. Various neural architectures, spanning Transformer-based models like Vision Transformers (ViTs) to Convolutional Networks…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Cristian Rodriguez-Opazo , Edison Marrese-Taylor , Ehsan Abbasnejad , Hamed Damirchi , Ignacio M. Jara , Felipe Bravo-Marquez , Anton van den Hengel

Adversarial attacks to image classification systems present challenges to convolutional networks and opportunities for understanding them. This study suggests that adversarial perturbations on images lead to noise in the features…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Cihang Xie , Yuxin Wu , Laurens van der Maaten , Alan Yuille , Kaiming He

Deep Convolutional Neural Networks (CNNs) have long been the architecture of choice for computer vision tasks. Recently, Transformer-based architectures like Vision Transformer (ViT) have matched or even surpassed ResNets for image…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Srinadh Bhojanapalli , Ayan Chakrabarti , Daniel Glasner , Daliang Li , Thomas Unterthiner , Andreas Veit

Adversarial attacks can readily disrupt the image classification system, revealing the vulnerability of DNN-based recognition tasks. While existing adversarial perturbations are primarily applied to uncompressed images or compressed images…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Yang Sui , Zhuohang Li , Ding Ding , Xiang Pan , Xiaozhong Xu , Shan Liu , Zhenzhong Chen

Recent advances in Vision Transformer (ViT) have demonstrated its impressive performance in image classification, which makes it a promising alternative to Convolutional Neural Network (CNN). Unlike CNNs, ViT represents an input image as a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Jindong Gu , Volker Tresp , Yao Qin

Deploying convolutional neural networks (CNNs) for embedded applications presents many challenges in balancing resource-efficiency and task-related accuracy. These two aspects have been well-researched in the field of CNN compression. In…

Defending against physical adversarial attacks is a rapidly growing topic in deep learning and computer vision. Prominent forms of physical adversarial attacks, such as overlaid adversarial patches and objects, share similarities with…

Cryptography and Security · Computer Science 2020-11-13 Perry Deng , Mohammad Saidur Rahman , Matthew Wright

Recent studies have shown that Convolutional Neural Networks (CNNs) are vulnerable to a small perturbation of input called "adversarial examples". In this work, we propose a new feedforward CNN that improves robustness in the presence of…

Machine Learning · Computer Science 2016-02-26 Jonghoon Jin , Aysegul Dundar , Eugenio Culurciello

Pretrained vision-language models (VLMs) like CLIP exhibit exceptional generalization across diverse downstream tasks. While recent studies reveal their vulnerability to adversarial attacks, research to date has primarily focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Wanqi Zhou , Shuanghao Bai , Danilo P. Mandic , Qibin Zhao , Badong Chen

In the past few years, an increasing number of machine-learning and deep learning structures, such as Convolutional Neural Networks (CNNs), have been applied to solving a wide range of real-life problems. However, these architectures are…

Cryptography and Security · Computer Science 2021-07-30 Amira Guesmi , Ihsen Alouani , Khaled Khasawneh , Mouna Baklouti , Tarek Frikha , Mohamed Abid , Nael Abu-Ghazaleh

Multimodal contrastive learning aims to train a general-purpose feature extractor, such as CLIP, on vast amounts of raw, unlabeled paired image-text data. This can greatly benefit various complex downstream tasks, including cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Ziqi Zhou , Shengshan Hu , Minghui Li , Hangtao Zhang , Yechao Zhang , Hai Jin

The advent of multimodal deep learning models, such as CLIP, has unlocked new frontiers in a wide range of applications, from image-text understanding to classification tasks. However, these models are not safe for adversarial attacks,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Md. Iqbal Hossain , Afia Sajeeda , Neeresh Kumar Perla , Ming Shao

Regarding image forensics, researchers have proposed various approaches to detect and/or localize manipulations, such as splices. Recent best performing image-forensics algorithms greatly benefit from the application of deep learning, but…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Andras Rozsa , Zheng Zhong , Terrance E. Boult