English
Related papers

Related papers: AdvCLIP: Downstream-agnostic Adversarial Examples …

200 papers

Contrastive learning allows us to flexibly define powerful losses by contrasting positive pairs from sets of negative samples. Recently, the principle has also been used to learn cross-modal embeddings for video and text, yet without…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Mohammadreza Zolfaghari , Yi Zhu , Peter Gehler , Thomas Brox

The majority of methods for crafting adversarial attacks have focused on scenes with a single dominant object (e.g., images from ImageNet). On the other hand, natural scenes include multiple dominant objects that are semantically related.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Abhishek Aich , Calvin-Khang Ta , Akash Gupta , Chengyu Song , Srikanth V. Krishnamurthy , M. Salman Asif , Amit K. Roy-Chowdhury

Multi-modal contrastive models such as CLIP achieve state-of-the-art performance in zero-shot classification by embedding input images and texts on a joint representational space. Recently, a modality gap has been reported in two-encoder…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Abrar Fahim , Alex Murphy , Alona Fyshe

In this paper, we explore a critical yet under-investigated issue: how to learn robust and well-generalized 3D representation from pre-trained vision language models such as CLIP. Previous works have demonstrated that cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Shuqing Luo , Bowen Qu , Wei Gao

The introduction of multimodal models is a huge step forward in Artificial Intelligence. A single model is trained to understand multiple modalities: text, image, video, and audio. Open-source multimodal models have made these breakthroughs…

Machine Learning · Computer Science 2025-09-03 Shashank Kapoor , Sanjay Surendranath Girija , Lakshit Arora , Dipen Pradhan , Ankit Shetgaonkar , Aman Raj

This paper investigates the robustness of vision-language models against adversarial visual perturbations and introduces a novel ``double visual defense" to enhance this robustness. Unlike previous approaches that resort to lightweight…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Zeyu Wang , Cihang Xie , Brian Bartoldson , Bhavya Kailkhura

Contrastive language-image pre-training (CLIP) serves as a de-facto standard to align images and texts. Nonetheless, the loose correlation between images and texts of web-crawled data renders the contrastive objective data inefficient and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Jinghao Zhou , Li Dong , Zhe Gan , Lijuan Wang , Furu Wei

Multiview clustering (MVC) aims to reveal the underlying structure of multiview data by categorizing data samples into clusters. Deep learning-based methods exhibit strong feature learning capabilities on large-scale datasets. For most…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Jie Chen , Hua Mao , Wai Lok Woo , Xi Peng

Deep learning based image recognition systems have been widely deployed on mobile devices in today's world. In recent studies, however, deep learning models are shown vulnerable to adversarial examples. One variant of adversarial examples,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Tao Bai , Jinqi Luo , Jun Zhao

Although deep convolutional neural networks (CNNs) have demonstrated remarkable performance on multiple computer vision tasks, researches on adversarial learning have shown that deep models are vulnerable to adversarial examples, which are…

Computer Vision and Pattern Recognition · Computer Science 2020-10-16 Hongjun Wang , Guanbin Li , Xiaobai Liu , Liang Lin

Pretrained large-scale vision-language models like CLIP have exhibited strong generalization over unseen tasks. Yet imperceptible adversarial perturbations can significantly reduce CLIP's performance on new tasks. In this work, we identify…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Chengzhi Mao , Scott Geng , Junfeng Yang , Xin Wang , Carl Vondrick

Large pre-trained Vision-Language Models (VLMs) such as Contrastive Language-Image Pre-training (CLIP) have been shown to be susceptible to adversarial attacks, raising concerns about their deployment in safety-critical applications like…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Lin Luo , Xin Wang , Bojia Zi , Shihao Zhao , Xingjun Ma , Yu-Gang Jiang

While vision-language pre-training model (VLP) has shown revolutionary improvements on various vision-language (V+L) tasks, the studies regarding its adversarial robustness remain largely unexplored. This paper studied the adversarial…

Machine Learning · Computer Science 2022-10-21 Jiaming Zhang , Qi Yi , Jitao Sang

Contrastive Language-Image Pre-training (CLIP) has shown impressive performance in aligning visual and textual representations. Recent studies have extended this paradigm to 3D vision to improve scene understanding for autonomous driving. A…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Ximeng Tao , Dimitar Filev , Gaurav Pandey

Contrastive learning (CL) has recently emerged as an effective approach to learning representation in a range of downstream tasks. Central to this approach is the selection of positive (similar) and negative (dissimilar) sets to provide the…

Machine Learning · Computer Science 2021-10-25 Anh Bui , Trung Le , He Zhao , Paul Montague , Seyit Camtepe , Dinh Phung

Multi-modal models have gained significant attention due to their powerful capabilities. These models effectively align embeddings across diverse data modalities, showcasing superior performance in downstream tasks compared to their…

Cryptography and Security · Computer Science 2024-09-25 Zhihao Dou , Xin Hu , Haibo Yang , Zhuqing Liu , Minghong Fang

Deep neural networks (DNNs) have achieved remarkable success in computer vision tasks such as image classification, segmentation, and object detection. However, they are vulnerable to adversarial attacks, which can cause incorrect…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Suklav Ghosh , Sonal Kumar , Arijit Sur

With the emergence of more powerful large language models (LLMs), such as ChatGPT and GPT-4, in-context learning (ICL) has gained significant prominence in leveraging these models for specific tasks by utilizing data-label pairs as…

Computation and Language · Computer Science 2023-10-17 Jiongxiao Wang , Zichen Liu , Keun Hee Park , Zhuojun Jiang , Zhaoheng Zheng , Zhuofeng Wu , Muhao Chen , Chaowei Xiao

Contrastive Language-Image Pre-training (CLIP) has significantly boosted the performance of various vision-language tasks by scaling up the dataset with image-text pairs collected from the web. However, the presence of intrinsic noise and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Kaicheng Yang , Jiankang Deng , Xiang An , Jiawei Li , Ziyong Feng , Jia Guo , Jing Yang , Tongliang Liu

Large pre-trained vision-language models, such as CLIP, have demonstrated state-of-the-art performance across a wide range of image classification tasks, without requiring retraining. Few-shot CLIP is competitive with existing specialized…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Dominykas Seputis , Serghei Mihailov , Soham Chatterjee , Zehao Xiao