English
Related papers

Related papers: CLIP-ReIdent: Contrastive Training for Player Re-I…

200 papers

Contrastive Language-Image Pretraining (CLIP) models maximize the mutual information between text and visual modalities to learn representations. This makes the nature of the training data a significant factor in the efficacy of CLIP for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Maitreya Patel , Abhiram Kusumba , Sheng Cheng , Changhoon Kim , Tejas Gokhale , Chitta Baral , Yezhou Yang

The contrastive vision-language pre-training, known as CLIP, demonstrates remarkable potential in perceiving open-world visual concepts, enabling effective zero-shot image recognition. Nevertheless, few-shot learning methods based on CLIP…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Cheng Cheng , Lin Song , Ruoyi Xue , Hang Wang , Hongbin Sun , Yixiao Ge , Ying Shan

Despite its prevalent use in image-text matching tasks in a zero-shot manner, CLIP has been shown to be highly vulnerable to adversarial perturbations added onto images. Recent studies propose to finetune the vision encoder of CLIP with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Songlong Xing , Zhengyu Zhao , Nicu Sebe

The Contrastive Language-Image Pre-training (CLIP) Model is a recently proposed large-scale pre-train model which attracts increasing attention in the computer vision community. Benefiting from its gigantic image-text training set, the CLIP…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Yuxuan Ding , Lingqiao Liu , Chunna Tian , Jingyuan Yang , Haoxuan Ding

There are a thousand ways to caption an image. Contrastive Language Pretraining (CLIP) on the other hand, works by mapping an image and its caption to a single vector -- limiting how well CLIP-like models can represent the diverse ways to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Samuel Lavoie , Polina Kirichenko , Mark Ibrahim , Mahmoud Assran , Andrew Gordon Wilson , Aaron Courville , Nicolas Ballas

Contrastive Language-Image Pre-training (CLIP) has been shown to learn visual representations with great transferability, which achieves promising accuracy for zero-shot classification. To further improve its downstream performance,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Ziyu Guo , Renrui Zhang , Longtian Qiu , Xianzheng Ma , Xupeng Miao , Xuming He , Bin Cui

In the field of vision-language contrastive learning, models such as CLIP capitalize on matched image-caption pairs as positive examples and leverage within-batch non-matching pairs as negatives. This approach has led to remarkable outcomes…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Maxwell Aladago , Lorenzo Torresani , Soroush Vosoughi

Contrastive Language-Image Pre-training (CLIP) has been the cornerstone for zero-shot classification, text-image retrieval, and text-image generation by aligning image and text modalities. Despite its widespread adoption, a significant…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Beichen Zhang , Pan Zhang , Xiaoyi Dong , Yuhang Zang , Jiaqi Wang

Contrastive Language-Image Pre-training (CLIP) models have shown significant potential, particularly in zero-shot classification across diverse distribution shifts. Building on existing evaluations of overall classification robustness, this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Weijie Tu , Weijian Deng , Tom Gedeon

Contrastive Language-Image Pretraining (CLIP) stands out as a prominent method for image representation learning. Various architectures, from vision transformers (ViTs) to convolutional networks (ResNets) have been trained with CLIP to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Cristian Rodriguez-Opazo , Ehsan Abbasnejad , Damien Teney , Hamed Damirchi , Edison Marrese-Taylor , Anton van den Hengel

Beyond the success of Contrastive Language-Image Pre-training (CLIP), recent trends mark a shift toward exploring the applicability of lightweight vision-language models for resource-constrained scenarios. These models often deliver…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Chu Myaet Thwal , Ye Lin Tun , Minh N. H. Nguyen , Eui-Nam Huh , Choong Seon Hong

Contrastive Language-Image Pretraining (CLIP) performs zero-shot image classification by mapping images and textual class representation into a shared embedding space, then retrieving the class closest to the image. This work provides a new…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Fawaz Sammani , Nikos Deligiannis

In rapidly evolving field of vision-language models (VLMs), contrastive language-image pre-training (CLIP) has made significant strides, becoming foundation for various downstream tasks. However, relying on one-to-one (image, text)…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Haicheng Wang , Chen Ju , Weixiong Lin , Shuai Xiao , Mengting Chen , Yixuan Huang , Chang Liu , Mingshuai Yao , Jinsong Lan , Ying Chen , Qingwen Liu , Yanfeng Wang

Contrastive vision-language representation learning has achieved state-of-the-art performance for zero-shot classification, by learning from millions of image-caption pairs crawled from the internet. However, the massive data that powers…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Wenhan Yang , Jingdong Gao , Baharan Mirzasoleiman

Contrastive learning has moved the state of the art for many tasks in computer vision and information retrieval in recent years. This poster is the first work that applies supervised contrastive learning to the task of product matching in…

Machine Learning · Computer Science 2022-05-03 Ralph Peeters , Christian Bizer

Contrastive Language-Image Pre-training (CLIP) achieves promising results in 2D zero-shot and few-shot learning. Despite the impressive performance in 2D, applying CLIP to help the learning in 3D scene understanding has yet to be explored.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Runnan Chen , Youquan Liu , Lingdong Kong , Xinge Zhu , Yuexin Ma , Yikang Li , Yuenan Hou , Yu Qiao , Wenping Wang

CLIP (Contrastive Language-Image Pretraining) is an efficient method for learning computer vision tasks from natural language supervision that has powered a recent breakthrough in deep learning due to its zero-shot transfer capabilities. By…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Arnau Martí Sarri , Victor Rodriguez-Fernandez

We present VideoCLIP, a contrastive approach to pre-train a unified model for zero-shot video and text understanding, without using any labels on downstream tasks. VideoCLIP trains a transformer for video and text by contrasting temporally…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Hu Xu , Gargi Ghosh , Po-Yao Huang , Dmytro Okhonko , Armen Aghajanyan , Florian Metze , Luke Zettlemoyer , Christoph Feichtenhofer

The CLIP (Contrastive Language-Image Pre-training) model and its variants are becoming the de facto backbone in many applications. However, training a CLIP model from hundreds of millions of image-text pairs can be prohibitively expensive.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Liangliang Cao , Bowen Zhang , Chen Chen , Yinfei Yang , Xianzhi Du , Wencong Zhang , Zhiyun Lu , Yantao Zheng

Image-text contrastive learning models such as CLIP have demonstrated strong task transfer ability. The high generality and usability of these visual models is achieved via a web-scale data collection process to ensure broad concept…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Haotian Liu , Kilho Son , Jianwei Yang , Ce Liu , Jianfeng Gao , Yong Jae Lee , Chunyuan Li