中文
相关论文

相关论文: CLIP-ReIdent: Contrastive Training for Player Re-I…

200 篇论文

Contrastive Language-Image Pretraining (CLIP) models maximize the mutual information between text and visual modalities to learn representations. This makes the nature of the training data a significant factor in the efficacy of CLIP for…

计算机视觉与模式识别 · 计算机科学 2024-11-06 Maitreya Patel , Abhiram Kusumba , Sheng Cheng , Changhoon Kim , Tejas Gokhale , Chitta Baral , Yezhou Yang

The contrastive vision-language pre-training, known as CLIP, demonstrates remarkable potential in perceiving open-world visual concepts, enabling effective zero-shot image recognition. Nevertheless, few-shot learning methods based on CLIP…

计算机视觉与模式识别 · 计算机科学 2024-01-12 Cheng Cheng , Lin Song , Ruoyi Xue , Hang Wang , Hongbin Sun , Yixiao Ge , Ying Shan

Despite its prevalent use in image-text matching tasks in a zero-shot manner, CLIP has been shown to be highly vulnerable to adversarial perturbations added onto images. Recent studies propose to finetune the vision encoder of CLIP with…

计算机视觉与模式识别 · 计算机科学 2025-03-06 Songlong Xing , Zhengyu Zhao , Nicu Sebe

The Contrastive Language-Image Pre-training (CLIP) Model is a recently proposed large-scale pre-train model which attracts increasing attention in the computer vision community. Benefiting from its gigantic image-text training set, the CLIP…

计算机视觉与模式识别 · 计算机科学 2022-07-21 Yuxuan Ding , Lingqiao Liu , Chunna Tian , Jingyuan Yang , Haoxuan Ding

There are a thousand ways to caption an image. Contrastive Language Pretraining (CLIP) on the other hand, works by mapping an image and its caption to a single vector -- limiting how well CLIP-like models can represent the diverse ways to…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Samuel Lavoie , Polina Kirichenko , Mark Ibrahim , Mahmoud Assran , Andrew Gordon Wilson , Aaron Courville , Nicolas Ballas

Contrastive Language-Image Pre-training (CLIP) has been shown to learn visual representations with great transferability, which achieves promising accuracy for zero-shot classification. To further improve its downstream performance,…

计算机视觉与模式识别 · 计算机科学 2022-12-20 Ziyu Guo , Renrui Zhang , Longtian Qiu , Xianzheng Ma , Xupeng Miao , Xuming He , Bin Cui

In the field of vision-language contrastive learning, models such as CLIP capitalize on matched image-caption pairs as positive examples and leverage within-batch non-matching pairs as negatives. This approach has led to remarkable outcomes…

计算机视觉与模式识别 · 计算机科学 2024-07-02 Maxwell Aladago , Lorenzo Torresani , Soroush Vosoughi

Contrastive Language-Image Pre-training (CLIP) has been the cornerstone for zero-shot classification, text-image retrieval, and text-image generation by aligning image and text modalities. Despite its widespread adoption, a significant…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Beichen Zhang , Pan Zhang , Xiaoyi Dong , Yuhang Zang , Jiaqi Wang

Contrastive Language-Image Pre-training (CLIP) models have shown significant potential, particularly in zero-shot classification across diverse distribution shifts. Building on existing evaluations of overall classification robustness, this…

计算机视觉与模式识别 · 计算机科学 2025-10-06 Weijie Tu , Weijian Deng , Tom Gedeon

Contrastive Language-Image Pretraining (CLIP) stands out as a prominent method for image representation learning. Various architectures, from vision transformers (ViTs) to convolutional networks (ResNets) have been trained with CLIP to…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Cristian Rodriguez-Opazo , Ehsan Abbasnejad , Damien Teney , Hamed Damirchi , Edison Marrese-Taylor , Anton van den Hengel

Beyond the success of Contrastive Language-Image Pre-training (CLIP), recent trends mark a shift toward exploring the applicability of lightweight vision-language models for resource-constrained scenarios. These models often deliver…

计算机视觉与模式识别 · 计算机科学 2025-03-24 Chu Myaet Thwal , Ye Lin Tun , Minh N. H. Nguyen , Eui-Nam Huh , Choong Seon Hong

Contrastive Language-Image Pretraining (CLIP) performs zero-shot image classification by mapping images and textual class representation into a shared embedding space, then retrieving the class closest to the image. This work provides a new…

计算机视觉与模式识别 · 计算机科学 2024-12-19 Fawaz Sammani , Nikos Deligiannis

In rapidly evolving field of vision-language models (VLMs), contrastive language-image pre-training (CLIP) has made significant strides, becoming foundation for various downstream tasks. However, relying on one-to-one (image, text)…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Haicheng Wang , Chen Ju , Weixiong Lin , Shuai Xiao , Mengting Chen , Yixuan Huang , Chang Liu , Mingshuai Yao , Jinsong Lan , Ying Chen , Qingwen Liu , Yanfeng Wang

Contrastive vision-language representation learning has achieved state-of-the-art performance for zero-shot classification, by learning from millions of image-caption pairs crawled from the internet. However, the massive data that powers…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Wenhan Yang , Jingdong Gao , Baharan Mirzasoleiman

Contrastive learning has moved the state of the art for many tasks in computer vision and information retrieval in recent years. This poster is the first work that applies supervised contrastive learning to the task of product matching in…

机器学习 · 计算机科学 2022-05-03 Ralph Peeters , Christian Bizer

Contrastive Language-Image Pre-training (CLIP) achieves promising results in 2D zero-shot and few-shot learning. Despite the impressive performance in 2D, applying CLIP to help the learning in 3D scene understanding has yet to be explored.…

计算机视觉与模式识别 · 计算机科学 2023-04-07 Runnan Chen , Youquan Liu , Lingdong Kong , Xinge Zhu , Yuexin Ma , Yikang Li , Yuenan Hou , Yu Qiao , Wenping Wang

CLIP (Contrastive Language-Image Pretraining) is an efficient method for learning computer vision tasks from natural language supervision that has powered a recent breakthrough in deep learning due to its zero-shot transfer capabilities. By…

计算机视觉与模式识别 · 计算机科学 2021-12-02 Arnau Martí Sarri , Victor Rodriguez-Fernandez

We present VideoCLIP, a contrastive approach to pre-train a unified model for zero-shot video and text understanding, without using any labels on downstream tasks. VideoCLIP trains a transformer for video and text by contrasting temporally…

计算机视觉与模式识别 · 计算机科学 2021-10-04 Hu Xu , Gargi Ghosh , Po-Yao Huang , Dmytro Okhonko , Armen Aghajanyan , Florian Metze , Luke Zettlemoyer , Christoph Feichtenhofer

The CLIP (Contrastive Language-Image Pre-training) model and its variants are becoming the de facto backbone in many applications. However, training a CLIP model from hundreds of millions of image-text pairs can be prohibitively expensive.…

计算机视觉与模式识别 · 计算机科学 2023-05-10 Liangliang Cao , Bowen Zhang , Chen Chen , Yinfei Yang , Xianzhi Du , Wencong Zhang , Zhiyun Lu , Yantao Zheng

Image-text contrastive learning models such as CLIP have demonstrated strong task transfer ability. The high generality and usability of these visual models is achieved via a web-scale data collection process to ensure broad concept…

计算机视觉与模式识别 · 计算机科学 2023-01-18 Haotian Liu , Kilho Son , Jianwei Yang , Ce Liu , Jianfeng Gao , Yong Jae Lee , Chunyuan Li