English
Related papers

Related papers: Prototypical Contrastive Learning-based CLIP Fine-…

200 papers

We present a comprehensive experimental study on pretrained feature extractors for visual out-of-distribution (OOD) detection, focusing on adapting contrastive language-image pretrained (CLIP) models. Without fine-tuning on the training…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Nikolas Adaloglou , Felix Michels , Tim Kaiser , Markus Kollmann

The contrastive vision-language pre-training, known as CLIP, demonstrates remarkable potential in perceiving open-world visual concepts, enabling effective zero-shot image recognition. Nevertheless, few-shot learning methods based on CLIP…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Cheng Cheng , Lin Song , Ruoyi Xue , Hang Wang , Hongbin Sun , Yixiao Ge , Ying Shan

Contrastive Language-Image Pre-training (CLIP), a simple yet effective pre-training paradigm, successfully introduces text supervision to vision models. It has shown promising results across various tasks due to its generalizability and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Zihao Zhao , Yuxiao Liu , Han Wu , Mei Wang , Yonghao Li , Sheng Wang , Lin Teng , Disheng Liu , Zhiming Cui , Qian Wang , Dinggang Shen

Large-scale natural image-text datasets, especially those automatically collected from the web, often suffer from loose semantic alignment due to weak supervision, while medical datasets tend to have high cross-modal correlation but low…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Shengzhu Yang , Jiawei Du , Shuai Lu , Weihang Zhang , Ningli Wang , Huiqi Li

Contrastive Language-Image Pre-training (CLIP) has drawn increasing attention recently for its transferable visual representation learning. However, due to the semantic gap within datasets, CLIP's pre-trained image-text alignment becomes…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Longtian Qiu , Renrui Zhang , Ziyu Guo , Ziyao Zeng , Zilu Guo , Yafeng Li , Guangnan Zhang

Vision language models have played a key role in extracting meaningful features for various robotic applications. Among these, Contrastive Language-Image Pretraining (CLIP) is widely used in robotic tasks that require both vision and…

Robotics · Computer Science 2024-09-27 Nghia Nguyen , Minh Nhat Vu , Tung D. Ta , Baoru Huang , Thieu Vo , Ngan Le , Anh Nguyen

This paper examines the robustness of a multi-modal computer vision model, CLIP (Contrastive Language-Image Pretraining), in the context of unsupervised learning. The main objective is twofold: first, to evaluate the robustness of CLIP, and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Clement Laroudie , Andrei Bursuc , Mai Lan Ha , Gianni Franchi

Person re-identification (ReID) has recently benefited from large pretrained vision-language models such as Contrastive Language-Image Pre-Training (CLIP). However, the absence of concrete descriptions necessitates the use of implicit text…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Qianru Han , Xinwei He , Zhi Liu , Sannyuya Liu , Ying Zhang , Jinhai Xiang

With the advent of large-scale pre-trained models, interest in adapting and exploiting them for continual learning scenarios has grown. In this paper, we propose an approach to exploiting pre-trained vision-language models (e.g. CLIP) that…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Xialei Liu , Xusheng Cao , Haori Lu , Jia-wen Xiao , Andrew D. Bagdanov , Ming-Ming Cheng

Given a query composed of a reference image and a relative caption, the Composed Image Retrieval goal is to retrieve images visually similar to the reference one that integrates the modifications expressed by the caption. Given that recent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Alberto Baldrati , Marco Bertini , Tiberio Uricchio , Alberto del Bimbo

Beyond the success of Contrastive Language-Image Pre-training (CLIP), recent trends mark a shift toward exploring the applicability of lightweight vision-language models for resource-constrained scenarios. These models often deliver…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Chu Myaet Thwal , Ye Lin Tun , Minh N. H. Nguyen , Eui-Nam Huh , Choong Seon Hong

Contrastive language image pre-training (CLIP) is an essential component of building modern vision-language foundation models. While CLIP demonstrates remarkable zero-shot performance on downstream tasks, the multi-modal feature spaces…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Shin'ya Yamaguchi , Dewei Feng , Sekitoshi Kanai , Kazuki Adachi , Daiki Chijiwa

Contrastive Vision-Language Pre-training, known as CLIP, has provided a new paradigm for learning visual representations by using large-scale contrastive image-text pairs. It shows impressive performance on zero-shot knowledge transfer to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Renrui Zhang , Rongyao Fang , Wei Zhang , Peng Gao , Kunchang Li , Jifeng Dai , Yu Qiao , Hongsheng Li

Contrastive Language-Image Pretraining (CLIP) is widely used to train models to align images and texts in a common embedding space by mapping them to fixed-sized vectors. These models are key to multimodal information retrieval and related…

Self-supervised contrastive learning models, such as CLIP, have set new benchmarks for vision-language models in many downstream tasks. However, their dependency on rigid one-to-one mappings overlooks the complex and often multifaceted…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yiming Zhang , Zhuokai Zhao , Zhaorun Chen , Zhili Feng , Zenghui Ding , Yining Sun

Recent advances in vision language models (VLM) have been driven by contrastive models such as CLIP, which learn to associate visual information with their corresponding text descriptions. However, these models have limitations in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Rim Assouel , Pietro Astolfi , Florian Bordes , Michal Drozdzal , Adriana Romero-Soriano

Unsupervised person re-identification (Re-ID) is a promising and very challenging research problem in computer vision. Learning robust and discriminative features with unlabeled data is of central importance to Re-ID. Recently, more…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Zheng Hu , Chuang Zhu , Gang He

In rapidly evolving field of vision-language models (VLMs), contrastive language-image pre-training (CLIP) has made significant strides, becoming foundation for various downstream tasks. However, relying on one-to-one (image, text)…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Haicheng Wang , Chen Ju , Weixiong Lin , Shuai Xiao , Mengting Chen , Yixuan Huang , Chang Liu , Mingshuai Yao , Jinsong Lan , Ying Chen , Qingwen Liu , Yanfeng Wang

Existing person re-identification (ReID) methods typically directly load the pre-trained ImageNet weights for initialization. However, as a fine-grained classification task, ReID is more challenging and exists a large domain gap between…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Zizheng Yang , Xin Jin , Kecheng Zheng , Feng Zhao

With the emergence of Transformers and Vision-Language Models (VLMs) such as CLIP, fine-tuning large pre-trained models has recently become a prevalent strategy in Continual Learning. This has led to the development of numerous prompting…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Emanuele Frascaroli , Aniello Panariello , Pietro Buzzega , Lorenzo Bonicelli , Angelo Porrello , Simone Calderara