中文
相关论文

相关论文: Prototypical Contrastive Learning-based CLIP Fine-…

200 篇论文

Photo search, the task of retrieving images based on textual queries, has witnessed significant advancements with the introduction of CLIP (Contrastive Language-Image Pretraining) model. CLIP leverages a vision-language pre training…

计算机视觉与模式识别 · 计算机科学 2024-01-25 Naresh Kumar Lahajal , Harini S

Contrastive language image pretraining (CLIP) is a standard method for training vision-language models. While CLIP is scalable, promptable, and robust to distribution shifts on image classification tasks, it lacks object localization…

Contrastive vision-language models like CLIP have shown great progress in transfer learning. In the inference stage, the proper text description, also known as prompt, needs to be carefully designed to correctly classify the given images.…

计算机视觉与模式识别 · 计算机科学 2022-08-23 Tony Huang , Jack Chu , Fangyun Wei

In this paper we propose a novel modification of Contrastive Language-Image Pre-Training (CLIP) guidance for the task of unsupervised backlit image enhancement. Our work builds on the state-of-the-art CLIP-LIT approach, which learns a…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Tatiana Gaintseva , Martin Benning , Gregory Slabaugh

Continual learning (CL) aims to help deep neural networks learn new knowledge while retaining what has been learned. Owing to their powerful generalizability, pre-trained vision-language models such as Contrastive Language-Image…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Saurav Jha , Dong Gong , Lina Yao

Recent work has shown that self-supervised pre-training leads to improvements over supervised learning on challenging visual recognition tasks. CLIP, an exciting new approach to learning with language supervision, demonstrates promising…

计算机视觉与模式识别 · 计算机科学 2021-12-24 Norman Mu , Alexander Kirillov , David Wagner , Saining Xie

Contrastive Language-Image Pretraining (CLIP) models excel at understanding image-text relationships but struggle with adapting to new data without forgetting prior knowledge. To address this, models are typically fine-tuned using both new…

机器学习 · 计算机科学 2026-05-06 Ryan King , Gang Li , Bobak Mortazavi , Tianbao Yang

Language-image pre-training is an effective technique for learning powerful representations in general domains. However, when directly turning to person representation learning, these general pre-training methods suffer from unsatisfactory…

计算机视觉与模式识别 · 计算机科学 2024-05-30 Jialong Zuo , Jiahao Hong , Feng Zhang , Changqian Yu , Hanyu Zhou , Changxin Gao , Nong Sang , Jingdong Wang

Existing computer vision research in artwork struggles with artwork's fine-grained attributes recognition and lack of curated annotated datasets due to their costly creation. To the best of our knowledge, we are one of the first methods to…

计算机视觉与模式识别 · 计算机科学 2022-05-02 Marcos V. Conde , Kerem Turgutlu

Methods based on Contrastive Language-Image Pre-training (CLIP) are nowadays extensively used in support of vision-and-language tasks involving remote sensing data, such as cross-modal retrieval. The adaptation of CLIP to this specific…

计算机视觉与模式识别 · 计算机科学 2024-11-01 João Daniel Silva , Joao Magalhaes , Devis Tuia , Bruno Martins

Contrastive language-image pretraining (CLIP) using image-text pairs has achieved impressive results on image classification in both zero-shot and transfer learning settings. However, we show that directly applying such models to recognize…

计算机视觉与模式识别 · 计算机科学 2021-12-17 Yiwu Zhong , Jianwei Yang , Pengchuan Zhang , Chunyuan Li , Noel Codella , Liunian Harold Li , Luowei Zhou , Xiyang Dai , Lu Yuan , Yin Li , Jianfeng Gao

Contrastive Language-Image Pre-training (CLIP)~\citep{radford2021learning} has emerged as a pivotal model in computer vision and multimodal learning, achieving state-of-the-art performance at aligning visual and textual representations…

计算机视觉与模式识别 · 计算机科学 2026-04-06 Shaoan Xie , Lingjing Kong , Yujia Zheng , Yu Yao , Zeyu Tang , Eric P. Xing , Guangyi Chen , Kun Zhang

Multi-spectral object re-identification (ReID) brings a new perception perspective for smart city and intelligent transportation applications, effectively addressing challenges from complex illumination and adverse weather. However, complex…

计算机视觉与模式识别 · 计算机科学 2025-05-26 Shihao Li , Chenglong Li , Aihua Zheng , Jin Tang , Bin Luo

Contrastive Language Image Pretraining (CLIP) has received widespread attention, since its learned representations can be transferred well to various downstream tasks. During the training process of the CLIP model, the InfoNCE objective…

计算机视觉与模式识别 · 计算机科学 2023-11-22 Delong Chen , Zhao Wu , Fan Liu , Zaiquan Yang , Huaxi Huang , Ying Tan , Erjin Zhou

Vision-language models, such as contrastive language-image pre-training (CLIP), have demonstrated impressive results in natural image domains. However, these models often struggle when applied to specialized domains like remote sensing, and…

计算机视觉与模式识别 · 计算机科学 2023-10-26 Sangwoo Mo , Minkyu Kim , Kyungmin Lee , Jinwoo Shin

We present RECLIP (Resource-efficient CLIP), a simple method that minimizes computational resource footprint for CLIP (Contrastive Language Image Pretraining). Inspired by the notion of coarse-to-fine in computer vision, we leverage small…

计算机视觉与模式识别 · 计算机科学 2023-09-01 Runze Li , Dahun Kim , Bir Bhanu , Weicheng Kuo

Face recognition is a core task in computer vision designed to identify and authenticate individuals by analyzing facial patterns and features. This field intersects with artificial intelligence image processing and machine learning with…

计算机视觉与模式识别 · 计算机科学 2024-11-21 Nhan T. Luu

Continual learning (CL) enables deep networks to acquire new knowledge while avoiding catastrophic forgetting. The powerful generalization ability of pre-trained models (PTMs), such as the Contrastive Language-Image Pre-training (CLIP)…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Haodong Lu , Xinyu Zhang , Kristen Moore , Jason Xue , Lina Yao , Anton van den Hengel , Dong Gong

We focus on domain and class generalization problems in analyzing optical remote sensing images, using the large-scale pre-trained vision-language model (VLM), CLIP. While contrastively trained VLMs show impressive zero-shot generalization…

计算机视觉与模式识别 · 计算机科学 2023-11-28 Avigyan Bhattacharya , Mainak Singha , Ankit Jha , Biplab Banerjee

The learning objective of vision-language approach of CLIP does not effectively account for the noisy many-to-many correspondences found in web-harvested image captioning datasets, which contributes to its compute and data inefficiency. To…

计算机视觉与模式识别 · 计算机科学 2022-04-12 Alex Andonian , Shixing Chen , Raffay Hamid