中文
相关论文

相关论文: ReCLIP: Refine Contrastive Language Image Pre-Trai…

200 篇论文

Training a referring expression comprehension (ReC) model for a new visual domain requires collecting referring expressions, and potentially corresponding bounding boxes, for images in the domain. While large-scale pre-trained models are…

计算机视觉与模式识别 · 计算机科学 2022-05-04 Sanjay Subramanian , William Merrill , Trevor Darrell , Matt Gardner , Sameer Singh , Anna Rohrbach

Vision-language models, such as contrastive language-image pre-training (CLIP), have demonstrated impressive results in natural image domains. However, these models often struggle when applied to specialized domains like remote sensing, and…

计算机视觉与模式识别 · 计算机科学 2023-10-26 Sangwoo Mo , Minkyu Kim , Kyungmin Lee , Jinwoo Shin

In recent studies on domain adaptation, significant emphasis has been placed on the advancement of learning shared knowledge from a source domain to a target domain. Recently, the large vision-language pre-trained model, i.e., CLIP has…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Ruoyu Feng , Tao Yu , Xin Jin , Xiaoyuan Yu , Lei Xiao , Zhibo Chen

Contrastive Language-Image Pretraining (CLIP) achieves strong generalization in vision-language tasks by aligning images and texts in a shared embedding space. However, recent findings show that CLIP-like models still underutilize…

计算机视觉与模式识别 · 计算机科学 2025-12-17 Weiheng Zhao , Zilong Huang , Jiashi Feng , Xinggang Wang

Contrastive language-image pretraining (CLIP) using image-text pairs has achieved impressive results on image classification in both zero-shot and transfer learning settings. However, we show that directly applying such models to recognize…

计算机视觉与模式识别 · 计算机科学 2021-12-17 Yiwu Zhong , Jianwei Yang , Pengchuan Zhang , Chunyuan Li , Noel Codella , Liunian Harold Li , Luowei Zhou , Xiyang Dai , Lu Yuan , Yin Li , Jianfeng Gao

We present RECLIP (Resource-efficient CLIP), a simple method that minimizes computational resource footprint for CLIP (Contrastive Language Image Pretraining). Inspired by the notion of coarse-to-fine in computer vision, we leverage small…

计算机视觉与模式识别 · 计算机科学 2023-09-01 Runze Li , Dahun Kim , Bir Bhanu , Weicheng Kuo

Contrastive language image pre-training (CLIP) is an essential component of building modern vision-language foundation models. While CLIP demonstrates remarkable zero-shot performance on downstream tasks, the multi-modal feature spaces…

计算机视觉与模式识别 · 计算机科学 2025-04-18 Shin'ya Yamaguchi , Dewei Feng , Sekitoshi Kanai , Kazuki Adachi , Daiki Chijiwa

Contrastive Language-Image Pre-training (CLIP) has made a remarkable breakthrough in open-vocabulary zero-shot image recognition. Many recent studies leverage the pre-trained CLIP models for image-level classification and manipulation. In…

计算机视觉与模式识别 · 计算机科学 2022-07-28 Chong Zhou , Chen Change Loy , Bo Dai

Fine-tuning vision-language models (VLMs) like CLIP to downstream tasks is often necessary to optimize their performance. However, a major obstacle is the limited availability of labeled data. We study the use of pseudolabels, i.e.,…

计算机视觉与模式识别 · 计算机科学 2024-03-11 Cristina Menghini , Andrew Delworth , Stephen H. Bach

Recently, large-scale Contrastive Language-Image Pre-training (CLIP) has attracted unprecedented attention for its impressive zero-shot recognition ability and excellent transferability to downstream tasks. However, CLIP is quite…

计算机视觉与模式识别 · 计算机科学 2022-03-15 Yangguang Li , Feng Liang , Lichen Zhao , Yufeng Cui , Wanli Ouyang , Jing Shao , Fengwei Yu , Junjie Yan

Contrastive language image pretraining (CLIP) is a standard method for training vision-language models. While CLIP is scalable, promptable, and robust to distribution shifts on image classification tasks, it lacks object localization…

Contrastive Language-Image Pre-training (CLIP) on large-scale image-caption datasets learns representations that can achieve remarkable zero-shot generalization. However, such models require a massive amount of pre-training data. Improving…

计算机视觉与模式识别 · 计算机科学 2024-03-21 Siddharth Joshi , Arnav Jain , Ali Payani , Baharan Mirzasoleiman

Visual language models like Contrastive Language-Image Pretraining (CLIP) have shown impressive performance in analyzing natural images with language information. However, these models often encounter challenges when applied to specialized…

计算机视觉与模式识别 · 计算机科学 2024-12-11 Jiaqing Zhang , Mingxiang Cao , Xue Yang , Kai Jiang , Yunsong Li

Methods based on Contrastive Language-Image Pre-training (CLIP) are nowadays extensively used in support of vision-and-language tasks involving remote sensing data, such as cross-modal retrieval. The adaptation of CLIP to this specific…

计算机视觉与模式识别 · 计算机科学 2024-11-01 João Daniel Silva , Joao Magalhaes , Devis Tuia , Bruno Martins

Although deep learning models have shown impressive performance on supervised learning tasks, they often struggle to generalize well when the training (source) and test (target) domains differ. Unsupervised domain adaptation (DA) has…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Mainak Singha , Harsh Pal , Ankit Jha , Biplab Banerjee

Contrastive Language-Image Pre-training (CLIP) stands as one of the most effective and scalable methods for training transferable vision models using paired image and text data. CLIP models are trained using contrastive loss, which…

计算机视觉与模式识别 · 计算机科学 2023-10-31 Lijie Fan , Dilip Krishnan , Phillip Isola , Dina Katabi , Yonglong Tian

Vision-language models, such as CLIP, have shown impressive generalization capacities when using appropriate text descriptions. While optimizing prompts on downstream labeled data has proven effective in improving performance, these methods…

计算机视觉与模式识别 · 计算机科学 2024-10-28 Xingyu Zhu , Beier Zhu , Yi Tan , Shuo Wang , Yanbin Hao , Hanwang Zhang

Treating texts as images, combining prompts with textual labels for prompt tuning, and leveraging the alignment properties of CLIP have been successfully applied in zero-shot multi-label image recognition. Nonetheless, relying solely on…

计算机视觉与模式识别 · 计算机科学 2024-07-09 Haonan Xu , Dian Chao , Xiangyu Wu , Zhonghua Wan , Yang Yang

Unsupervised domain adaption (UDA) has emerged as a popular solution to tackle the divergence between the labeled source and unlabeled target domains. Recently, some research efforts have been made to leverage large vision-language models,…

计算机视觉与模式识别 · 计算机科学 2024-07-03 Jinjing Zhu , Yucheng Chen , Lin Wang

Capitalizing on vast amount of image-text data, large-scale vision-language pre-training has demonstrated remarkable zero-shot capabilities and has been utilized in several applications. However, models trained on general everyday…

计算机视觉与模式识别 · 计算机科学 2024-10-03 Umair Nawaz , Muhammad Awais , Hanan Gani , Muzammal Naseer , Fahad Khan , Salman Khan , Rao Muhammad Anwer
‹ 上一页 1 2 3 10 下一页 ›