中文
相关论文

相关论文: Tip-Adapter: Training-free CLIP-Adapter for Better…

200 篇论文

We introduce ProLIP, a simple and architecture-agnostic method for adapting contrastively pretrained vision-language models, such as CLIP, to few-shot classification. ProLIP fine-tunes the vision encoder's projection matrix with Frobenius…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Mohammad Fahes , Tuan-Hung Vu , Andrei Bursuc , Patrick Pérez , Raoul de Charette

Despite significant results achieved by Contrastive Language-Image Pretraining (CLIP) in zero-shot image recognition, limited effort has been made exploring its potential for zero-shot video recognition. This paper presents Open-VCLIP++, a…

计算机视觉与模式识别 · 计算机科学 2023-10-10 Zuxuan Wu , Zejia Weng , Wujian Peng , Xitong Yang , Ang Li , Larry S. Davis , Yu-Gang Jiang

Pre-training across 3D vision and language remains under development because of limited training data. Recent works attempt to transfer vision-language pre-training models to 3D vision. PointCLIP converts point cloud data to multi-view…

计算机视觉与模式识别 · 计算机科学 2023-08-24 Tianyu Huang , Bowen Dong , Yunhan Yang , Xiaoshui Huang , Rynson W. H. Lau , Wanli Ouyang , Wangmeng Zuo

Contrastive language-image pre-training, CLIP for short, has gained increasing attention for its potential in various scenarios. In this paper, we propose EVA-CLIP, a series of models that significantly improve the efficiency and…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Quan Sun , Yuxin Fang , Ledell Wu , Xinlong Wang , Yue Cao

This work aims to adapt large-scale pre-trained vision-language models, such as contrastive language-image pretraining (CLIP), to enhance the performance of object reidentification (Re-ID) across various supervision settings. Although…

计算机视觉与模式识别 · 计算机科学 2026-01-15 Jiachen Li , Xiaojin Gong

Contrastive Vision-Language Pre-training(CLIP) demonstrates impressive zero-shot capability. The key to improve the adaptation of CLIP to downstream task with few exemplars lies in how to effectively model and transfer the useful knowledge…

计算机视觉与模式识别 · 计算机科学 2024-07-01 Cilin Yan , Haochen Wang , Xiaolong Jiang , Yao Hu , Xu Tang , Guoliang Kang , Efstratios Gavves

Contrastive vision-language models like CLIP have shown great progress in transfer learning. In the inference stage, the proper text description, also known as prompt, needs to be carefully designed to correctly classify the given images.…

计算机视觉与模式识别 · 计算机科学 2022-08-23 Tony Huang , Jack Chu , Fangyun Wei

Large vision-language representation learning models like CLIP have demonstrated impressive performance for zero-shot transfer to downstream tasks while largely benefiting from inter-modal (image-text) alignment via contrastive objectives.…

计算机视觉与模式识别 · 计算机科学 2023-11-16 Muhammad Waleed Gondal , Jochen Gast , Inigo Alonso Ruiz , Richard Droste , Tommaso Macri , Suren Kumar , Luitpold Staudigl

Although massive pre-trained vision-language models like CLIP show impressive generalization capabilities for many tasks, still it often remains necessary to fine-tune them for improved performance on specific datasets. When doing so, it is…

计算机视觉与模式识别 · 计算机科学 2022-12-14 Moritz Ibing , Isaak Lim , Leif Kobbelt

Recently, zero-shot and few-shot learning via Contrastive Vision-Language Pre-training (CLIP) have shown inspirational performance on 2D visual recognition, which learns to match images with their corresponding texts in open-vocabulary…

计算机视觉与模式识别 · 计算机科学 2021-12-07 Renrui Zhang , Ziyu Guo , Wei Zhang , Kunchang Li , Xupeng Miao , Bin Cui , Yu Qiao , Peng Gao , Hongsheng Li

The Contrastive Language-Image Pre-training (CLIP) Model is a recently proposed large-scale pre-train model which attracts increasing attention in the computer vision community. Benefiting from its gigantic image-text training set, the CLIP…

计算机视觉与模式识别 · 计算机科学 2022-07-21 Yuxuan Ding , Lingqiao Liu , Chunna Tian , Jingyuan Yang , Haoxuan Ding

Contrastive Language-Image Pre-training (CLIP) has significantly boosted the performance of various vision-language tasks by scaling up the dataset with image-text pairs collected from the web. However, the presence of intrinsic noise and…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Kaicheng Yang , Jiankang Deng , Xiang An , Jiawei Li , Ziyong Feng , Jia Guo , Jing Yang , Tongliang Liu

Few-shot image classification remains difficult under limited supervision and visual domain shift. Recent cache-based adaptation approaches (e.g., Tip-Adapter) address this challenge to some extent by learning lightweight residual adapters…

计算机视觉与模式识别 · 计算机科学 2025-12-16 Tasweer Ahmad , Arindam Sikdar , Sandip Pradhan , Ardhendu Behera

Visual language models like Contrastive Language-Image Pretraining (CLIP) have shown impressive performance in analyzing natural images with language information. However, these models often encounter challenges when applied to specialized…

计算机视觉与模式识别 · 计算机科学 2024-12-11 Jiaqing Zhang , Mingxiang Cao , Xue Yang , Kai Jiang , Yunsong Li

Contrastive language-image pre-training (CLIP) serves as a de-facto standard to align images and texts. Nonetheless, the loose correlation between images and texts of web-crawled data renders the contrastive objective data inefficient and…

计算机视觉与模式识别 · 计算机科学 2022-10-18 Jinghao Zhou , Li Dong , Zhe Gan , Lijuan Wang , Furu Wei

Large pre-trained vision-language models like CLIP have shown great potential in learning representations that are transferable across a wide range of downstream tasks. Different from the traditional representation learning that is based…

计算机视觉与模式识别 · 计算机科学 2022-10-07 Kaiyang Zhou , Jingkang Yang , Chen Change Loy , Ziwei Liu

Video understanding has shown remarkable improvements in recent years, largely dependent on the availability of large scaled labeled datasets. Recent advancements in visual-language models, especially based on contrastive pretraining, have…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Shreyank N Gowda , Boyan Gao , Xiao Gu , Xiaobo Jin

Contrastive Language-Image Pre-training (CLIP) has become a promising language-supervised visual pre-training framework. This paper aims to distill small CLIP models supervised by a large teacher CLIP model. We propose several distillation…

计算机视觉与模式识别 · 计算机科学 2024-05-08 Chuanguang Yang , Zhulin An , Libo Huang , Junyu Bi , Xinqiang Yu , Han Yang , Boyu Diao , Yongjun Xu

Contrastive language-image pretraining (CLIP) links vision and language modalities into a unified embedding space, yielding the tremendous potential for vision-language (VL) tasks. While early concurrent works have begun to study this…

计算机视觉与模式识别 · 计算机科学 2023-01-02 Zhecan Wang , Noel Codella , Yen-Chun Chen , Luowei Zhou , Jianwei Yang , Xiyang Dai , Bin Xiao , Haoxuan You , Shih-Fu Chang , Lu Yuan

Recent work has shown that self-supervised pre-training leads to improvements over supervised learning on challenging visual recognition tasks. CLIP, an exciting new approach to learning with language supervision, demonstrates promising…

计算机视觉与模式识别 · 计算机科学 2021-12-24 Norman Mu , Alexander Kirillov , David Wagner , Saining Xie