中文
相关论文

相关论文: Decoupling Template Bias in CLIP: Harnessing Empty…

200 篇论文

Image captioning aims at generating descriptive and meaningful textual descriptions of images, enabling a broad range of vision-language applications. Prior works have demonstrated that harnessing the power of Contrastive Image Language…

计算机视觉与模式识别 · 计算机科学 2024-01-05 Longtian Qiu , Shan Ning , Xuming He

The CLIP (Contrastive Language-Image Pre-training) model and its variants are becoming the de facto backbone in many applications. However, training a CLIP model from hundreds of millions of image-text pairs can be prohibitively expensive.…

计算机视觉与模式识别 · 计算机科学 2023-05-10 Liangliang Cao , Bowen Zhang , Chen Chen , Yinfei Yang , Xianzhi Du , Wencong Zhang , Zhiyun Lu , Yantao Zheng

Contrastive Language-Image Pretraining (CLIP) has demonstrated great zero-shot performance for matching images and text. However, it is still challenging to adapt vision-lanaguage pretrained models like CLIP to compositional image and text…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Kenan Jiang , Xuehai He , Ruize Xu , Xin Eric Wang

Current methods for prompt learning in zeroshot scenarios widely rely on a development set with sufficient human-annotated data to select the best-performing prompt template a posteriori. This is not ideal because in a realworld zero-shot…

计算与语言 · 计算机科学 2023-05-17 Jinghui Lu , Dongsheng Zhu , Weidong Han , Rui Zhao , Brian Mac Namee , Fei Tan

In the field of vision-language contrastive learning, models such as CLIP capitalize on matched image-caption pairs as positive examples and leverage within-batch non-matching pairs as negatives. This approach has led to remarkable outcomes…

计算机视觉与模式识别 · 计算机科学 2024-07-02 Maxwell Aladago , Lorenzo Torresani , Soroush Vosoughi

Current pre-trained vision-language models, such as CLIP, have demonstrated remarkable zero-shot generalization capabilities across various downstream tasks. However, their performance significantly degrades when test inputs exhibit…

计算机视觉与模式识别 · 计算机科学 2024-08-20 Junhui Yin , Xinyu Zhang , Lin Wu , Xiaojie Wang

This paper presents a simple and effective visual prompting method for adapting pre-trained models to downstream recognition tasks. Our method includes two key designs. First, rather than directly adding together the prompt and the image,…

计算机视觉与模式识别 · 计算机科学 2023-03-30 Junyang Wu , Xianhang Li , Chen Wei , Huiyu Wang , Alan Yuille , Yuyin Zhou , Cihang Xie

Contrastive Language-Image Pre-training (CLIP) achieves remarkable performance in various downstream tasks through the alignment of image and text input embeddings and holds great promise for anomaly detection. However, our empirical…

计算机视觉与模式识别 · 计算机科学 2024-07-25 Adam Goodge , Bryan Hooi , Wee Siong Ng

Contrastive Language-Image Pre-training (CLIP) represents the latest incarnation of pre-trained vision-language models. Although CLIP has recently shown its superior power on a wide range of downstream vision-language tasks like Visual…

计算机视觉与模式识别 · 计算机科学 2022-05-31 Sinuo Deng , Lifang Wu , Ge Shi , Lehao Xing , Meng Jian , Ye Xiang

Recent advancements in Contrastive Language-Image Pre-training (CLIP) have demonstrated notable success in self-supervised representation learning across various tasks. However, the existing CLIP-like approaches often demand extensive GPU…

计算机视觉与模式识别 · 计算机科学 2024-07-31 Yuexi Du , Brian Chang , Nicha C. Dvornek

Contrastive Language-Image Pretraining (CLIP) performs zero-shot image classification by mapping images and textual class representation into a shared embedding space, then retrieving the class closest to the image. This work provides a new…

计算机视觉与模式识别 · 计算机科学 2024-12-19 Fawaz Sammani , Nikos Deligiannis

Few-shot segmentation remains challenging due to the limitations of its labeling information for unseen classes. Most previous approaches rely on extracting high-level feature maps from the frozen visual encoder to compute the pixel-wise…

计算机视觉与模式识别 · 计算机科学 2024-05-15 Jin Wang , Bingfeng Zhang , Jian Pang , Honglong Chen , Weifeng Liu

The popularity of Contrastive Language-Image Pre-training (CLIP) has propelled its application to diverse downstream vision tasks. To improve its capacity on downstream tasks, few-shot learning has become a widely-adopted technique.…

计算机视觉与模式识别 · 计算机科学 2023-04-04 Xiangyang Zhu , Renrui Zhang , Bowei He , Aojun Zhou , Dong Wang , Bin Zhao , Peng Gao

The Contrastive Language-Image Pretraining (CLIP) model has been widely used in various downstream vision tasks. The few-shot learning paradigm has been widely adopted to augment its capacity for these tasks. However, current paradigms may…

计算机视觉与模式识别 · 计算机科学 2024-11-22 Jintao Rong , Hao Chen , Linlin Ou , Tianxiao Chen , Xinyi Yu , Yifan Liu

Vision-language models such as CLIP learn a generic text-image embedding from large-scale training data. A vision-language model can be adapted to a new classification task through few-shot prompt tuning. We find that such a prompt tuning…

计算机视觉与模式识别 · 计算机科学 2023-07-25 Cheng-En Wu , Yu Tian , Haichao Yu , Heng Wang , Pedro Morgado , Yu Hen Hu , Linjie Yang

Contrastive Language-Image Pre-training (CLIP) has emerged as a simple yet effective way to train large-scale vision-language models. CLIP demonstrates impressive zero-shot classification and retrieval on diverse downstream tasks. However,…

计算机视觉与模式识别 · 计算机科学 2023-08-16 Vishaal Udandarao , Ankush Gupta , Samuel Albanie

We propose a novel unsupervised backlit image enhancement method, abbreviated as CLIP-LIT, by exploring the potential of Contrastive Language-Image Pre-Training (CLIP) for pixel-level image enhancement. We show that the open-world CLIP…

计算机视觉与模式识别 · 计算机科学 2023-10-02 Zhexin Liang , Chongyi Li , Shangchen Zhou , Ruicheng Feng , Chen Change Loy

Few-shot, fine-grained classification in computer vision poses significant challenges due to the need to differentiate subtle class distinctions with limited data. This paper presents a novel method that enhances the Contrastive…

计算机视觉与模式识别 · 计算机科学 2025-04-24 Eric Brouwer , Jan Erik van Woerden , Gertjan Burghouts , Matias Valdenegro-Toro , Marco Zullich

The application of Contrastive Language-Image Pre-training (CLIP) in Weakly Supervised Semantic Segmentation (WSSS) research powerful cross-modal semantic understanding capabilities. Existing methods attempt to optimize input text prompts…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Zhongxing Xu , Feilong Tang , Zhe Chen , Yingxue Su , Zhiyi Zhao , Ge Zhang , Jionglong Su , Zongyuan Ge

There are a thousand ways to caption an image. Contrastive Language Pretraining (CLIP) on the other hand, works by mapping an image and its caption to a single vector -- limiting how well CLIP-like models can represent the diverse ways to…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Samuel Lavoie , Polina Kirichenko , Mark Ibrahim , Mahmoud Assran , Andrew Gordon Wilson , Aaron Courville , Nicolas Ballas