English
Related papers

Related papers: Supervision Exists Everywhere: A Data Efficient Co…

200 papers

Contrastive language image pretraining (CLIP) is a standard method for training vision-language models. While CLIP is scalable, promptable, and robust to distribution shifts on image classification tasks, it lacks object localization…

We introduce SuperClass, a super simple classification method for vision-language pre-training on image-text data. Unlike its contrastive counterpart CLIP who contrast with a text encoder, SuperClass directly utilizes tokenized raw text as…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Zilong Huang , Qinghao Ye , Bingyi Kang , Jiashi Feng , Haoqi Fan

The continual learning setting aims to learn new tasks over time without forgetting the previous ones. The literature reports several significant efforts to tackle this problem with limited or no access to previous task data. Among such…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Vishal Thengane , Salman Khan , Munawar Hayat , Fahad Khan

The success of large-scale contrastive vision-language pretraining (CLIP) has benefited both visual recognition and multimodal content understanding. The concise design brings CLIP the advantage in inference efficiency against other…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Shijie Geng , Jianbo Yuan , Yu Tian , Yuxiao Chen , Yongfeng Zhang

Contrastive Language-Image Pretraining (CLIP) has gained popularity for its remarkable zero-shot capacity. Recent research has focused on developing efficient fine-tuning methods, such as prompt learning and adapter, to enhance CLIP's…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Zhengbo Wang , Jian Liang , Lijun Sheng , Ran He , Zilei Wang , Tieniu Tan

Contrastive vision-language pre-training frameworks such as CLIP have demonstrated impressive zero-shot performance across a range of vision-language tasks. Recent studies have shown that aligning individual text tokens with specific image…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Masaki Kawamura , Nakamasa Inoue , Rintaro Yanagi , Hirokatsu Kataoka , Rio Yokota

The contrastive vision-language pre-training, known as CLIP, demonstrates remarkable potential in perceiving open-world visual concepts, enabling effective zero-shot image recognition. Nevertheless, few-shot learning methods based on CLIP…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Cheng Cheng , Lin Song , Ruoyi Xue , Hang Wang , Hongbin Sun , Yixiao Ge , Ying Shan

We propose a novel unsupervised backlit image enhancement method, abbreviated as CLIP-LIT, by exploring the potential of Contrastive Language-Image Pre-Training (CLIP) for pixel-level image enhancement. We show that the open-world CLIP…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Zhexin Liang , Chongyi Li , Shangchen Zhou , Ruicheng Feng , Chen Change Loy

Contrastive Language-Image Pre-training (CLIP) has become the standard for cross-modal image-text representation learning. Improving CLIP typically requires additional data and retraining with new loss functions, but these demands raise…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Haonan Wang , Minbin Huang , Runhui Huang , Lanqing Hong , Hang Xu , Tianyang Hu , Xiaodan Liang , Zhenguo Li , Hong Cheng , Kenji Kawaguchi

Deep Learning (DL) is undergoing a paradigm shift with the emergence of foundation models. In this work, we focus on Contrastive Language-Image Pre-training (CLIP), a Vision-Language foundation model that achieves high accuracy across…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Angelos Zavras , Dimitrios Michail , Begüm Demir , Ioannis Papoutsis

CLIP (Contrastive Language-Image Pre-training) has attained great success in pattern recognition and computer vision. Transferring CLIP to downstream tasks (e.g. zero- or few-shot classification) is a hot topic in multimodal learning.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Zhipeng Ye , Feng Jiang , Qiufeng Wang , Kaizhu Huang , Jiaqi Huang

In rapidly evolving field of vision-language models (VLMs), contrastive language-image pre-training (CLIP) has made significant strides, becoming foundation for various downstream tasks. However, relying on one-to-one (image, text)…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Haicheng Wang , Chen Ju , Weixiong Lin , Shuai Xiao , Mengting Chen , Yixuan Huang , Chang Liu , Mingshuai Yao , Jinsong Lan , Ying Chen , Qingwen Liu , Yanfeng Wang

Large-scale but noisy image-text pair data have paved the way for the success of Contrastive Language-Image Pretraining (CLIP). As the foundation vision encoder, CLIP in turn serves as the cornerstone for most large vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Zhixiang Wei , Guangting Wang , Xiaoxiao Ma , Ke Mei , Huaian Chen , Yi Jin , Fengyun Rao

Contrastive Language-Image Pre-training (CLIP) has significantly boosted the performance of various vision-language tasks by scaling up the dataset with image-text pairs collected from the web. However, the presence of intrinsic noise and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Kaicheng Yang , Jiankang Deng , Xiang An , Jiawei Li , Ziyong Feng , Jia Guo , Jing Yang , Tongliang Liu

Contrastive Language-Image Pre-training (CLIP) achieves promising results in 2D zero-shot and few-shot learning. Despite the impressive performance in 2D, applying CLIP to help the learning in 3D scene understanding has yet to be explored.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Runnan Chen , Youquan Liu , Lingdong Kong , Xinge Zhu , Yuexin Ma , Yikang Li , Yuenan Hou , Yu Qiao , Wenping Wang

Contrastive Language Image Pretraining (CLIP) has received widespread attention, since its learned representations can be transferred well to various downstream tasks. During the training process of the CLIP model, the InfoNCE objective…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Delong Chen , Zhao Wu , Fan Liu , Zaiquan Yang , Huaxi Huang , Ying Tan , Erjin Zhou

Contrastive Language-Image Pretraining (CLIP) performs zero-shot image classification by mapping images and textual class representation into a shared embedding space, then retrieving the class closest to the image. This work provides a new…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Fawaz Sammani , Nikos Deligiannis

Contrastive Language-Image Pre-training (CLIP) learns rich representations via readily available supervision of natural language. It improves the performance of downstream vision tasks, including but not limited to the zero-shot, long tail,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yi Li , Hualiang Wang , Yiqun Duan , Hang Xu , Xiaomeng Li

Contrastive vision-language models continue to be the dominant approach for image and text retrieval. Contrastive Language-Image Pre-training (CLIP) trains two neural networks in contrastive manner to align their image and text embeddings…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Kwun Ho Ngan , Saman Sadeghi Afgeh , Joe Townsend , Artur d'Avila Garcez

Existing computer vision research in artwork struggles with artwork's fine-grained attributes recognition and lack of curated annotated datasets due to their costly creation. To the best of our knowledge, we are one of the first methods to…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Marcos V. Conde , Kerem Turgutlu