English
Related papers

Related papers: Is CLIP ideal? No. Can we fix it? Yes!

200 papers

Despite the success of Vision-Language Models (VLMs) like CLIP in aligning vision and language, their proficiency in detailed, fine-grained visual comprehension remains a key challenge. We present CLIP-IN, a novel framework that bolsters…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Ziteng Wang , Siqi Yang , Limeng Qiao , Lin Ma

Recent efforts have repurposed the Contrastive Language-Image Pre-training (CLIP) model for No-Reference Image Quality Assessment (NR-IQA) by measuring the cosine similarity between the image embedding and textual prompts such as "a good…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Zhicheng Liao , Dongxu Wu , Zhenshan Shi , Sijie Mai , Hanwei Zhu , Lingyu Zhu , Yuncheng Jiang , Baoliang Chen

We introduce MotionCLIP, a 3D human motion auto-encoder featuring a latent embedding that is disentangled, well behaved, and supports highly semantic textual descriptions. MotionCLIP gains its unique power by aligning its latent space with…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Guy Tevet , Brian Gordon , Amir Hertz , Amit H. Bermano , Daniel Cohen-Or

Contrastive Language-Image Pretraining (CLIP) has gained popularity for its remarkable zero-shot capacity. Recent research has focused on developing efficient fine-tuning methods, such as prompt learning and adapter, to enhance CLIP's…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Zhengbo Wang , Jian Liang , Lijun Sheng , Ran He , Zilei Wang , Tieniu Tan

Vision-language models such as CLIP have shown impressive capabilities in aligning images and text, but they often struggle with lengthy and detailed text descriptions due to pre-training on short and concise captions. We present FAST-GOAL…

Artificial Intelligence · Computer Science 2026-05-27 Hyungyu Choi , Young Kyun Jang , Chanho Eom

The continual learning setting aims to learn new tasks over time without forgetting the previous ones. The literature reports several significant efforts to tackle this problem with limited or no access to previous task data. Among such…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Vishal Thengane , Salman Khan , Munawar Hayat , Fahad Khan

CLIP (Contrastive Language-Image Pre-Training) is a multimodal neural network trained on (text, image) pairs to predict the most relevant text caption given an image. It has been used extensively in image generation by connecting its output…

Multimedia · Computer Science 2024-06-04 Zhouyao Xie , Nikhil Yadala , Xinyi Chen , Jing Xi Liu

Measuring the perception of visual content is a long-standing problem in computer vision. Many mathematical models have been developed to evaluate the look or quality of an image. Despite the effectiveness of such tools in quantifying…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Jianyi Wang , Kelvin C. K. Chan , Chen Change Loy

Contrastive Language-Image Pretraining (CLIP) models excel at understanding image-text relationships but struggle with adapting to new data without forgetting prior knowledge. To address this, models are typically fine-tuned using both new…

Machine Learning · Computer Science 2026-05-06 Ryan King , Gang Li , Bobak Mortazavi , Tianbao Yang

Research connecting text and images has recently seen several breakthroughs, with models like CLIP, DALL-E 2, and Stable Diffusion. However, the connection between text and other visual modalities, such as lidar data, has received less…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Georg Hess , Adam Tonderski , Christoffer Petersson , Kalle Åström , Lennart Svensson

Video-text retrieval plays an essential role in multi-modal research and has been widely used in many real-world web applications. The CLIP (Contrastive Language-Image Pre-training), an image-language pre-training model, has demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Huaishao Luo , Lei Ji , Ming Zhong , Yang Chen , Wen Lei , Nan Duan , Tianrui Li

Recent strides in multimodal model development have ignited a paradigm shift in the realm of text-to-image generation. Among these advancements, CLIP stands out as a remarkable achievement which is a sophisticated autoencoder adept at…

Artificial Intelligence · Computer Science 2026-01-07 Abdul Aziz A. B , A. B Abdul Rahim

Methods based on Contrastive Language-Image Pre-training (CLIP) are nowadays extensively used in support of vision-and-language tasks involving remote sensing data, such as cross-modal retrieval. The adaptation of CLIP to this specific…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 João Daniel Silva , Joao Magalhaes , Devis Tuia , Bruno Martins

In this paper, we explore the potential of the Contrastive Language-Image Pretraining (CLIP) model in scene text recognition (STR), and establish a novel Symmetrical Linguistic Feature Distillation framework (named CLIP-OCR) to leverage…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Zixiao Wang , Hongtao Xie , Yuxin Wang , Jianjun Xu , Boqiang Zhang , Yongdong Zhang

Contrastive Language-Image Pre-training (CLIP) models have demonstrated remarkable performance in zero-shot classification tasks, yet their efficacy in handling complex multi-object scenarios remains challenging. This study presents a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Reza Abbasi , Ali Nazari , Aminreza Sefid , Mohammadali Banayeeanzade , Mohammad Hossein Rohban , Mahdieh Soleymani Baghshah

Recent works utilize CLIP to perform the challenging unsupervised semantic segmentation task where only images without annotations are available. However, we observe that when adopting CLIP to such a pixel-level understanding task,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Jingyun Wang , Guoliang Kang

Contrastive vision-language pre-training frameworks such as CLIP have demonstrated impressive zero-shot performance across a range of vision-language tasks. Recent studies have shown that aligning individual text tokens with specific image…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Masaki Kawamura , Nakamasa Inoue , Rintaro Yanagi , Hirokatsu Kataoka , Rio Yokota

Contrastive Language-Image Pretraining (CLIP) has been widely used for crossmodal information retrieval and multimodal understanding tasks. However, CLIP models are mainly optimized for crossmodal vision-language tasks and underperform in…

Contrastive cross-modal models such as CLIP and CLAP aid various vision-language (VL) and audio-language (AL) tasks. However, there has been limited investigation of and improvement in their language encoder, which is the central component…

Computation and Language · Computer Science 2023-10-23 Mengjie Zhao , Junya Ono , Zhi Zhong , Chieh-Hsin Lai , Yuhta Takida , Naoki Murata , Wei-Hsiang Liao , Takashi Shibuya , Hiromi Wakaki , Yuki Mitsufuji

Density ratio estimation is a core concept in statistical machine learning because it provides a unified mechanism for tasks such as importance weighting, divergence estimation, and likelihood-free inference, but its potential in vision and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Fumiya Uchiyama , Rintaro Yanagi , Shohei Taniguchi , Shota Takashiro , Masahiro Suzuki , Hirokatsu Kataoka , Yusuke Iwasawa , Yutaka Matsuo