English
Related papers

Related papers: Multi-View and Multi-Scale Alignment for Contrasti…

200 papers

Contrastive Language-Image Pretraining (CLIP) has emerged as a novel paradigm to learn visual models from language supervision. While researchers continue to push the frontier of CLIP, reproducing these works remains challenging. This is…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Yufeng Cui , Lichen Zhao , Feng Liang , Yangguang Li , Jing Shao

Contrastive language image pre-training (CLIP) is an essential component of building modern vision-language foundation models. While CLIP demonstrates remarkable zero-shot performance on downstream tasks, the multi-modal feature spaces…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Shin'ya Yamaguchi , Dewei Feng , Sekitoshi Kanai , Kazuki Adachi , Daiki Chijiwa

Contrastive Language-Image Pre-training (CLIP)~\citep{radford2021learning} has emerged as a pivotal model in computer vision and multimodal learning, achieving state-of-the-art performance at aligning visual and textual representations…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Shaoan Xie , Lingjing Kong , Yujia Zheng , Yu Yao , Zeyu Tang , Eric P. Xing , Guangyi Chen , Kun Zhang

While the Contrastive Language-Image Pretraining(CLIP) model has achieved remarkable success in a variety of downstream vison language understanding tasks, enhancing its capability for fine-grained image-text alignment remains an active…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Yicheng Xiao , Yu Chen , Haoxuan Ma , Jiale Hong , Caorui Li , Lingxiang Wu , Haiyun Guo , Jinqiao Wang

Automated radiology report generation aims to expedite the tedious and error-prone reporting process for radiologists. While recent works have made progress, learning to align medical images and textual findings remains challenging due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Yaxiong Chen , Chuang Du , Chunlei Li , Jingliang Hu , Yilei Shi , Shengwu Xiong , Xiao Xiang Zhu , Lichao Mou

Contrastive Language-Image Pretraining (CLIP) is a popular foundation model, supporting from zero-shot classification, retrieval to encoders for multimodal large language models (MLLMs). Although CLIP is successfully trained on…

Modern Web systems such as social media and e-commerce contain rich contents expressed in images and text. Leveraging information from multi-modalities can improve the performance of machine learning tasks such as classification and…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Huidong Liu , Shaoyuan Xu , Jinmiao Fu , Yang Liu , Ning Xie , Chien-Chih Wang , Bryan Wang , Yi Sun

Accurate human posture classification in images and videos is crucial for automated applications across various fields, including work safety, physical rehabilitation, sports training, or daily assisted living. Recently, multimodal learning…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Andrzej D. Dobrzycki , Ana M. Bernardos , Luca Bergesio , Andrzej Pomirski , Daniel Sáez-Trigueros

Contrastive Language-Image Pre-Training (CLIP) is a popular method for learning multimodal latent spaces with well-organized semantics. Despite its wide range of applications, CLIP's latent space is known to fail at handling complex…

Machine Learning · Computer Science 2026-03-17 Raphi Kang , Yue Song , Georgia Gkioxari , Pietro Perona

Artificial intelligence (AI) shows great potential in assisting radiologists to improve the efficiency and accuracy of medical image interpretation and diagnosis. However, a versatile AI model requires large-scale data and comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Zhongyi Shui , Jianpeng Zhang , Weiwei Cao , Sinuo Wang , Ruizhe Guo , Le Lu , Lin Yang , Xianghua Ye , Tingbo Liang , Qi Zhang , Ling Zhang

Photo search, the task of retrieving images based on textual queries, has witnessed significant advancements with the introduction of CLIP (Contrastive Language-Image Pretraining) model. CLIP leverages a vision-language pre training…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Naresh Kumar Lahajal , Harini S

CLIP (Contrastive Language-Image Pre-training) is a very recent multi-modal model that jointly learns representations of images and texts. The model is trained on a massive amount of English data and shows impressive performance on…

Computation and Language · Computer Science 2021-08-20 Federico Bianchi , Giuseppe Attanasio , Raphael Pisoni , Silvia Terragni , Gabriele Sarti , Sri Lakshmi

Contrastive Language-Image Pre-training (CLIP) has demonstrated outstanding performance in global image understanding and zero-shot transfer through large-scale text-image alignment. However, the core of medical image analysis often lies in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Jiahui Peng , He Yao , Jingwen Li , Yanzhou Su , Sibo Ju , Yujie Lu , Jin Ye , Hongchun Lu , Xue Li , Lincheng Jiang , Min Zhu , Junlong Cheng

Multimodal models, such as the Contrastive Language-Image Pre-training (CLIP) model, have demonstrated remarkable success in aligning visual and linguistic representations. However, these models exhibit limitations when applied to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Hiroshi Sasaki

The success of large-scale contrastive vision-language pretraining (CLIP) has benefited both visual recognition and multimodal content understanding. The concise design brings CLIP the advantage in inference efficiency against other…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Shijie Geng , Jianbo Yuan , Yu Tian , Yuxiao Chen , Yongfeng Zhang

After pre-training on extensive image-text pairs, Contrastive Language-Image Pre-training (CLIP) demonstrates promising performance on a wide variety of benchmarks. However, a substantial volume of multimodal interleaved documents remains…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Tiancheng Gu , Kaicheng Yang , Chaoyi Zhang , Yin Xie , Xiang An , Ziyong Feng , Dongnan Liu , Weidong Cai , Jiankang Deng

X-ray imaging is pivotal in medical diagnostics, offering non-invasive insights into a range of health conditions. Recently, vision-language models, such as the Contrastive Language-Image Pretraining (CLIP) model, have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Xiangyu Sun , Xiaoguang Zou , Yuanquan Wu , Guotai Wang , Shaoting Zhang

Pre-trained Vision-Language Models (VLMs), like CLIP, exhibit strong generalization ability to downstream tasks but struggle in few-shot scenarios. Existing prompting techniques primarily focus on global text and image representations, yet…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Xin Liu , Jiamin Wu , and Wenfei Yang , Xu Zhou , Tianzhu Zhang

Vision-language pre-training like CLIP has shown promising performance on various downstream tasks such as zero-shot image classification and image-text retrieval. Most of the existing CLIP-alike works usually adopt relatively large image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Ying Nie , Wei He , Kai Han , Yehui Tang , Tianyu Guo , Fanyi Du , Yunhe Wang

Contrastive Language-Image Pretraining (CLIP) achieves strong generalization in vision-language tasks by aligning images and texts in a shared embedding space. However, recent findings show that CLIP-like models still underutilize…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Weiheng Zhao , Zilong Huang , Jiashi Feng , Xinggang Wang