English
Related papers

Related papers: Extending CLIP's Image-Text Alignment to Referring…

200 papers

Until recently, the general corpus of CLIP-type fundamental models has widely explored either the retrieval of short descriptions or the classification of objects in the scene as SINGLE-object image classification task. The same holds for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Advik Sinha , Saurabh Atreya , Aashutosh A , Sk Aziz Ali , Abhijit Das

Contrastive Language--Image Pre-training (CLIP) has manifested remarkable improvements in zero-shot classification and cross-modal vision-language tasks. Yet, from a geometrical point of view, the CLIP embedding space has been found to have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Sedigheh Eslami , Gerard de Melo

Contrastive Language-Image Pre-training (CLIP) formulates image classification as an image-to-text matching task, i.e., matching images to the corresponding natural language descriptions instead of discrete category IDs. This allows for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Shuhuai Ren , Lei Li , Xuancheng Ren , Guangxiang Zhao , Xu Sun

Contrastive language-image pre-training (CLIP) is a powerful vision-language model that has shown great benefits for various tasks. However, we have identified some issues with its explainability, which undermine its credibility and limit…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Yi Li , Hualiang Wang , Yiqun Duan , Jiheng Zhang , Xiaomeng Li

CLIP has demonstrated exceptional image-text matching capabilities due to its training on contrastive learning tasks. Past research has suggested that whereas CLIP effectively matches text to images when the matching can be achieved just by…

Computation and Language · Computer Science 2025-09-17 Omri Suissa , Muhiim Ali , Ariana Azarbal , Hui Shen , Shekhar Pradhan

Research connecting text and images has recently seen several breakthroughs, with models like CLIP, DALL-E 2, and Stable Diffusion. However, the connection between text and other visual modalities, such as lidar data, has received less…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Georg Hess , Adam Tonderski , Christoffer Petersson , Kalle Åström , Lennart Svensson

Referring Image Segmentation (RIS) aims to segment the target object in an image given a natural language expression. While recent methods leverage pre-trained vision backbones and more training corpus to achieve impressive results, they…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Zhenjie Mao , Yuhuan Yang , Chaofan Ma , Dongsheng Jiang , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Continual learning of vision-language models (VLMs) focuses on leveraging cross-modal pretrained knowledge to incrementally adapt to expanding downstream tasks and datasets, while tackling the challenge of knowledge forgetting. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Chiyuan He , Zihuan Qiu , Fanman Meng , Linfeng Xu , Qingbo Wu , Hongliang Li

Existing machine learning models demonstrate excellent performance in image object recognition after training on a large-scale dataset under full supervision. However, these models only learn to map an image to a predefined class index,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Kai Han , Xiaohu Huang , Yandong Li , Sagar Vaze , Jie Li , Xuhui Jia

Contrastive Language-Image Pre-training (CLIP) has demonstrated remarkable generalization ability and strong performance across a wide range of vision-language tasks. However, due to the lack of region-level supervision, CLIP exhibits…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Haoxi Zeng , Haoxuan Li , Yi Bin , Pengpeng Zeng , Xing Xu , Yang Yang , Heng Tao Shen

Open-vocabulary semantic segmentation (OVSS) employs pixel-level vision-language alignment to associate category-related prompts with corresponding pixels. A key challenge is enhancing the multimodal dense prediction capability,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Jiahao Li , Yang Lu , Yachao Zhang , Yong Xie , Fangyong Wang , Yuan Xie , Yanyun Qu

The success of large-scale contrastive vision-language pretraining (CLIP) has benefited both visual recognition and multimodal content understanding. The concise design brings CLIP the advantage in inference efficiency against other…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Shijie Geng , Jianbo Yuan , Yu Tian , Yuxiao Chen , Yongfeng Zhang

Recent advancements in pre-trained vision-language models like CLIP have enabled the task of open-vocabulary segmentation. CLIP demonstrates impressive zero-shot capabilities in various downstream tasks that require holistic image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Sule Bai , Yong Liu , Yifei Han , Haoji Zhang , Yansong Tang , Jie Zhou , Jiwen Lu

The evolution of prompt learning methodologies has driven exploration of deeper prompt designs to enhance model performance. However, current deep text prompting approaches suffer from two critical limitations: Over-reliance on constrastive…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Qiqi Zhan , Shiwei Li , Qingjie Liu , Yunhong Wang

Contrastive learning has emerged as an efficient framework to learn multimodal representations. CLIP, a seminal work in this area, achieved impressive results by training on paired image-text data using the contrastive loss. Recent work…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Enrico Fini , Pietro Astolfi , Adriana Romero-Soriano , Jakob Verbeek , Michal Drozdzal

The increase of web-scale weakly labelled image-text pairs have greatly facilitated the development of large-scale vision-language models (e.g., CLIP), which have shown impressive generalization performance over a series of downstream…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Lianyu Hu , Tongkai Shi , Liqing Gao , Zekang Liu , Wei Feng

Localizing desired objects from remote sensing images is of great use in practical applications. Referring image segmentation, which aims at segmenting out the objects to which a given expression refers, has been extensively studied in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhenghang Yuan , Lichao Mou , Yuansheng Hua , Xiao Xiang Zhu

The recently proposed visually grounded speech model SpeechCLIP is an innovative framework that bridges speech and text through images via CLIP without relying on text transcription. On this basis, this paper introduces two extensions to…

Computation and Language · Computer Science 2024-02-13 Hsuan-Fu Wang , Yi-Jen Shih , Heng-Jui Chang , Layne Berry , Puyuan Peng , Hung-yi Lee , Hsin-Min Wang , David Harwath

Contrastive Language-Image Pre-training (CLIP) has been a celebrated method for training vision encoders to generate image/text representations facilitating various applications. Recently, CLIP has been widely adopted as the vision backbone…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Hong-You Chen , Zhengfeng Lai , Haotian Zhang , Xinze Wang , Marcin Eichner , Keen You , Meng Cao , Bowen Zhang , Yinfei Yang , Zhe Gan

Contrastive Language-Image Pre-training (CLIP) has recently shown great promise in pixel-level zero-shot learning tasks. However, existing approaches utilizing CLIP's text and patch embeddings to generate semantic masks often misidentify…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Jingyao Li , Pengguang Chen , Shengju Qian , Shu Liu , Jiaya Jia