English
Related papers

Related papers: HiCLIP: Contrastive Language-Image Pretraining wit…

200 papers

Recent multimodal models such as Contrastive Language-Image Pre-training (CLIP) have shown remarkable ability to align visual and linguistic representations. However, domains where small visual differences carry large semantic significance,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Hiroshi Sasaki

Vision language models have played a key role in extracting meaningful features for various robotic applications. Among these, Contrastive Language-Image Pretraining (CLIP) is widely used in robotic tasks that require both vision and…

Robotics · Computer Science 2024-09-27 Nghia Nguyen , Minh Nhat Vu , Tung D. Ta , Baoru Huang , Thieu Vo , Ngan Le , Anh Nguyen

The recent contrastive language-image pre-training (CLIP) model has shown great success in a wide range of image-level tasks, revealing remarkable ability for learning powerful visual representations with rich semantics. An open and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Peng Wu , Xuerong Zhou , Guansong Pang , Lingru Zhou , Qingsen Yan , Peng Wang , Yanning Zhang

The dream of instantly creating rich 360-degree panoramic worlds from text is rapidly becoming a reality, yet a crucial gap exists in our ability to reliably evaluate their semantic alignment. Contrastive Language-Image Pre-training (CLIP)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Hai Wang , Xiaochen Yang , Mingzhi Dong , Jing-Hao Xue

Severe data imbalance naturally exists among web-scale vision-language datasets. Despite this, we find CLIP pre-trained thereupon exhibits notable robustness to the data imbalance compared to supervised learning, and demonstrates…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Xin Wen , Bingchen Zhao , Yilun Chen , Jiangmiao Pang , Xiaojuan Qi

Contrastive image-text models such as CLIP form the building blocks of many state-of-the-art systems. While they excel at recognizing common generic concepts, they still struggle on fine-grained entities which are rare, or even absent from…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Ahmet Iscen , Mathilde Caron , Alireza Fathi , Cordelia Schmid

Continual learning (CL) aims to help deep neural networks learn new knowledge while retaining what has been learned. Owing to their powerful generalizability, pre-trained vision-language models such as Contrastive Language-Image…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Saurav Jha , Dong Gong , Lina Yao

Contrastive Language-Image Pretraining (CLIP) has demonstrated strong zero-shot performance across diverse downstream text-image tasks. Existing CLIP methods typically optimize a contrastive objective using negative samples drawn from each…

Machine Learning · Computer Science 2025-10-23 Haotian Sun , Yitong Li , Yuchen Zhuang , Niao He , Hanjun Dai , Bo Dai

Contrastive Vision-Language Pre-training, known as CLIP, has provided a new paradigm for learning visual representations by using large-scale contrastive image-text pairs. It shows impressive performance on zero-shot knowledge transfer to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Renrui Zhang , Rongyao Fang , Wei Zhang , Peng Gao , Kunchang Li , Jifeng Dai , Yu Qiao , Hongsheng Li

During the preceding biennium, vision-language pre-training has achieved noteworthy success on several downstream tasks. Nevertheless, acquiring high-quality image-text pairs, where the pairs are entirely exclusive of each other, remains a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Yuting Gao , Jinfeng Liu , Zihan Xu , Tong Wu Enwei Zhang , Wei Liu , Jie Yang , Ke Li , Xing Sun

Contrastive Language-Image Pre-training (CLIP) demonstrates strong potential in medical image analysis but requires substantial data and computational resources. Due to these restrictions, existing CLIP applications in medical imaging focus…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yuexi Du , John Onofrey , Nicha C. Dvornek

Vision-language models like CLIP are widely used in zero-shot image classification due to their ability to understand various visual concepts and natural language descriptions. However, how to fully leverage CLIP's unprecedented human-like…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Bang An , Sicheng Zhu , Michael-Andrei Panaitescu-Liess , Chaithanya Kumar Mummadi , Furong Huang

Conventional object detectors rely on cross-entropy classification, which can be vulnerable to class imbalance and label noise. We propose CLIP-Joint-Detect, a simple and detector-agnostic framework that integrates CLIP-style contrastive…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Behnam Raoufi , Hossein Sharify , Mohamad Mahdee Ramezanee , Khosrow Hajsadeghi , Saeed Bagheri Shouraki

Vision-language models (VLMs), such as CLIP, have demonstrated exceptional generalization capabilities and can quickly adapt to downstream tasks through prompt fine-tuning. Unfortunately, in classification tasks involving non-training…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Song-Lin Lv , Yu-Yang Chen , Zhi Zhou , Yu-Feng Li , Lan-Zhe Guo

Recent advances in vision-language models (VLMs) have made significant progress in downstream tasks that require quantitative concepts such as facial age estimation and image quality assessment, enabling VLMs to explore applications like…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Wei-Hsiang Yu , Yen-Yu Lin , Ming-Hsuan Yang , Yi-Hsuan Tsai

Vision-Language Models (VLMs), such as CLIP, exhibit strong image-text comprehension abilities, facilitating advances in several downstream tasks such as zero-shot image classification, image-text retrieval, and text-to-image generation.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Le Zhang , Rabiul Awal , Aishwarya Agrawal

We propose Domain-Conditioned Meta-Contrastive Learning, a framework for improving the cross-domain generalization of vision-language models. While contrastive models such as CLIP achieve strong performance through large-scale training,…

Optimization and Control · Mathematics 2026-03-31 Merham Fouladvand , Peuroly Batra

Contrastive language-image pre-training (CLIP) models have demonstrated considerable success across various vision-language tasks, such as text-to-image retrieval, where the model is required to effectively process natural language input to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Hyunjae Kim , Seunghyun Yoon , Trung Bui , Handong Zhao , Quan Tran , Franck Dernoncourt , Jaewoo Kang

As a general-purpose vision-language pretraining model, CLIP demonstrates strong generalization ability in image-text alignment tasks and has been widely adopted in downstream applications such as image classification and image-text…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Kuanrong Liu , Siyuan Liang , Cheng Qian , Ming Zhang , Xiaochun Cao

Contrastive Language-Image Pretraining (CLIP) models excel at understanding image-text relationships but struggle with adapting to new data without forgetting prior knowledge. To address this, models are typically fine-tuned using both new…

Machine Learning · Computer Science 2026-05-06 Ryan King , Gang Li , Bobak Mortazavi , Tianbao Yang