English
Related papers

Related papers: Modeling Caption Diversity in Contrastive Vision-L…

200 papers

Contrastive Language-Image Pretraining (CLIP) has demonstrated strong zero-shot performance across diverse downstream text-image tasks. Existing CLIP methods typically optimize a contrastive objective using negative samples drawn from each…

Machine Learning · Computer Science 2025-10-23 Haotian Sun , Yitong Li , Yuchen Zhuang , Niao He , Hanjun Dai , Bo Dai

Contrastive image-text models such as CLIP form the building blocks of many state-of-the-art systems. While they excel at recognizing common generic concepts, they still struggle on fine-grained entities which are rare, or even absent from…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Ahmet Iscen , Mathilde Caron , Alireza Fathi , Cordelia Schmid

Recent advances in vision language models (VLM) have been driven by contrastive models such as CLIP, which learn to associate visual information with their corresponding text descriptions. However, these models have limitations in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Rim Assouel , Pietro Astolfi , Florian Bordes , Michal Drozdzal , Adriana Romero-Soriano

Large-scale web-crawled datasets are fundamental for the success of pre-training vision-language models, such as CLIP. However, the inherent noise and potential irrelevance of web-crawled AltTexts pose challenges in achieving precise…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Zhengfeng Lai , Haotian Zhang , Bowen Zhang , Wentao Wu , Haoping Bai , Aleksei Timofeev , Xianzhi Du , Zhe Gan , Jiulong Shan , Chen-Nee Chuah , Yinfei Yang , Meng Cao

Vision language models have played a key role in extracting meaningful features for various robotic applications. Among these, Contrastive Language-Image Pretraining (CLIP) is widely used in robotic tasks that require both vision and…

Robotics · Computer Science 2024-09-27 Nghia Nguyen , Minh Nhat Vu , Tung D. Ta , Baoru Huang , Thieu Vo , Ngan Le , Anh Nguyen

Contrastive Language-Image Pre-training (CLIP) represents the latest incarnation of pre-trained vision-language models. Although CLIP has recently shown its superior power on a wide range of downstream vision-language tasks like Visual…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Sinuo Deng , Lifang Wu , Ge Shi , Lehao Xing , Meng Jian , Ye Xiang

Contrastive Language-Image Pretraining (CLIP) has shown impressive zero-shot performance on image classification. However, state-of-the-art methods often rely on fine-tuning techniques like prompt learning and adapter-based tuning to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Ans Munir , Faisal Z. Qureshi , Muhammad Haris Khan , Mohsen Ali

Besides image classification, Contrastive Language-Image Pre-training (CLIP) has accomplished extraordinary success for a wide range of vision tasks, including object-level and 3D space understanding. However, it's still challenging to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Renrui Zhang , Ziyao Zeng , Ziyu Guo , Yafeng Li

Understanding long text is of great demands in practice but beyond the reach of most language-image pre-training (LIP) models. In this work, we empirically confirm that the key reason causing such an issue is that the training images are…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Wei Wu , Kecheng Zheng , Shuailei Ma , Fan Lu , Yuxin Guo , Yifei Zhang , Wei Chen , Qingpei Guo , Yujun Shen , Zheng-Jun Zha

Large-scale cross-modal pre-training paradigms have recently shown ubiquitous success on a wide range of downstream tasks, e.g., zero-shot classification, retrieval and image captioning. However, their successes highly rely on the scale and…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Runhui Huang , Yanxin Long , Jianhua Han , Hang Xu , Xiwen Liang , Chunjing Xu , Xiaodan Liang

Recent advances in contrastive representation learning over paired image-text data have led to models such as CLIP that achieve state-of-the-art performance for zero-shot classification and distributional robustness. Such models typically…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Shashank Goel , Hritik Bansal , Sumit Bhatia , Ryan A. Rossi , Vishwa Vinay , Aditya Grover

Image captioning, a popular topic in computer vision, has achieved substantial progress in recent years. However, the distinctiveness of natural descriptions is often overlooked in previous work. It is closely related to the quality of…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Bo Dai , Dahua Lin

Modern image captioning models are usually trained with text similarity objectives. However, since reference captions in public datasets often describe the most salient common objects, models trained with text similarity objectives tend to…

Computation and Language · Computer Science 2023-03-31 Jaemin Cho , Seunghyun Yoon , Ajinkya Kale , Franck Dernoncourt , Trung Bui , Mohit Bansal

Image recognition has recently witnessed a paradigm shift, where vision-language models are now used to perform few-shot classification based on textual prompts. Among these, the CLIP model has shown remarkable capabilities for zero-shot…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Lorenzo Agnolucci , Alberto Baldrati , Francesco Todino , Federico Becattini , Marco Bertini , Alberto Del Bimbo

The Visual Language Model, known for its robust cross-modal capabilities, has been extensively applied in various computer vision tasks. In this paper, we explore the use of CLIP (Contrastive Language-Image Pretraining), a vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Huazhong Zhao , Lei Qi , Xin Geng

The objective in this paper is to improve the performance of text-to-image retrieval. To this end, we introduce a new framework that can boost the performance of large-scale pre-trained vision-language models, so that they can be used for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Guanqi Zhan , Yuanpei Liu , Kai Han , Weidi Xie , Andrew Zisserman

Contrastive Language-Image Pretraining (CLIP) models are able to capture the semantic relationship of images and texts and have enabled a wide range of applications, from image retrieval to classification. These models are trained with…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Calvin Metzger

In this work, we present an unsupervised method for enhancing an image captioning model (in our case, BLIP2) using reinforcement learning and vision-language models like CLIP and BLIP2-ITM as reward models. The RL-tuned model is able to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Maksim Dzabraev , Alexander Kunitsyn , Andrei Ivaniuta

Contrastive Language-Image Pretraining (CLIP) model has exhibited remarkable efficacy in establishing cross-modal connections between texts and images, yielding impressive performance across a broad spectrum of downstream applications…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Yi Zhang , Ce Zhang , Ke Yu , Yushun Tang , Zhihai He

We propose a novel unsupervised backlit image enhancement method, abbreviated as CLIP-LIT, by exploring the potential of Contrastive Language-Image Pre-Training (CLIP) for pixel-level image enhancement. We show that the open-world CLIP…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Zhexin Liang , Chongyi Li , Shangchen Zhou , Ruicheng Feng , Chen Change Loy