English
Related papers

Related papers: Meta-Contrastive Learning for Vision-Language Mode…

200 papers

Prompt learning has recently become a very efficient transfer learning paradigm for Contrastive Language Image Pretraining (CLIP) models. Compared with fine-tuning the entire encoder, prompt learning can obtain highly competitive results by…

Machine Learning · Computer Science 2024-08-30 Guoyizhe Wei , Feng Wang , Anshul Shah , Rama Chellappa

Large-scale natural image-text datasets, especially those automatically collected from the web, often suffer from loose semantic alignment due to weak supervision, while medical datasets tend to have high cross-modal correlation but low…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Shengzhu Yang , Jiawei Du , Shuai Lu , Weihang Zhang , Ningli Wang , Huiqi Li

Recent advances in vision language models (VLM) have been driven by contrastive models such as CLIP, which learn to associate visual information with their corresponding text descriptions. However, these models have limitations in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Rim Assouel , Pietro Astolfi , Florian Bordes , Michal Drozdzal , Adriana Romero-Soriano

We perform a comprehensive benchmarking of contrastive frameworks for learning multimodal representations in the medical domain. Through this study, we aim to answer the following research questions: (i) How transferable are general-domain…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Shuvendu Roy , Yasaman Parhizkar , Franklin Ogidi , Vahid Reza Khazaie , Michael Colacci , Ali Etemad , Elham Dolatabadi , Arash Afkanpour

Contrastive Language-Image Pretraining (CLIP) has achieved remarkable success, leading to rapid advancements in multimodal studies. However, CLIP faces a notable challenge in terms of inefficient data utilization. It relies on a single…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Yu Zhang , Qi Zhang , Zixuan Gong , Yiwei Shi , Yepeng Liu , Duoqian Miao , Yang Liu , Ke Liu , Kun Yi , Wei Fan , Liang Hu , Changwei Wang

Contrastive language image pretraining (CLIP) is a standard method for training vision-language models. While CLIP is scalable, promptable, and robust to distribution shifts on image classification tasks, it lacks object localization…

In recent years, object detection has shown impressive results using supervised deep learning, but it remains challenging in a cross-domain environment. The variations of illumination, style, scale, and appearance in different domains can…

Computer Vision and Pattern Recognition · Computer Science 2019-08-12 Rongchang Xie , Fei Yu , Jiachao Wang , Yizhou Wang , Li Zhang

Recent advancements in machine learning (ML), natural language processing (NLP), and foundational models have shown promise for real-life applications in critical, albeit compute-constrainted fields like healthcare. In such areas, combining…

Machine Learning · Computer Science 2025-02-05 Georgios Margaritis , Periklis Petridis , Dimitris J. Bertsimas

Recent advances have been witnessed in audio-language joint learning, such as CLAP, that shows much success in multi-modal understanding tasks. These models usually aggregate uni-modal local representations, namely frame or word features,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-16 Yiming Li , Zhifang Guo , Xiangdong Wang , Hong Liu

Contrastive Language-Image Pre-training (CLIP)~\citep{radford2021learning} has emerged as a pivotal model in computer vision and multimodal learning, achieving state-of-the-art performance at aligning visual and textual representations…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Shaoan Xie , Lingjing Kong , Yujia Zheng , Yu Yao , Zeyu Tang , Eric P. Xing , Guangyi Chen , Kun Zhang

Open-Set Domain Adaptation (OSDA) confronts the dual challenge of aligning known-class distributions across domains while identifying target-domain-specific unknown categories. Current approaches often fail to leverage semantic…

Machine Learning · Computer Science 2025-05-21 Haoyang Chen

As machine learning evolves, domain generalization (DG) and domain adaptation (DA) have become crucial for enhancing model robustness across diverse environments. Contrastive Language-Image Pretraining (CLIP) plays a significant role in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Jindong Li , Yongguang Li , Yali Fu , Jiahong Liu , Yixin Liu , Menglin Yang , Irwin King

Cross-modal retrieval is the task of retrieving samples of a given modality by using queries of a different one. Due to the wide range of practical applications, the problem has been mainly focused on the vision and language case, e.g. text…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Jorge Sánchez , Rodrigo Laguna

The application of Contrastive Language-Image Pre-training (CLIP) in Weakly Supervised Semantic Segmentation (WSSS) research powerful cross-modal semantic understanding capabilities. Existing methods attempt to optimize input text prompts…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Zhongxing Xu , Feilong Tang , Zhe Chen , Yingxue Su , Zhiyi Zhao , Ge Zhang , Jionglong Su , Zongyuan Ge

Video topic segmentation unveils the coarse-grained semantic structure underlying videos and is essential for other video understanding tasks. Given the recent surge in multi-modal, relying solely on a single modality is arguably…

Multimodal learning has recently gained significant popularity, demonstrating impressive performance across various zero-shot classification tasks and a range of perceptive and generative applications. Models such as Contrastive…

Machine Learning · Computer Science 2026-02-16 Can Yaras , Siyi Chen , Peng Wang , Qing Qu

Contrastive Language-Image Pre-training, benefiting from large-scale unlabeled text-image pairs, has demonstrated great performance in open-world vision understanding tasks. However, due to the limited Text-3D data pairs, adapting the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yihan Zeng , Chenhan Jiang , Jiageng Mao , Jianhua Han , Chaoqiang Ye , Qingqiu Huang , Dit-Yan Yeung , Zhen Yang , Xiaodan Liang , Hang Xu

Deep learning models for dermatological image analysis remain sensitive to acquisition variability and domain-specific visual characteristics, leading to performance degradation when deployed in clinical settings. We investigate how visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Rodrigo Mota , Kelvin Cunha , Emanoel dos Santos , Fábio Papais , Francisco Filho , Thales Bezerra , Erico Medeiros , Paulo Borba , Tsang Ing Ren

Adopting contrastive image-text pretrained models like CLIP towards video classification has gained attention due to its cost-effectiveness and competitive performance. However, recent works in this area face a trade-off. Finetuning the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Syed Talal Wasim , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan , Mubarak Shah

In this work, we propose CLUDA, a simple, yet novel method for performing unsupervised domain adaptation (UDA) for semantic segmentation by incorporating contrastive losses into a student-teacher learning paradigm, that makes use of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Midhun Vayyat , Jaswin Kasi , Anuraag Bhattacharya , Shuaib Ahmed , Rahul Tallamraju