English
Related papers

Related papers: A Contrastive Learning Framework Empowered by Atte…

200 papers

Multi-modal semantic understanding requires integrating information from different modalities to extract users' real intention behind words. Most previous work applies a dual-encoder structure to separately encode image and text, but fails…

Computation and Language · Computer Science 2024-03-12 Ming Zhang , Ke Chang , Yunfang Wu

Understanding brain disorders is crucial for accurate clinical diagnosis and treatment. Recent advances in Multimodal Large Language Models (MLLMs) offer a promising approach to interpreting medical images with the support of text…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Jing Zhang , Xiaowei Yu , Yanjun Lyu , Lu Zhang , Tong Chen , Chao Cao , Yan Zhuang , Minheng Chen , Tianming Liu , Dajiang Zhu

Video-text retrieval plays an essential role in multi-modal research and has been widely used in many real-world web applications. The CLIP (Contrastive Language-Image Pre-training), an image-language pre-training model, has demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Huaishao Luo , Lei Ji , Ming Zhong , Yang Chen , Wen Lei , Nan Duan , Tianrui Li

Contrastive Language Image Pre-training (CLIP) has recently demonstrated success across various tasks due to superior feature representation empowered by image-text contrastive learning. However, the instance discrimination method used by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Xiang An , Kaicheng Yang , Xiangzi Dai , Ziyong Feng , Jiankang Deng

Contrastive Language-Image Pre-training (CLIP) has become a cornerstone in multimodal intelligence. However, recent studies discovered that CLIP can only encode one aspect of the feature space, leading to substantial information loss and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Jihai Zhang , Xiaoye Qu , Tong Zhu , Yu Cheng

Contrastive Language-Image Pretraining (CLIP) model has exhibited remarkable efficacy in establishing cross-modal connections between texts and images, yielding impressive performance across a broad spectrum of downstream applications…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Yi Zhang , Ce Zhang , Ke Yu , Yushun Tang , Zhihai He

The Contrastive Language-Image Pre-training (CLIP) has recently shown remarkable generalization on "zero-shot" training and has applied to many downstream tasks. We explore the adaptation of CLIP to achieve a more efficient and generalized…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Qiang Wang , Junlong Du , Ke Yan , Shouhong Ding

Self-Supervised Contrastive Learning has proven effective in deriving high-quality representations from unlabeled data. However, a major challenge that hinders both unimodal and multimodal contrastive learning is feature suppression, a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jihai Zhang , Xiang Lan , Xiaoye Qu , Yu Cheng , Mengling Feng , Bryan Hooi

Adapter-based tuning methods have shown significant potential in transferring knowledge from pre-trained Vision-Language Models to the downstream tasks. However, after reviewing existing adapters, we find they generally fail to fully…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Yumiao Zhao , Bo Jiang , Xiao Wang , Qin Xu , Jin Tang

Multi-Task Learning (MTL) is designed to train multiple correlated tasks simultaneously, thereby enhancing the performance of individual tasks. Typically, a multi-task network structure consists of a shared backbone and task-specific…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Yi Xin , Junlong Du , Qiang Wang , Ke Yan , Shouhong Ding

Significant progress has been achieved on the improvement and downstream usages of the Contrastive Language-Image Pre-training (CLIP) vision-language model, while less attention is paid to the interpretation of CLIP. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Chenyang Zhao , Kun Wang , Janet H. Hsiao , Antoni B. Chan

Contrastive Language-Image Pre-Training (CLIP) is a popular method for learning multimodal latent spaces with well-organized semantics. Despite its wide range of applications, CLIP's latent space is known to fail at handling complex…

Machine Learning · Computer Science 2026-03-17 Raphi Kang , Yue Song , Georgia Gkioxari , Pietro Perona

Recent advancements in Contrastive Language-Image Pre-training (CLIP) have demonstrated notable success in self-supervised representation learning across various tasks. However, the existing CLIP-like approaches often demand extensive GPU…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Yuexi Du , Brian Chang , Nicha C. Dvornek

Photo search, the task of retrieving images based on textual queries, has witnessed significant advancements with the introduction of CLIP (Contrastive Language-Image Pretraining) model. CLIP leverages a vision-language pre training…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Naresh Kumar Lahajal , Harini S

Contrastive language image pretraining (CLIP) is a standard method for training vision-language models. While CLIP is scalable, promptable, and robust to distribution shifts on image classification tasks, it lacks object localization…

There are a thousand ways to caption an image. Contrastive Language Pretraining (CLIP) on the other hand, works by mapping an image and its caption to a single vector -- limiting how well CLIP-like models can represent the diverse ways to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Samuel Lavoie , Polina Kirichenko , Mark Ibrahim , Mahmoud Assran , Andrew Gordon Wilson , Aaron Courville , Nicolas Ballas

Few-shot, fine-grained classification in computer vision poses significant challenges due to the need to differentiate subtle class distinctions with limited data. This paper presents a novel method that enhances the Contrastive…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Eric Brouwer , Jan Erik van Woerden , Gertjan Burghouts , Matias Valdenegro-Toro , Marco Zullich

Recent progress has shown that large-scale pre-training using contrastive image-text pairs can be a promising alternative for high-quality visual representation learning from natural language supervision. Benefiting from a broader source of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yongming Rao , Wenliang Zhao , Guangyi Chen , Yansong Tang , Zheng Zhu , Guan Huang , Jie Zhou , Jiwen Lu

Contrastive Language-Image Pre-Training (CLIP) model excels in traditional person re-identification (ReID) tasks due to its inherent advantage in generating textual descriptions for pedestrian images. However, applying CLIP directly to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Xuan Tan , Xun Gong , Yang Xiang

The rapid growth of visual content consumption across platforms necessitates automated video classification for age-suitability standards like the MPAA rating system (G, PG, PG-13, R). Traditional methods struggle with large labeled data…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Dipta Neogi , Nourash Azmine Chowdhury , Muhammad Rafsan Kabir , Mohammad Ashrafuzzaman Khan
‹ Prev 1 4 5 6 7 8 10 Next ›