English
Related papers

Related papers: Generalized Contrastive Learning for Universal Mul…

200 papers

Contrastive Language and Image Pairing (CLIP), a transformative method in multimedia retrieval, typically trains two neural networks concurrently to generate joint embeddings for text and image pairs. However, when applied directly, these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Konstantin Schall , Kai Uwe Barthel , Nico Hezel , Klaus Jung

Existing vision-text contrastive learning like CLIP aims to match the paired image and caption embeddings while pushing others apart, which improves representation transferability and supports zero-shot prediction. However, medical…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Zifeng Wang , Zhenbang Wu , Dinesh Agarwal , Jimeng Sun

General Continual Learning (GCL) aims at learning from non independent and identically distributed stream data without catastrophic forgetting of the old tasks that don't rely on task boundaries during both training and testing stages. We…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Zhong Ji , Jin Li , Qiang Wang , Zhongfei Zhang

Graph contrastive learning (GCL) aims to align the positive features while differentiating the negative features in the latent space by minimizing a pair-wise contrastive loss. As the embodiment of an outstanding discriminative unsupervised…

Machine Learning · Computer Science 2023-12-27 Jiangmeng Li , Yifan Jin , Hang Gao , Wenwen Qiang , Changwen Zheng , Fuchun Sun

Self-supervised contrastive learning (SSCL) has recently demonstrated superiority in multiple downstream tasks. In this paper, we generalize the standard SSCL methods to a Generalized Learning Framework (GLF) consisting of two parts: the…

Machine Learning · Computer Science 2025-08-20 Lingyu Si , Jingyao Wang , Wenwen Qiang

The Contrastive Language-Image Pre-training (CLIP) framework has become a widely used approach for multimodal representation learning, particularly in image-text retrieval and clustering. However, its efficacy is constrained by three key…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Tiancheng Gu , Kaicheng Yang , Ziyong Feng , Xingjun Wang , Yanzhao Zhang , Dingkun Long , Yingda Chen , Weidong Cai , Jiankang Deng

A good clustering algorithm can discover natural groupings in data. These groupings, if used wisely, provide a form of weak supervision for learning representations. In this work, we present Clustering-based Contrastive Learning (CCL), a…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Vivek Sharma , Makarand Tapaswi , M. Saquib Sarfraz , Rainer Stiefelhagen

The classification of medical images is a pivotal aspect of disease diagnosis, often enhanced by deep learning techniques. However, traditional approaches typically focus on unimodal medical image data, neglecting the integration of diverse…

Image and Video Processing · Electrical Eng. & Systems 2025-11-11 Jun-En Ding , Chien-Chin Hsu , Chi-Hsiang Chu , Shuqiang Wang , Feng Liu

Matrix completion is a widely adopted framework in recommender systems, as predicting the missing entries in the user-item rating matrix enables a comprehensive understanding of user preferences. However, current graph neural network…

Information Retrieval · Computer Science 2025-06-13 Narges Nemati , Mostafa Haghir Chehreghani

Attributed graph clustering holds significant importance in modern data analysis. However, due to the complexity of graph data and the heterogeneity of node attributes, leveraging graph information for clustering remains challenging. To…

Machine Learning · Computer Science 2025-08-01 Binxiong Li , Xu Xiang , Xue Li , Quanzhou Lou , Binyu Zhao , Yujie Liu , Huijie Tang , Benhan Yang

In rapidly evolving field of vision-language models (VLMs), contrastive language-image pre-training (CLIP) has made significant strides, becoming foundation for various downstream tasks. However, relying on one-to-one (image, text)…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Haicheng Wang , Chen Ju , Weixiong Lin , Shuai Xiao , Mengting Chen , Yixuan Huang , Chang Liu , Mingshuai Yao , Jinsong Lan , Ying Chen , Qingwen Liu , Yanfeng Wang

Generalized zero-shot learning(GZSL) aims to classify samples from seen and unseen labels, assuming unseen labels are not accessible during training. Recent advancements in GZSL have been expedited by incorporating…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Riti Paul , Sahil Vora , Baoxin Li

The goal of Few-Shot Continual Learning (FSCL) is to incrementally learn novel tasks with limited labeled samples and preserve previous capabilities simultaneously, while current FSCL methods are all for the class-incremental purpose.…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Yawen Cui , Zitong Yu , Rizhao Cai , Xun Wang , Alex C. Kot , Li Liu

Recommender systems (RecSys) are essential for online platforms, providing personalized suggestions to users within a vast sea of information. Self-supervised graph learning seeks to harness high-order collaborative filtering signals…

Information Retrieval · Computer Science 2025-07-18 Weizhi Zhang , Liangwei Yang , Zihe Song , Henrry Peng Zou , Ke Xu , Yuanjie Zhu , Philip S. Yu

Contrastive learning has emerged as a pivotal framework for representation learning, underpinning advances in both unimodal and bimodal applications like SimCLR and CLIP. To address fundamental limitations like large batch size dependency…

Machine Learning · Computer Science 2024-12-12 Ajay Jagannath , Aayush Upadhyay , Anant Mehta

Graphs serve as versatile data structures in numerous real-world domains-including social networks, molecular biology, and knowledge graphs-by capturing intricate relational information among entities. Among graph-based learning techniques,…

Machine Learning · Computer Science 2025-05-21 Chou-Ying Hsieh , Chun-Fu Jang , Cheng-En Hsieh , Qian-Hui Chen , Sy-Yen Kuo

The inexorable growth of online shopping and e-commerce demands scalable and robust machine learning-based solutions to accommodate customer requirements. In the context of automatic tagging classification and multimodal retrieval, prior…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Giuseppe Cartella , Alberto Baldrati , Davide Morelli , Marcella Cornia , Marco Bertini , Rita Cucchiara

Contrastive Learning (CL) has emerged as a dominant technique for unsupervised representation learning which embeds augmented versions of the anchor close to each other (positive samples) and pushes the embeddings of other samples…

Artificial Intelligence · Computer Science 2022-06-15 Jun Xia , Lirong Wu , Ge Wang , Jintao Chen , Stan Z. Li

Visual place recognition (VPR) is a fundamental task of computer vision for visual localization. Existing methods are trained using image pairs that either depict the same place or not. Such a binary indication does not consider continuous…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Maria Leyva-Vallina , Nicola Strisciuglio , Nicolai Petkov

Feature extraction is an efficient approach for alleviating the issue of dimensionality in high-dimensional data. As a popular self-supervised learning method, contrastive learning has recently garnered considerable attention. In this…

Machine Learning · Computer Science 2021-09-14 Hongjie Zhang