English
Related papers

Related papers: Generalized Contrastive Learning for Multi-Modal R…

200 papers

Contrastive learning methods based on InfoNCE loss are popular in node representation learning tasks on graph-structured data. However, its reliance on data augmentation and its quadratic computational complexity might lead to inconsistency…

Machine Learning · Computer Science 2022-12-12 Hengrui Zhang , Qitian Wu , Yu Wang , Shaofeng Zhang , Junchi Yan , Philip S. Yu

Graph neural networks (GNNs) have recently emerged as an effective approach to model neighborhood signals in collaborative filtering. Towards this research line, graph contrastive learning (GCL) demonstrates robust capabilities to address…

Information Retrieval · Computer Science 2024-07-22 Xinzhou Jin , Jintang Li , Liang Chen , Chenyun Yu , Yuanzhen Xie , Tao Xie , Chengxiang Zhuo , Zang Li , Zibin Zheng

The graph contrastive learning (GCL) framework has gained remarkable achievements in graph representation learning. However, similar to graph neural networks (GNNs), GCL models are susceptible to graph structural attacks. As an unsupervised…

Machine Learning · Computer Science 2025-08-25 Yulin Zhu , Xing Ai , Yevgeniy Vorobeychik , Kai Zhou

Graph contrastive learning (GCL) alleviates the heavy reliance on label information for graph representation learning (GRL) via self-supervised learning schemes. The core idea is to learn by maximising mutual information for similar…

Machine Learning · Computer Science 2022-10-18 Yizhen Zheng , Shirui Pan , Vincent Cs Lee , Yu Zheng , Philip S. Yu

Multimodal Contrastive Learning (MCL) advances in aligning different modalities and generating multimodal representations in a joint space. By leveraging contrastive learning across diverse modalities, large-scale multimodal data enhances…

Machine Learning · Computer Science 2025-09-23 Xiaohao Liu , Xiaobo Xia , See-Kiong Ng , Tat-Seng Chua

Recent advancements in Graph Contrastive Learning (GCL) have demonstrated remarkable effectiveness in improving graph representations. However, relying on predefined augmentations (e.g., node dropping, edge perturbation, attribute masking)…

Machine Learning · Computer Science 2025-02-27 Khaled Mohammed Saifuddin , Shihao Ji , Esra Akbas

Graph Contrastive Learning (GCL) has emerged as a popular training approach for learning node embeddings from augmented graphs without labels. Despite the key principle that maximizing the similarity between positive node pairs while…

Machine Learning · Computer Science 2024-05-27 Yue Yu , Xiao Wang , Mengmei Zhang , Nian Liu , Chuan Shi

Rating is a typical user explicit feedback that visually reflects how much a user likes a related item. The (rating) matrix completion is essentially a rating prediction process, which is also a significant problem in recommender systems.…

Machine Learning · Computer Science 2025-07-09 Xiang Li , Changsheng Shui , Zhongying Zhao , Junyu Dong , Yanwei Yu

Graph contrastive learning (GCL) is an effective paradigm for node representation learning in graphs. The key components hidden behind GCL are data augmentation and positive-negative pair selection. Typical data augmentations in GCL, such…

Machine Learning · Computer Science 2024-07-25 Jiaqiang Zhang , Songcan Chen

Graph neural network (GNN) is a powerful learning approach for graph-based recommender systems. Recently, GNNs integrated with contrastive learning have shown superior performance in recommendation with their data augmentation schemes,…

Information Retrieval · Computer Science 2023-06-16 Xuheng Cai , Chao Huang , Lianghao Xia , Xubin Ren

Graph contrastive learning (GCL) has emerged as a representative graph self-supervised method, achieving significant success. The currently prevalent optimization objective for GCL is InfoNCE. Typically, it employs augmentation techniques…

Machine Learning · Computer Science 2024-03-22 Yulan Hu , Sheng Ouyang , Jingyu Liu , Ge Chen , Zhirui Yang , Junchen Wan , Fuzheng Zhang , Zhongyuan Wang , Yong Liu

This paper introduces a semi-supervised contrastive learning framework and its application to text-independent speaker verification. The proposed framework employs generalized contrastive loss (GCL). GCL unifies losses from two different…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-09 Nakamasa Inoue , Keita Goto

Multimodal representation learning is commonly built on a shared-private decomposition, treating latent information as either common to all modalities or specific to one. This binary view is often inadequate: many factors are shared by only…

Machine Learning · Statistics 2026-04-08 Huichao Li , Junhan Yu , Doudou Zhou

Contrastive learning (CL) has emerged as a powerful framework for learning representations of images and text in a self-supervised manner while enhancing model robustness against adversarial attacks. More recently, researchers have extended…

Machine Learning · Computer Science 2023-12-04 Filippo Guerranti , Zinuo Yi , Anna Starovoit , Rafiq Kamel , Simon Geisler , Stephan Günnemann

Graph Contrastive Learning (GCL) has emerged as a powerful tool for extracting consistent representations from graphs, independent of labeled information. However, existing methods predominantly focus on undirected graphs, disregarding the…

Machine Learning · Computer Science 2025-10-21 Daohan Su , Yang Zhang , Xunkai Li , Rong-Hua Li , Guoren Wang

Graph contrastive learning (GCL) aligns node representations by classifying node pairs into positives and negatives using a selection process that typically relies on establishing correspondences within two augmented graphs. The…

Machine Learning · Computer Science 2024-11-27 Maysam Behmanesh , Maks Ovsjanikov

In recent years, deep learning on graphs has achieved remarkable success in various domains. However, the reliance on annotated graph data remains a significant bottleneck due to its prohibitive cost and time-intensive nature. To address…

Human beings can quickly adapt to environmental changes by leveraging learning experience. However, adapting deep neural networks to dynamic environments by machine learning algorithms remains a challenge. To better understand this issue,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Shixiang Tang , Peng Su , Dapeng Chen , Wanli Ouyang

Generalized Category Discovery (GCD) is a crucial task that aims to recognize both known and novel categories from a set of unlabeled data by utilizing a few labeled data with only known categories. Due to the lack of supervision and…

Computation and Language · Computer Science 2024-05-28 Wenbin An , Wenkai Shi , Feng Tian , Haonan Lin , QianYing Wang , Yaqiang Wu , Mingxiang Cai , Luyan Wang , Yan Chen , Haiping Zhu , Ping Chen

Leading graph contrastive learning (GCL) methods perform graph augmentations in two fashions: (1) randomly corrupting the anchor graph, which could cause the loss of semantic information, or (2) using domain knowledge to maintain salient…

Machine Learning · Computer Science 2022-06-17 Sihang Li , Xiang Wang , An zhang , Yingxin Wu , Xiangnan He , Tat-Seng Chua