English
Related papers

Related papers: Are Graph Augmentations Necessary? Simple Graph Co…

200 papers

We introduce a randomized topological augmentor based on Schur complements for Graph Contrastive Learning (GCL). Given a graph laplacian matrix, the technique generates unbiased approximations of its Schur complements and treats the…

Machine Learning · Computer Science 2023-06-08 Vignesh Kothapalli

While some powerful neural network architectures (e.g., Transformer, Graph Neural Networks) have achieved improved performance in sequential recommendation with high-order item dependency modeling, they may suffer from poor representation…

Information Retrieval · Computer Science 2023-06-02 Yaowen Ye , Lianghao Xia , Chao Huang

In recent years, methods that combine contrastive learning with graph neural networks have emerged to address the challenges of recommendation systems, demonstrating powerful performance and playing a significant role in this domain.…

Information Retrieval · Computer Science 2025-09-08 Hao Chen , Wenming Ma , Zihao Chu , Mingqi Li

Graph neural network(GNN) has been a powerful approach in collaborative filtering(CF) due to its ability to model high-order user-item relationships. Recently, to alleviate the data sparsity and enhance representation learning, many efforts…

Information Retrieval · Computer Science 2024-12-10 Bowen Zheng , Junjie Zhang , Hongyu Lu , Yu Chen , Ming Chen , Wayne Xin Zhao , Ji-Rong Wen

Graph Neural Networks (GNNs) have become popular in Graph Representation Learning (GRL). One fundamental application is few-shot node classification. Most existing methods follow the meta learning paradigm, showing the ability of fast…

Machine Learning · Computer Science 2023-09-20 Hao Liu , Jiarui Feng , Lecheng Kong , Dacheng Tao , Yixin Chen , Muhan Zhang

Graph Contrastive Learning (GCL) has recently drawn much research interest for learning generalizable node representations in a self-supervised manner. In general, the contrastive learning process in GCL is performed on top of the…

Machine Learning · Computer Science 2022-12-06 Kaize Ding , Yancheng Wang , Yingzhen Yang , Huan Liu

Graph contrastive learning (GCL) has recently emerged as an effective learning paradigm to alleviate the reliance on labelling information for graph representation learning. The core of GCL is to maximise the mutual information between the…

Machine Learning · Computer Science 2022-10-18 Yizhen Zheng , Yu Zheng , Xiaofei Zhou , Chen Gong , Vincent CS Lee , Shirui Pan

This paper introduces Variable Substitution as a domain-specific graph augmentation technique for graph contrastive learning (GCL) in the context of searching for mathematical formulas. Standard GCL augmentation techniques often distort the…

Information Retrieval · Computer Science 2026-03-10 Chun-Hsi Ku , Hung-Hsuan Chen

Graph Contrastive Learning (GCL) excels at managing noise and fluctuations in input data, making it popular in various fields (e.g., social networks, and knowledge graphs). Our study finds that the difference in high-frequency information…

Machine Learning · Computer Science 2024-10-15 Yuntao Shou , Xiangyong Cao , Deyu Meng

Contrastive learning (CL) is a form of self-supervised learning and has been widely used for various tasks. Different from widely studied instance-level contrastive learning, pixel-wise contrastive learning mainly helps with pixel-wise…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Quan Quan , Qingsong Yao , Jun Li , S. kevin Zhou

Contrastive learning is one of the fastest growing research areas in machine learning due to its ability to learn useful representations without labeled data. However, contrastive learning is susceptible to feature suppression, i.e., it may…

Machine Learning · Computer Science 2021-11-30 Tianhong Li , Lijie Fan , Yuan Yuan , Hao He , Yonglong Tian , Rogerio Feris , Piotr Indyk , Dina Katabi

Contrastive learning has been widely applied to graph representation learning, where the view generators play a vital role in generating effective contrastive samples. Most of the existing contrastive learning methods employ pre-defined…

Machine Learning · Computer Science 2022-01-04 Yihang Yin , Qingzhong Wang , Siyu Huang , Haoyi Xiong , Xiang Zhang

Graph Contrastive Learning (GCL) is a powerful self-supervised learning framework that performs data augmentation through graph perturbations, with growing applications in the analysis of biological networks such as Gene Regulatory Networks…

Machine Learning · Computer Science 2026-02-20 Sho Oshima , Yuji Okamoto , Taisei Tosaki , Ryosuke Kojima

Contrastive learning -- a modern approach to extract useful representations from unlabeled data by training models to distinguish similar samples from dissimilar ones -- has driven significant progress in foundation models. In this work, we…

Machine Learning · Statistics 2025-10-15 Licong Lin , Song Mei

Graph Contrastive Learning frameworks have demonstrated success in generating high-quality node representations. The existing research on efficient data augmentation methods and ideal pretext tasks for graph contrastive learning remains…

Machine Learning · Computer Science 2024-10-22 Zhenyu Lin , Hongzheng Li , Yingxia Shao , Guanhua Ye , Yawen Li , Quanqing Xu

Graph representation learning (GRL) makes considerable progress recently, which encodes graphs with topological structures into low-dimensional embeddings. Meanwhile, the time-consuming and costly process of annotating graph labels manually…

Machine Learning · Computer Science 2024-02-28 Haojun Jiang , Jiawei Sun , Jie Li , Chentao Wu

Leading graph contrastive learning (GCL) methods perform graph augmentations in two fashions: (1) randomly corrupting the anchor graph, which could cause the loss of semantic information, or (2) using domain knowledge to maintain salient…

Machine Learning · Computer Science 2022-06-17 Sihang Li , Xiang Wang , An zhang , Yingxin Wu , Xiangnan He , Tat-Seng Chua

Contrastive learning (CL) has emerged as a powerful technique for representation learning, with or without label supervision. However, supervised CL is prone to collapsing representations of subclasses within a class by not capturing all…

Machine Learning · Computer Science 2023-05-30 Yihao Xue , Siddharth Joshi , Eric Gan , Pin-Yu Chen , Baharan Mirzasoleiman

The rise of self-supervised learning, which operates without the need for labeled data, has garnered significant interest within the graph learning community. This enthusiasm has led to the development of numerous Graph Contrastive Learning…

Machine Learning · Computer Science 2024-02-27 Qian Ma , Hongliang Chi , Hengrui Zhang , Kay Liu , Zhiwei Zhang , Lu Cheng , Suhang Wang , Philip S. Yu , Yao Ma

The field of generating recommendations within the framework of causal inference has seen a recent surge, with recommendations being likened to treatments. This approach enhances insights into the influence of recommendations on user…

Information Retrieval · Computer Science 2023-08-21 Guanglin Zhou , Chengkai Huang , Xiaocong Chen , Xiwei Xu , Chen Wang , Liming Zhu , Lina Yao