English
Related papers

Related papers: Towards Graph Self-Supervised Learning with Contra…

200 papers

A recent focal area in the space of graph neural networks (GNNs) is graph self-supervised learning (SSL), which aims to derive useful node representations without labeled data. Notably, many state-of-the-art graph SSL methods are…

Machine Learning · Computer Science 2023-03-30 William Shiao , Zhichun Guo , Tong Zhao , Evangelos E. Papalexakis , Yozen Liu , Neil Shah

The recent emergence of contrastive learning approaches facilitates the application on graph representation learning (GRL), introducing graph contrastive learning (GCL) into the literature. These methods contrast semantically similar and…

Machine Learning · Computer Science 2022-06-03 Ganqu Cui , Yufeng Du , Cheng Yang , Jie Zhou , Liang Xu , Xing Zhou , Xingyi Cheng , Zhiyuan Liu

Graph Neural Networks (GNNs) have demonstrated promising results on exploiting node representations for many downstream tasks through supervised end-to-end training. To deal with the widespread label scarcity issue in real-world…

Machine Learning · Computer Science 2023-08-02 Cheng Wu , Chaokun Wang , Jingcao Xu , Ziyang Liu , Kai Zheng , Xiaowei Wang , Yang Song , Kun Gai

Graph Contrastive Learning (GCL) has recently made progress as an unsupervised graph representation learning paradigm. GCL approaches can be categorized into augmentation-based and augmentation-free methods. The former relies on complex…

Machine Learning · Computer Science 2025-04-25 Yanan Zhao , Feng Ji , Kai Zhao , Xuhao Li , Qiyu Kang , Wenfei Liang , Yahya Alkhatib , Xingchao Jian , Wee Peng Tay

Graph Contrastive Learning (GCL) has emerged as a powerful paradigm for training Graph Neural Networks (GNNs) in the absence of task-specific labels. However, its scalability on large-scale graphs is hindered by the intensive message…

Machine Learning · Computer Science 2025-11-12 Xiang Chen , Kun Yue , Wenjie Liu , Zhenyu Zhang , Liang Duan

Self-supervised learning has become a key method for training deep learning models when labeled data is scarce or unavailable. While graph machine learning holds great promise across various domains, the design of effective pretext tasks…

Machine Learning · Computer Science 2025-03-03 Amadou S. Sangare , Nicolas Dunou , Jhony H. Giraldo , Fragkiskos D. Malliaros

Graph neural networks (GNNs) work well when the graph structure is provided. However, this structure may not always be available in real-world applications. One solution to this problem is to infer a task-specific latent structure and then…

Machine Learning · Computer Science 2021-11-02 Bahare Fatemi , Layla El Asri , Seyed Mehran Kazemi

Graph Contrastive Learning (GCL) has recently emerged as a promising graph self-supervised learning framework for learning discriminative node representations without labels. The widely adopted objective function of GCL benefits from two…

Machine Learning · Computer Science 2024-11-05 Yunhui Liu , Tieke He , Tao Zheng , Jianhua Zhao

Graph contrastive learning (GCL) is a popular method for leaning graph representations by maximizing the consistency of features across augmented views. Traditional GCL methods utilize single-perspective i.e. data or model-perspective)…

Machine Learning · Computer Science 2024-06-04 Zelin Yao , Chuang Liu , Xueqi Ma , Mukun Chen , Jia Wu , Xiantao Cai , Bo Du , Wenbin Hu

Contrastive learning is a significant paradigm in graph self-supervised learning. However, it requires negative samples to prevent model collapse and learn discriminative representations. These negative samples inevitably lead to heavy…

Machine Learning · Computer Science 2024-08-12 Yunhui Liu , Huaisong Zhang , Tieke He , Tao Zheng , Jianhua Zhao

Graph augmentation with contrastive learning has gained significant attention in the field of recommendation systems due to its ability to learn expressive user representations, even when labeled data is limited. However, directly applying…

Machine Learning · Computer Science 2024-03-26 Qianru Zhang , Lianghao Xia , Xuheng Cai , Siuming Yiu , Chao Huang , Christian S. Jensen

Graph representation learning received increasing attentions in recent years. Most of existing methods ignore the complexity of the graph structures and restrict graphs in a single constant-curvature representation space, which is only…

Machine Learning · Computer Science 2021-12-13 Li Sun , Zhongbao Zhang , Junda Ye , Hao Peng , Jiawei Zhang , Sen Su , Philip S. Yu

Graph self-supervised learning can reduce the need for labeled graph data and has been widely used in recommendation, social networks, and other web applications. However, existing methods often underuse high-frequency signals and may…

Machine Learning · Computer Science 2026-04-20 Haojie Li , Mengjiao Zhang , Guanfeng Liu , Qiang Hu , Yan Wang , Junwei Du

Recently, graph Convolutional Neural Networks (graph CNNs) have been widely used for graph data representation and semi-supervised learning tasks. However, existing graph CNNs generally use a fixed graph which may be not optimal for…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Bo Jiang , Ziyan Zhang , Doudou Lin , Jin Tang

Contrastive learning (CL), which can extract the information shared between different contrastive views, has become a popular paradigm for vision representation learning. Inspired by the success in computer vision, recent work introduces CL…

Machine Learning · Computer Science 2022-12-15 Xumeng Gong , Cheng Yang , Chuan Shi

Graph representation learning based on graph neural networks (GNNs) can greatly improve the performance of downstream tasks, such as node and graph classification. However, the general GNN models do not aggregate node information in a…

Machine Learning · Computer Science 2020-07-30 Fei Ding , Xiaohong Zhang , Justin Sybrandt , Ilya Safro

Graph contrastive learning (GCL) has recently achieved substantial advancements. Existing GCL approaches compare two different ``views'' of the same graph in order to learn node/graph representations. The underlying assumption of these…

Machine Learning · Computer Science 2024-01-18 Gehang Zhang , Bowen Yu , Jiangxia Cao , Xinghua Zhang , Jiawei Sheng , Chuan Zhou , Tingwen Liu

Attributed graph clustering, which learns node representation from node attribute and topological graph for clustering, is a fundamental but challenging task for graph analysis. Recently, methods based on graph contrastive learning (GCL)…

Machine Learning · Computer Science 2023-05-15 Wei Xia , Quanxue Gao , Ming Yang , Xinbo Gao

Graph clustering discovers groups or communities within networks. Deep learning methods such as autoencoders (AE) extract effective clustering and downstream representations but cannot incorporate rich structural information. While Graph…

Machine Learning · Computer Science 2022-04-28 Gayan K. Kulatilleke , Marius Portmann , Shekhar S. Chandra

Graph Contrastive Learning (GCL) has emerged as the foremost approach for self-supervised learning on graph-structured data. GCL reduces reliance on labeled data by learning robust representations from various augmented views. However,…

Machine Learning · Computer Science 2025-02-20 Ruyue Liu , Rong Yin , Yong Liu , Xiaoshuai Hao , Haichao Shi , Can Ma , Weiping Wang