English
Related papers

Related papers: Large-Scale Representation Learning on Graphs via …

200 papers

In recent years, deep learning on graphs has achieved remarkable success in various domains. However, the reliance on annotated graph data remains a significant bottleneck due to its prohibitive cost and time-intensive nature. To address…

Self-supervised learning of graph neural networks (GNN) is in great need because of the widespread label scarcity issue in real-world graph/network data. Graph contrastive learning (GCL), by training GNNs to maximize the correspondence…

Machine Learning · Computer Science 2021-11-04 Susheel Suresh , Pan Li , Cong Hao , Jennifer Neville

Graph Self-Supervised Learning (GSSL) has emerged as a powerful paradigm for generating high-quality representations for graph-structured data. While multi-scale graph contrastive learning has received increasing attention, many existing…

Machine Learning · Computer Science 2026-05-14 Mohamed Mahmoud Amar , Nairouz Mrabah , Mohamed Bouguessa , Abdoulaye Baniré Diallo

Unsupervised graph representation learning(GRL) aims to distill diverse graph information into task-agnostic embeddings without label supervision. Due to a lack of support from labels, recent representation learning methods usually adopt…

Machine Learning · Computer Science 2023-04-18 Bei Lin , You Li , Ning Gui , Zhuopeng Xu , Zhiwu Yu

Reinforcement learning (RL) is an effective method of finding reasoning pathways in incomplete knowledge graphs (KGs). To overcome the challenges of a large action space, a self-supervised pre-training method is proposed to warm up the…

Computation and Language · Computer Science 2025-04-17 Ying Ma , Owen Burns , Mingqiu Wang , Gang Li , Nan Du , Laurent El Shafey , Liqiang Wang , Izhak Shafran , Hagen Soltau

Graph Neural Networks (GNNs) are increasingly used in conjunction with unsupervised learning techniques to learn powerful node representations, but their deployment is hindered by their high sensitivity to hyperparameter tuning and the…

Machine Learning · Statistics 2025-05-22 So Won Jeong , Claire Donnat

Graph representation learning has attracted lots of attention recently. Existing graph neural networks fed with the complete graph data are not scalable due to limited computation and memory costs. Thus, it remains a great challenge to…

Machine Learning · Computer Science 2020-11-24 Yizhu Jiao , Yun Xiong , Jiawei Zhang , Yao Zhang , Tianqi Zhang , Yangyong Zhu

Self-supervised learning (SSL) on graphs generates node and graph representations (i.e., embeddings) that can be used for downstream tasks such as node classification, node clustering, and link prediction. Graph SSL is particularly useful…

Machine Learning · Computer Science 2025-09-26 Jiali Chen , Avijit Mukherjee

Recent studies have revealed that GNNs are vulnerable to adversarial attacks. Most existing robust graph learning methods measure model robustness based on label information, rendering them infeasible when label information is not…

Machine Learning · Computer Science 2023-06-09 Jihong Wang , Minnan Luo , Jundong Li , Ziqi Liu , Jun Zhou , Qinghua Zheng

Temporal graph representation learning (TGRL) is essential for modeling dynamic systems in real-world networks. However, traditional TGRL methods, despite their effectiveness, often face significant computational challenges and inference…

Machine Learning · Computer Science 2024-11-26 Yuhong Luo , Pan Li

Graph representation learning (GRL) is to encode graph elements into informative vector representations, which can be used in downstream tasks for analyzing graph-structured data and has seen extensive applications in various domains.…

Machine Learning · Computer Science 2024-06-21 Hewen Wang , Renchi Yang , Xiaokui Xiao

Graph Neural Networks (GNNs) have achieved great success in learning graph representations and thus facilitating various graph-related tasks. However, most GNN methods adopt a supervised learning setting, which is not always feasible in…

Machine Learning · Computer Science 2022-08-16 Hongliang Chi , Yao Ma

Graph representation learning is a fast-growing field where one of the main objectives is to generate meaningful representations of graphs in lower-dimensional spaces. The learned embeddings have been successfully applied to perform various…

Machine Learning · Computer Science 2021-12-21 Md. Khaledur Rahman , Ariful Azad

We focus on developing a novel scalable graph-based semi-supervised learning (SSL) method for a small number of labeled data and a large amount of unlabeled data. Due to the lack of labeled data and the availability of large-scale unlabeled…

Machine Learning · Computer Science 2019-12-06 Zitong Wang , Li Wang , Raymond Chan , Tieyong Zeng

We propose Graph Contrastive Learning (GraphCL), a general framework for learning node representations in a self supervised manner. GraphCL learns node embeddings by maximizing the similarity between the representations of two randomly…

Machine Learning · Computer Science 2020-07-17 Hakim Hafidi , Mounir Ghogho , Philippe Ciblat , Ananthram Swami

Graph Contrastive Learning (GCL) is a potent paradigm for self-supervised graph learning that has attracted attention across various application scenarios. However, GCL for learning on Text-Attributed Graphs (TAGs) has yet to be explored.…

Social and Information Networks · Computer Science 2024-09-04 Haoran Yang , Xiangyu Zhao , Sirui Huang , Qing Li , Guandong Xu

Graph Convolutional Representation (GCR) has achieved impressive performance for graph data representation. However, existing GCR is generally defined on the input fixed graph which may restrict the representation capacity and also be…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Bo Jiang , Ziyan Zhang , Bin Luo

Graph contrastive learning (GCL) has emerged as a representative graph self-supervised method, achieving significant success. The currently prevalent optimization objective for GCL is InfoNCE. Typically, it employs augmentation techniques…

Machine Learning · Computer Science 2024-03-22 Yulan Hu , Sheng Ouyang , Jingyu Liu , Ge Chen , Zhirui Yang , Junchen Wan , Fuzheng Zhang , Zhongyuan Wang , Yong Liu

We propose $\textbf{MGCL}$, a model-driven graph contrastive learning (GCL) framework that leverages graphons (probabilistic generative models for graphs) to guide contrastive learning by accounting for the data's underlying generative…

Machine Learning · Computer Science 2025-06-09 Ali Azizpour , Nicolas Zilberstein , Santiago Segarra

In this paper, we introduce a self-supervised learning method to enhance the graph-level representations with the help of a set of subgraphs. For this purpose, we propose a universal framework to generate subgraphs in an auto-regressive way…

Machine Learning · Computer Science 2021-05-10 Chenguang Wang , Ziwen Liu