English
Related papers

Related papers: Augmentation-Free Self-Supervised Learning on Grap…

200 papers

We consider a family of problems that are concerned about making predictions for the majority of unlabeled, graph-structured data samples based on a small proportion of labeled samples. Relational information among the data samples, often…

Machine Learning · Computer Science 2019-11-05 Jiaqi Ma , Weijing Tang , Ji Zhu , Qiaozhu Mei

This paper studies the problem of conducting self-supervised learning for node representation learning on graphs. Most existing self-supervised learning methods assume the graph is homophilous, where linked nodes often belong to the same…

Machine Learning · Computer Science 2023-10-03 Teng Xiao , Zhengyu Chen , Zhimeng Guo , Zeyang Zhuang , Suhang Wang

Self-supervised learning of graph neural networks (GNN) is in great need because of the widespread label scarcity issue in real-world graph/network data. Graph contrastive learning (GCL), by training GNNs to maximize the correspondence…

Machine Learning · Computer Science 2021-11-04 Susheel Suresh , Pan Li , Cong Hao , Jennifer Neville

Graph contrastive learning (GCL), as a self-supervised learning method, can solve the problem of annotated data scarcity. It mines explicit features in unannotated graphs to generate favorable graph representations for downstream tasks.…

Machine Learning · Computer Science 2024-04-02 Jinhuan Wang , Jiafei Shao , Zeyu Wang , Shanqing Yu , Qi Xuan , Xiaoniu Yang

In recent years, graph neural networks (GNNs) have been widely adopted in the representation learning of graph-structured data and provided state-of-the-art performance in various applications such as link prediction, node classification,…

Machine Learning · Computer Science 2021-04-14 Dasol Hwang , Jinyoung Park , Sunyoung Kwon , Kyung-Min Kim , Jung-Woo Ha , Hyunwoo J. Kim

Graph Contrastive Learning (GCL) has emerged as the foremost approach for self-supervised learning on graph-structured data. GCL reduces reliance on labeled data by learning robust representations from various augmented views. However,…

Machine Learning · Computer Science 2025-02-20 Ruyue Liu , Rong Yin , Yong Liu , Xiaoshuai Hao , Haichao Shi , Can Ma , Weiping Wang

Recently, contrastive learning (CL) has emerged as a successful method for unsupervised graph representation learning. Most graph CL methods first perform stochastic augmentation on the input graph to obtain two graph views and maximize the…

Machine Learning · Computer Science 2021-03-01 Yanqiao Zhu , Yichen Xu , Feng Yu , Qiang Liu , Shu Wu , Liang Wang

Self-supervised Learning (SSL) has emerged as a powerful technique in pre-training deep learning models without relying on expensive annotated labels, instead leveraging embedded signals in unlabeled data. While SSL has shown remarkable…

Machine Learning · Computer Science 2024-06-05 Mahdi Naseri , Mahdi Biparva

In recent years, graph neural networks (GNNs) have emerged as a successful tool in a variety of graph-related applications. However, the performance of GNNs can be deteriorated when noisy connections occur in the original graph structures;…

Machine Learning · Computer Science 2022-01-19 Yixin Liu , Yu Zheng , Daokun Zhang , Hongxu Chen , Hao Peng , Shirui Pan

Real world data is mostly unlabeled or only few instances are labeled. Manually labeling data is a very expensive and daunting task. This calls for unsupervised learning techniques that are powerful enough to achieve comparable results as…

Machine Learning · Computer Science 2021-05-21 Zekarias T. Kefato , Sarunas Girdzijauskas

Graph Contrastive Learning (GCL) is a powerful self-supervised learning framework that performs data augmentation through graph perturbations, with growing applications in the analysis of biological networks such as Gene Regulatory Networks…

Machine Learning · Computer Science 2026-02-20 Sho Oshima , Yuji Okamoto , Taisei Tosaki , Ryosuke Kojima

Federated graph representation learning (FedGRL) brings the benefits of distributed training to graph structured data while simultaneously addressing some privacy and compliance concerns related to data curation. However, several…

Machine Learning · Computer Science 2022-10-28 Susheel Suresh , Danny Godbout , Arko Mukherjee , Mayank Shrivastava , Jennifer Neville , Pan Li

Self-supervised learning (SSL) has emerged as a powerful paradigm for learning representations without labeled data. Most SSL approaches rely on strong, well-established, handcrafted data augmentations to generate diverse views for…

Machine Learning · Computer Science 2026-01-16 Berken Utku Demirel , Christian Holz

Graph Neural Networks (GNNs) have demonstrated remarkable effectiveness in various graph representation learning tasks. However, most existing GNNs focus primarily on capturing local information through explicit graph convolution, often…

Machine Learning · Computer Science 2025-01-31 Jinlu Wang , Yanfeng Sun , Jiapu Wang , Junbin Gao , Shaofan Wang , Jipeng Guo

Existing graph contrastive learning methods rely on augmentation techniques based on random perturbations (e.g., randomly adding or dropping edges and nodes). Nevertheless, altering certain edges or nodes can unexpectedly change the graph…

Machine Learning · Computer Science 2022-11-08 Huidong Liang , Xingjian Du , Bilei Zhu , Zejun Ma , Ke Chen , Junbin Gao

Graph representation learning has now become the de facto standard when handling graph-structured data, with the framework of message-passing graph neural networks (MPNN) being the most prevailing algorithmic tool. Despite its popularity,…

Machine Learning · Computer Science 2023-10-18 Jiawang Dan , Ruofan Wu , Yunpeng Liu , Baokun Wang , Changhua Meng , Tengfei Liu , Tianyi Zhang , Ningtao Wang , Xing Fu , Qi Li , Weiqiang Wang

Attribute graphs are ubiquitous in multimedia applications, and graph representation learning (GRL) has been successful in analyzing attribute graph data. However, incomplete graph data and missing node attributes can have a negative impact…

Machine Learning · Computer Science 2023-05-09 Xiaochuan Zhang , Mengran Li , Ye Wang , Haojun Fei

Self-supervised learning is currently gaining a lot of attention, as it allows neural networks to learn robust representations from large quantities of unlabeled data. Additionally, multi-task learning can further improve representation…

Machine Learning · Computer Science 2020-12-07 Franco Manessi , Alessandro Rozza

In this paper, we introduce a self-supervised learning method to enhance the graph-level representations with the help of a set of subgraphs. For this purpose, we propose a universal framework to generate subgraphs in an auto-regressive way…

Machine Learning · Computer Science 2021-05-10 Chenguang Wang , Ziwen Liu

Recently, generative graph models have shown promising results in learning graph representations through self-supervised methods. However, most existing generative graph representation learning (GRL) approaches rely on random masking across…

Machine Learning · Computer Science 2026-05-08 Xinyue Hu , Zhibin Duan , Xinyang Liu , Yuxin Li , Bo Chen , Chaojie Wang , Yilin He , Hongwei Liu , Mingyuan Zhou