English
Related papers

Related papers: Relational Self-Supervised Learning on Graphs

200 papers

Heterogeneous graph neural network (HGNN) is a very popular technique for the modeling and analysis of heterogeneous graphs. Most existing HGNN-based approaches are supervised or semi-supervised learning methods requiring graphs to be…

Machine Learning · Computer Science 2023-11-17 Cuiying Huo , Dongxiao He , Yawen Li , Di Jin , Jianwu Dang , Weixiong Zhang , Witold Pedrycz , Lingfei Wu

In this paper, we introduce a self-supervised learning method to enhance the graph-level representations with the help of a set of subgraphs. For this purpose, we propose a universal framework to generate subgraphs in an auto-regressive way…

Machine Learning · Computer Science 2021-05-10 Chenguang Wang , Ziwen Liu

Graph representation learning plays a vital role in processing graph-structured data. However, prior arts on graph representation learning heavily rely on labeling information. To overcome this problem, inspired by the recent success of…

Machine Learning · Computer Science 2021-07-19 Ming Jin , Yizhen Zheng , Yuan-Fang Li , Chen Gong , Chuan Zhou , Shirui Pan

This paper presents a general graph representation learning framework called DeepGL for learning deep node and edge representations from large (attributed) graphs. In particular, DeepGL begins by deriving a set of base features (e.g.,…

Machine Learning · Statistics 2017-10-17 Ryan A. Rossi , Rong Zhou , Nesreen K. Ahmed

Graphs are widely used to describe real-world objects and their interactions. Graph Neural Networks (GNNs) as a de facto model for analyzing graphstructured data, are highly sensitive to the quality of the given graph structures. Therefore,…

Machine Learning · Computer Science 2022-02-16 Yanqiao Zhu , Weizhi Xu , Jinghao Zhang , Yuanqi Du , Jieyu Zhang , Qiang Liu , Carl Yang , Shu Wu

Relational data representations have become an increasingly important topic due to the recent proliferation of network datasets (e.g., social, biological, information networks) and a corresponding increase in the application of statistical…

Machine Learning · Statistics 2012-04-03 Ryan A. Rossi , Luke K. McDowell , David W. Aha , Jennifer Neville

Recent years have witnessed the fast development of the emerging topic of Graph Learning based Recommender Systems (GLRS). GLRS employ advanced graph learning approaches to model users' preferences and intentions as well as items'…

Information Retrieval · Computer Science 2021-05-14 Shoujin Wang , Liang Hu , Yan Wang , Xiangnan He , Quan Z. Sheng , Mehmet A. Orgun , Longbing Cao , Francesco Ricci , Philip S. Yu

Graph neural networks (GNNs) have become a powerful tool for processing graph-structured data but still face challenges in effectively aggregating and propagating information between layers, which limits their performance. We tackle this…

Machine Learning · Computer Science 2023-02-09 Maxim Fishman , Chaim Baskin , Evgenii Zheltonozhskii , Almog David , Ron Banner , Avi Mendelson

Graph contrastive learning (GCL), as a self-supervised learning method, can solve the problem of annotated data scarcity. It mines explicit features in unannotated graphs to generate favorable graph representations for downstream tasks.…

Machine Learning · Computer Science 2024-04-02 Jinhuan Wang , Jiafei Shao , Zeyu Wang , Shanqing Yu , Qi Xuan , Xiaoniu Yang

Unsupervised graph representation learning (UGRL) has drawn increasing research attention and achieved promising results in several graph analytic tasks. Relying on the homophily assumption, existing UGRL methods tend to smooth the learned…

Machine Learning · Computer Science 2022-11-28 Yixin Liu , Yizhen Zheng , Daokun Zhang , Vincent CS Lee , Shirui Pan

Graph representation learning methods generate numerical vector representations for the nodes in a network, thereby enabling their use in standard machine learning models. These methods aim to preserve relational information, such that…

Machine Learning · Computer Science 2021-11-10 Janet Layne , Edoardo Serra

Continual graph learning (CGL) studies the problem of learning from an infinite stream of graph data, consolidating historical knowledge, and generalizing it to the future task. At once, only current graph data are available. Although some…

Machine Learning · Computer Science 2023-08-17 Qinghua Shen , Weijieying Ren , Wei Qin

Graph Contrastive Learning (GCL) is a powerful self-supervised learning framework that performs data augmentation through graph perturbations, with growing applications in the analysis of biological networks such as Gene Regulatory Networks…

Machine Learning · Computer Science 2026-02-20 Sho Oshima , Yuji Okamoto , Taisei Tosaki , Ryosuke Kojima

Graph self-supervised learning can reduce the need for labeled graph data and has been widely used in recommendation, social networks, and other web applications. However, existing methods often underuse high-frequency signals and may…

Machine Learning · Computer Science 2026-04-20 Haojie Li , Mengjiao Zhang , Guanfeng Liu , Qiang Hu , Yan Wang , Junwei Du

Self-supervised representation learning~(SSRL) has advanced considerably by exploiting the transformation invariance assumption under artificially designed data augmentations. While augmentation-based SSRL algorithms push the boundaries of…

Machine Learning · Computer Science 2024-03-22 Yi Sui , Tongzi Wu , Jesse C. Cresswell , Ga Wu , George Stein , Xiao Shi Huang , Xiaochen Zhang , Maksims Volkovs

Deep learning on graphs has recently achieved remarkable success on a variety of tasks, while such success relies heavily on the massive and carefully labeled data. However, precise annotations are generally very expensive and…

Machine Learning · Computer Science 2021-09-30 Lirong Wu , Haitao Lin , Zhangyang Gao , Cheng Tan , Stan. Z. Li

Real-world heterogeneous graphs are inherently noisy and usually not in the optimal graph structures for downstream tasks, which often adversely affects the performance of GRL models in downstream tasks. Although Graph Structure Learning…

Machine Learning · Computer Science 2026-04-08 He Zhao , Zhiwei Zeng , Yongwei Wang , Chunyan Miao

In recent years, graph neural networks (GNNs) have emerged as a successful tool in a variety of graph-related applications. However, the performance of GNNs can be deteriorated when noisy connections occur in the original graph structures;…

Machine Learning · Computer Science 2022-01-19 Yixin Liu , Yu Zheng , Daokun Zhang , Hongxu Chen , Hao Peng , Shirui Pan

Graph convolutional networks (GCNs) allow us to learn topologically-aware node embeddings, which can be useful for classification or link prediction. However, they are unable to capture long-range dependencies between nodes without adding…

Machine Learning · Computer Science 2023-08-17 Reza Namazi , Elahe Ghalebi , Sinead Williamson , Hamidreza Mahyar

Graph Neural Networks (GNNs) have emerged as the de facto standard for representation learning on graphs, owing to their ability to effectively integrate graph topology and node attributes. However, the inherent suboptimal nature of node…

Machine Learning · Computer Science 2023-12-27 Zhiyao Zhou , Sheng Zhou , Bochao Mao , Xuanyi Zhou , Jiawei Chen , Qiaoyu Tan , Daochen Zha , Yan Feng , Chun Chen , Can Wang