English
Related papers

Related papers: Multi-task Self-supervised Graph Neural Networks E…

200 papers

Graph neural networks (GNNs) work remarkably well in semi-supervised node regression, yet a rigorous theory explaining when and why they succeed remains lacking. To address this gap, we study an aggregate-and-readout model that encompasses…

Machine Learning · Statistics 2026-02-20 Juntong Chen , Claire Donnat , Olga Klopp , Johannes Schmidt-Hieber

Semi-supervised learning (SSL) over graph-structured data emerges in many network science applications. To efficiently manage learning over graphs, variants of graph neural networks (GNNs) have been developed recently. By succinctly…

Machine Learning · Computer Science 2021-10-22 Alireza Sadeghi , Meng Ma , Bingcong Li , Georgios B. Giannakis

Semi-supervised learning (SSL) has tremendous value in practice due to its ability to utilize both labeled data and unlabelled data. An important class of SSL methods is to naturally represent data as graphs such that the label information…

Machine Learning · Computer Science 2021-03-01 Zixing Song , Xiangli Yang , Zenglin Xu , Irwin King

Self-supervised learning (SSL) of graph neural networks is emerging as a promising way of leveraging unlabeled data. Currently, most methods are based on contrastive learning adapted from the image domain, which requires view generation and…

Machine Learning · Computer Science 2022-07-12 Yaochen Xie , Zhao Xu , Shuiwang Ji

Self-supervised learning (SSL) on graphs generates node and graph representations (i.e., embeddings) that can be used for downstream tasks such as node classification, node clustering, and link prediction. Graph SSL is particularly useful…

Machine Learning · Computer Science 2025-09-26 Jiali Chen , Avijit Mukherjee

Recently, graph neural networks (GNNs) have shown its unprecedented success in many graph-related tasks. However, GNNs face the label scarcity issue as other neural networks do. Thus, recent efforts try to pre-train GNNs on a large-scale…

Machine Learning · Computer Science 2024-03-04 Zhili Wang , Shimin Di , Lei Chen , Xiaofang Zhou

Graph Neural Networks (GNNs) have become the state-of-the-art method for many applications on graph structured data. GNNs are a model for graph representation learning, which aims at learning to generate low dimensional node embeddings that…

Machine Learning · Computer Science 2022-05-23 Davide Buffelli , Fabio Vandin

Graphs can inherently model interconnected objects on the Web, thereby facilitating a series of Web applications, such as web analyzing and content recommendation. Recently, Graph Neural Networks (GNNs) have emerged as a mainstream…

Computation and Language · Computer Science 2024-08-27 Xingtong Yu , Chang Zhou , Yuan Fang , Xinming Zhang

Unsupervised graph representation learning aims to learn low-dimensional node embeddings without supervision while preserving graph topological structures and node attributive features. Previous graph neural networks (GNN) require a large…

Machine Learning · Computer Science 2020-09-04 Yanqiao Zhu , Yichen Xu , Feng Yu , Shu Wu , Liang Wang

Recently, pretraining methods for the Graph Neural Networks (GNNs) have been successful at learning effective representations from unlabeled graph data. However, most of these methods rely on pairwise relations in the graph and do not…

Machine Learning · Computer Science 2023-11-21 Abdalgader Abubaker , Takanori Maehara , Madhav Nimishakavi , Vassilis Plachouras

Graph Neural Network (GNN), with the main idea of encoding graph structure information of graphs by propagation and aggregation, has developed rapidly. It achieved excellent performance in representation learning of multiple types of graphs…

Machine Learning · Computer Science 2024-07-04 Yushan Zhu , Wen Zhang , Yajing Xu , Zhen Yao , Mingyang Chen , Huajun Chen

Graph-based Semi-Supervised Learning (SSL) aims to transfer the labels of a handful of labeled data to the remaining massive unlabeled data via a graph. As one of the most popular graph-based SSL approaches, the recently proposed Graph…

Machine Learning · Computer Science 2020-09-22 Sheng Wan , Shirui Pan , Jian Yang , Chen Gong

Semi-supervised learning (SSL) is effectively used for numerous classification problems, thanks to its ability to make use of abundant unlabeled data. The main assumption of various SSL algorithms is that the nearby points on the data…

Machine Learning · Computer Science 2019-09-30 Xuan Wu , Lingxiao Zhao , Leman Akoglu

Despite the success of Graph Neural Networks (GNNs) on various applications, GNNs encounter significant performance degradation when the amount of supervision signals, i.e., number of labeled nodes, is limited, which is expected as GNNs are…

Machine Learning · Computer Science 2022-04-29 Junseok Lee , Yunhak Oh , Yeonjun In , Namkyeong Lee , Dongmin Hyun , Chanyoung Park

Predicting properties of nodes in a graph is an important problem with applications in a variety of domains. Graph-based Semi-Supervised Learning (SSL) methods aim to address this problem by labeling a small subset of the nodes as seeds and…

Machine Learning · Computer Science 2019-02-13 Shikhar Vashishth , Prateek Yadav , Manik Bhandari , Partha Talukdar

In recent years, graph neural networks (GNNs) have facilitated the development of graph data mining. However, training GNNs requires sufficient labeled task-specific data, which is expensive and sometimes unavailable. To be less dependent…

Machine Learning · Computer Science 2025-10-15 Shengyin Sun , Chen Ma , Jiehao Chen

Graph pre-training strategies have been attracting a surge of attention in the graph mining community, due to their flexibility in parameterizing graph neural networks (GNNs) without any label information. The key idea lies in encoding…

Machine Learning · Computer Science 2022-08-23 Dawei Zhou , Lecheng Zheng , Dongqi Fu , Jiawei Han , Jingrui He

Self-supervised learning (SSL) plays a central role in molecular representation learning. Yet, many recent innovations in masking-based pretraining are introduced as heuristics and lack principled evaluation, obscuring which design choices…

Machine Learning · Computer Science 2025-12-09 Jiannan Yang , Veronika Thost , Tengfei Ma

We address the challenging problem of semi-supervised learning in the context of multiple visual interpretations of the world by finding consensus in a graph of neural networks. Each graph node is a scene interpretation layer, while each…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Marius Leordeanu , Mihai Pirvu , Dragos Costea , Alina Marcu , Emil Slusanschi , Rahul Sukthankar

Attributed graph clustering is an unsupervised task that partitions nodes into different groups. Self-supervised learning (SSL) shows great potential in handling this task, and some recent studies simultaneously learn multiple SSL tasks to…

Machine Learning · Computer Science 2024-01-15 Pengfei Zhu , Qian Wang , Yu Wang , Jialu Li , Qinghua Hu