English
Related papers

Related papers: Feature propagation as self-supervision signals on…

200 papers

Graph-based methods have been demonstrated as one of the most effective approaches for semi-supervised learning, as they can exploit the connectivity patterns between labeled and unlabeled data samples to improve learning performance.…

Machine Learning · Computer Science 2019-07-01 Qimai Li , Xiao-Ming Wu , Han Liu , Xiaotong Zhang , Zhichao Guan

Self-supervised representation learning on text-attributed graphs, which aims to create expressive and generalizable representations for various downstream tasks, has received increasing research attention lately. However, existing methods…

Computation and Language · Computer Science 2023-10-24 Yichuan Li , Kaize Ding , Kyumin Lee

Attention mechanism in graph neural networks is designed to assign larger weights to important neighbor nodes for better representation. However, what graph attention learns is not understood well, particularly when graphs are noisy. In…

Machine Learning · Computer Science 2022-04-12 Dongkwan Kim , Alice Oh

Two main families of node feature augmentation schemes have been explored for enhancing GNNs: random features and spectral positional encoding. Surprisingly, however, there is still no clear understanding of the relation between these two…

Machine Learning · Computer Science 2023-07-20 Moshe Eliasof , Fabrizio Frasca , Beatrice Bevilacqua , Eran Treister , Gal Chechik , Haggai Maron

Graph neural networks (GNNs) have emerged as a powerful tool for graph classification and representation learning. However, GNNs tend to suffer from over-smoothing problems and are vulnerable to graph perturbations. To address these…

Machine Learning · Computer Science 2021-11-01 Yuzhou Chen , Baris Coskunuzer , Yulia R. Gel

Inspired by the impressive success of contrastive learning (CL), a variety of graph augmentation strategies have been employed to learn node representations in a self-supervised manner. Existing methods construct the contrastive samples by…

Machine Learning · Computer Science 2022-12-14 Peiyao Zhao , Yuangang Pan , Xin Li , Xu Chen , Ivor W. Tsang , Lejian Liao

Heterophilic Graph Neural Networks (HGNNs) have shown promising results for semi-supervised learning tasks on graphs. Notably, most real-world heterophilic graphs are composed of a mixture of nodes with different neighbor patterns,…

Machine Learning · Computer Science 2025-02-26 Jinluan Yang , Zhengyu Chen , Teng Xiao , Wenqiao Zhang , Yong Lin , Kun Kuang

Graph representation learning has emerged as a cornerstone for tasks like node classification and link prediction, yet prevailing self-supervised learning (SSL) methods face challenges such as computational inefficiency, reliance on…

Machine Learning · Computer Science 2025-09-04 Srinitish Srinivasan , Omkumar CU

Graph neural networks (GNNs) have shown advantages in graph-based analysis tasks. However, most existing methods have the homogeneity assumption and show poor performance on heterophilic graphs, where the linked nodes have dissimilar…

Machine Learning · Computer Science 2024-04-16 Tianhao Peng , Wenjun Wu , Haitao Yuan , Zhifeng Bao , Zhao Pengrui , Xin Yu , Xuetao Lin , Yu Liang , Yanjun Pu

Self-supervised learning (SSL) with vision transformers (ViTs) has proven effective for representation learning as demonstrated by the impressive performance on various downstream tasks. Despite these successes, existing ViT-based SSL…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Chaitanya Devaguptapu , Sumukh Aithal , Shrinivas Ramasubramanian , Moyuru Yamada , Manohar Kaul

Despite the success of Graph Neural Networks (GNNs) on various applications, GNNs encounter significant performance degradation when the amount of supervision signals, i.e., number of labeled nodes, is limited, which is expected as GNNs are…

Machine Learning · Computer Science 2022-04-29 Junseok Lee , Yunhak Oh , Yeonjun In , Namkyeong Lee , Dongmin Hyun , Chanyoung Park

Most real-world networks are noisy and incomplete samples from an unknown target distribution. Refining them by correcting corruptions or inferring unobserved regions typically improves downstream performance. Inspired by the impressive…

We introduce a conceptually simple yet effective model for self-supervised representation learning with graph data. It follows the previous methods that generate two views of an input graph through data augmentation. However, unlike…

Machine Learning · Computer Science 2021-10-29 Hengrui Zhang , Qitian Wu , Junchi Yan , David Wipf , Philip S. Yu

Many real-world problems can be represented as graph-based learning problems. In this paper, we propose a novel framework for learning spatial and attentional convolution neural networks on arbitrary graphs. Different from previous…

Machine Learning · Computer Science 2019-02-26 Hao Peng , Jianxin Li , Qiran Gong , Senzhang Wang , Yuanxing Ning , Philip S. Yu

Graph Neural Networks (GNNs) have received considerable attention on graph-structured data learning for a wide variety of tasks. The well-designed propagation mechanism which has been demonstrated effective is the most fundamental part of…

Machine Learning · Computer Science 2021-01-29 Meiqi Zhu , Xiao Wang , Chuan Shi , Houye Ji , Peng Cui

How can we accurately classify graphs? Graph classification is a pivotal task in data mining with applications in social network analysis, web analysis, drug discovery, molecular property prediction, etc. Graph neural networks have achieved…

Machine Learning · Computer Science 2025-03-28 Minjun Kim , Jaehyeon Choi , SeungJoo Lee , Jinhong Jung , U Kang

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

Machine Learning · Computer Science 2026-05-05 Hugo Attali , Nathalie Pernelle , Davide Buscaldi , Fragkiskos D. Malliaros

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

Machine Learning · Computer Science 2026-05-04 Hugo Attali , Davide Buscaldi , Nathalie Pernelle , Fragkiskos D. Malliaros

The graph Laplacian regularization term is usually used in semi-supervised representation learning to provide graph structure information for a model $f(X)$. However, with the recent popularity of graph neural networks (GNNs), directly…

Machine Learning · Computer Science 2020-12-22 Han Yang , Kaili Ma , James Cheng

Various Graph Neural Networks (GNNs) have been successful in analyzing data in non-Euclidean spaces, however, they have limitations such as oversmoothing, i.e., information becomes excessively averaged as the number of hidden layers…

Machine Learning · Computer Science 2024-01-23 Jaeyoon Sim , Sooyeon Jeon , InJun Choi , Guorong Wu , Won Hwa Kim