English
Related papers

Related papers: Graph Neural Network Generalization with Gaussian …

200 papers

Graph Neural Network (GNN) has demonstrated extraordinary performance in classifying graph properties. However, due to the selection bias of training and testing data (e.g., training on small graphs and testing on large graphs, or training…

Machine Learning · Computer Science 2023-08-17 Bin Lu , Xiaoying Gan , Ze Zhao , Shiyu Liang , Luoyi Fu , Xinbing Wang , Chenghu Zhou

Graph neural networks (GNNs) have become compelling models designed to perform learning and inference on graph-structured data. However, little work has been done to understand the fundamental limitations of GNNs for scaling to larger…

Machine Learning · Computer Science 2023-10-27 Hyungeun Lee , Kijung Yoon

Graph Neural Networks (GNNs) have made significant advances on several fundamental inference tasks. As a result, there is a surge of interest in using these models for making potentially important decisions in high-regret applications.…

Machine Learning · Computer Science 2020-02-26 Kaidi Xu , Sijia Liu , Pin-Yu Chen , Mengshu Sun , Caiwen Ding , Bhavya Kailkhura , Xue Lin

Graph neural networks (GNNs) are the most widely adopted model in graph-structured data oriented learning and representation. Despite their extraordinary success in real-world applications, understanding their working mechanism by theory is…

Machine Learning · Computer Science 2023-05-16 Huayi Tang , Yong Liu

Graph neural networks (GNN) have recently emerged as a vehicle for applying deep network architectures to graph and relational data. However, given the increasing size of industrial datasets, in many practical situations the message passing…

Machine Learning · Computer Science 2021-11-16 Qingru Zhang , David Wipf , Quan Gan , Le Song

We study the problem of semi-supervised learning on graphs, for which graph neural networks (GNNs) have been extensively explored. However, most existing GNNs inherently suffer from the limitations of over-smoothing, non-robustness, and…

Machine Learning · Computer Science 2021-09-22 Wenzheng Feng , Jie Zhang , Yuxiao Dong , Yu Han , Huanbo Luan , Qian Xu , Qiang Yang , Evgeny Kharlamov , Jie Tang

Graph neural networks (GNNs) have been widely adopted for semi-supervised learning on graphs. A recent study shows that the graph random neural network (GRAND) model can generate state-of-the-art performance for this problem. However, it is…

Machine Learning · Computer Science 2022-03-15 Wenzheng Feng , Yuxiao Dong , Tinglin Huang , Ziqi Yin , Xu Cheng , Evgeny Kharlamov , Jie Tang

This paper aims at studying the sample complexity of graph convolutional networks (GCNs), by providing tight upper bounds of Rademacher complexity for GCN models with a single hidden layer. Under regularity conditions, theses derived…

Machine Learning · Statistics 2021-02-23 Shaogao Lv

The exponential growth of data has intensified the gap between the availability of unlabeled data and the high cost of manual annotation. Graph Neural Networks (GNNs) have emerged as a promising solution, as they exploit relational…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Rafael Mendonça Duarte , Jean Roberto Ponciano , Lucas Pascotti Valem

Graph Neural Network (GNNs) based methods have recently become a popular tool to deal with graph data because of their ability to incorporate structural information. The only hurdle in the performance of GNNs is the lack of labeled data.…

Machine Learning · Computer Science 2022-08-26 Maria Marrium , Arif Mahmood

Graph Neural Networks (GNNs) are proposed without considering the agnostic distribution shifts between training and testing graphs, inducing the degeneration of the generalization ability of GNNs on Out-Of-Distribution (OOD) settings. The…

Machine Learning · Computer Science 2024-03-12 Shaohua Fan , Xiao Wang , Chuan Shi , Peng Cui , Bai Wang

Graph Neural Networks (GNNs) have emerged as powerful tools for learning over graph-structured data, yet recent studies have shown that their performance gains are beginning to plateau. In many cases, well-established models such as GCN and…

Machine Learning · Computer Science 2026-02-13 Mohit Meena , Yash Punjabi , Abhishek A , Vishal Sharma , Mahesh Chandran

Graph Neural Networks (GNNs) have achieved promising performance in a variety of graph-focused tasks. Despite their success, however, existing GNNs suffer from two significant limitations: a lack of interpretability in their results due to…

Machine Learning · Statistics 2024-11-19 Wenzhuo Zhou , Annie Qu , Keiland W. Cooper , Norbert Fortin , Babak Shahbaba

It is known that the current graph neural networks (GNNs) are difficult to make themselves deep due to the problem known as over-smoothing. Multi-scale GNNs are a promising approach for mitigating the over-smoothing problem. However, there…

Machine Learning · Computer Science 2021-01-07 Kenta Oono , Taiji Suzuki

Graph neural networks (GNNs) have achieved tremendous success on multiple graph-based learning tasks by fusing network structure and node features. Modern GNN models are built upon iterative aggregation of neighbor's/proximity features by…

Machine Learning · Computer Science 2021-06-15 Susheel Suresh , Vinith Budde , Jennifer Neville , Pan Li , Jianzhu Ma

Graph neural networks are widely used tools for graph prediction tasks. Motivated by their empirical performance, prior works have developed generalization bounds for graph neural networks, which scale with graph structures in terms of the…

Machine Learning · Computer Science 2023-10-25 Haotian Ju , Dongyue Li , Aneesh Sharma , Hongyang R. Zhang

We study the generalization capabilities of Message Passing Neural Networks (MPNNs), a prevalent class of Graph Neural Networks (GNN). We derive generalization bounds specifically for MPNNs with normalized sum aggregation and mean…

Machine Learning · Computer Science 2024-04-05 Sohir Maskey , Gitta Kutyniok , Ron Levie

Graph Neural Networks (GNNs) often suffer from weak-generalization due to sparsely labeled data despite their promising results on various graph-based tasks. Data augmentation is a prevalent remedy to improve the generalization ability of…

Machine Learning · Computer Science 2022-03-29 Hyeonjin Park , Seunghun Lee , Sihyeon Kim , Jinyoung Park , Jisu Jeong , Kyung-Min Kim , Jung-Woo Ha , Hyunwoo J. Kim

Graph neural networks have demonstrated excellent applicability to a wide range of domains, including social networks, biological systems, recommendation systems, and wireless communications. Yet a principled theoretical understanding of…

Machine Learning · Computer Science 2026-04-14 Xinping Yi

Despite the celebrated popularity of Graph Neural Networks (GNNs) across numerous applications, the ability of GNNs to generalize remains less explored. In this work, we propose to study the generalization of GNNs through a novel…

Machine Learning · Computer Science 2024-04-17 Shouheng Li , Dongwoo Kim , Qing Wang
‹ Prev 1 2 3 10 Next ›