English
Related papers

Related papers: Tackling Size Generalization of Graph Neural Netwo…

200 papers

In the past few years, graph neural networks (GNNs) have become the de facto model of choice for graph classification. While, from the theoretical viewpoint, most GNNs can operate on graphs of any size, it is empirically observed that their…

Machine Learning · Computer Science 2022-10-21 Davide Buffelli , Pietro Liò , Fabio Vandin

Graph neural networks (GNNs) can process graphs of different sizes, but their ability to generalize across sizes, specifically from small to large graphs, is still not well understood. In this paper, we identify an important type of data…

Machine Learning · Computer Science 2021-07-19 Gilad Yehudai , Ethan Fetaya , Eli Meirom , Gal Chechik , Haggai Maron

Graph neural networks (GNNs) have become compelling models designed to perform learning and inference on graph-structured data. However, little work has been done to understand the fundamental limitations of GNNs for scaling to larger…

Machine Learning · Computer Science 2023-10-27 Hyungeun Lee , Kijung Yoon

Recent studies on Graph Neural Networks(GNNs) provide both empirical and theoretical evidence supporting their effectiveness in capturing structural patterns on both homophilic and certain heterophilic graphs. Notably, most real-world…

Machine Learning · Computer Science 2023-10-17 Haitao Mao , Zhikai Chen , Wei Jin , Haoyu Han , Yao Ma , Tong Zhao , Neil Shah , Jiliang Tang

Due to inappropriate sample selection and limited training data, a distribution shift often exists between the training and test sets. This shift can adversely affect the test performance of Graph Neural Networks (GNNs). Existing approaches…

Machine Learning · Computer Science 2023-10-16 Rui Ding , Jielong Yang , Feng Ji , Xionghu Zhong , Linbo Xie

Although most graph neural networks (GNNs) can operate on graphs of any size, their classification performance often declines on graphs larger than those encountered during training. Existing methods insufficiently address the removal of…

Machine Learning · Computer Science 2024-06-13 Zheng Huang , Qihui Yang , Dawei Zhou , Yujun Yan

Graph Neural Networks (GNNs) extend convolutional neural networks to operate on graphs. Despite their impressive performances in various graph learning tasks, the theoretical understanding of their generalization capability is still…

Machine Learning · Computer Science 2025-06-10 Zhiyang Wang , Juan Cervino , Alejandro Ribeiro

We aim to better understand attention over nodes in graph neural networks (GNNs) and identify factors influencing its effectiveness. We particularly focus on the ability of attention GNNs to generalize to larger, more complex or noisy…

Machine Learning · Computer Science 2019-10-29 Boris Knyazev , Graham W. Taylor , Mohamed R. Amer

Graph Neural Networks (GNNs) are a new and increasingly popular family of deep neural network architectures to perform learning on graphs. Training them efficiently is challenging due to the irregular nature of graph data. The problem…

Machine Learning · Computer Science 2021-06-15 Marco Serafini , Hui Guan

There has been a recent surge of interest in designing Graph Neural Networks (GNNs) for semi-supervised learning tasks. Unfortunately this work has assumed that the nodes labeled for use in training were selected uniformly at random (i.e.…

Machine Learning · Computer Science 2021-10-28 Qi Zhu , Natalia Ponomareva , Jiawei Han , Bryan Perozzi

Graph neural networks (GNNs) are a type of deep learning models that are trained on graphs and have been successfully applied in various domains. Despite the effectiveness of GNNs, it is still challenging for GNNs to efficiently scale to…

Machine Learning · Computer Science 2023-08-28 Yingxia Shao , Hongzheng Li , Xizhi Gu , Hongbo Yin , Yawen Li , Xupeng Miao , Wentao Zhang , Bin Cui , Lei Chen

Out-of-distribution (OOD) generalization has gained increasing attentions for learning on graphs, as graph neural networks (GNNs) often exhibit performance degradation with distribution shifts. The challenge is that distribution shifts on…

Machine Learning · Computer Science 2024-08-19 Qitian Wu , Fan Nie , Chenxiao Yang , Tianyi Bao , Junchi Yan

Size generalization is important for learning wireless policies, which are often with dynamic sizes, say caused by time-varying number of users. Recent works of learning to optimize resource allocation empirically demonstrate that graph…

Signal Processing · Electrical Eng. & Systems 2022-05-02 Wu Jiajun , Sun Chengjian , Yang Chenyang

Graph Neural Networks (GNNs) have shown remarkable performance on graph-structured data. However, recent empirical studies suggest that GNNs are very susceptible to distribution shift. There is still significant ambiguity about why…

Machine Learning · Computer Science 2023-06-07 Qi Zhu , Yizhu Jiao , Natalia Ponomareva , Jiawei Han , Bryan Perozzi

Graph Neural Networks (GNN) have shown a strong potential to be integrated into commercial products for network control and management. Early works using GNN have demonstrated an unprecedented capability to learn from different network…

Networking and Internet Architecture · Computer Science 2021-10-05 Miquel Ferriol-Galmés , José Suárez-Varela , Krzysztof Rusek , Pere Barlet-Ros , Albert Cabellos-Aparicio

Graph Neural Networks (GNN) are currently the most popular approach for learning and prediction on graph-structured data and are deployed in various fields, from social network analysis to drug discovery. However, there is limited…

Methodology · Statistics 2026-05-26 Nil Ayday , Mahalakshmi Sabanayagam , Debarghya Ghoshdastidar

Graph Neural Networks (GNNs) have led to state-of-the-art performance on a variety of machine learning tasks such as recommendation, node classification and link prediction. Graph neural network models generate node embeddings by merging…

Machine Learning · Computer Science 2020-11-04 Yunpeng Weng , Xu Chen , Liang Chen , Wei Liu

Graph Convolutional Networks (GCNs) have been shown to be a powerful concept that has been successfully applied to a large variety of tasks across many domains over the past years. In this work we study the theory that paved the way to the…

Machine Learning · Computer Science 2022-07-13 Matteo Bunino

Graph neural networks (GNNs) have been widely adopted for semi-supervised learning on graphs. A recent study shows that the graph random neural network (GRAND) model can generate state-of-the-art performance for this problem. However, it is…

Machine Learning · Computer Science 2022-03-15 Wenzheng Feng , Yuxiao Dong , Tinglin Huang , Ziqi Yin , Xu Cheng , Evgeny Kharlamov , Jie Tang

Graph neural networks (GNNs) have attracted much attention due to their ability to leverage the intrinsic geometries of the underlying data. Although many different types of GNN models have been developed, with many benchmarking procedures…

‹ Prev 1 2 3 10 Next ›