English
Related papers

Related papers: Deeper-GXX: Deepening Arbitrary GNNs

200 papers

Recent works have demonstrated the benefits of capturing long-distance dependency in graphs by deeper graph neural networks (GNNs). But deeper GNNs suffer from the long-lasting scalability challenge due to the neighborhood explosion problem…

Machine Learning · Computer Science 2023-06-02 Rui Xue , Haoyu Han , MohamadAli Torkamani , Jian Pei , Xiaorui Liu

Graph Neural Networks (GNNs) have emerged as effective tools for learning tasks on graph-structured data. Recently, Graph-Informed (GI) layers were introduced to address regression tasks on graph nodes, extending their applicability beyond…

Machine Learning · Computer Science 2024-03-21 Francesco Della Santa

Graph convolutional networks (GCNs) have achieved remarkable learning ability for dealing with various graph structural data recently. In general, deep GCNs do not work well since graph convolution in conventional GCNs is a special form of…

Machine Learning · Computer Science 2021-12-08 Zhilong Xiong , Jia Cai

Interpreting graph neural networks (GNNs) is difficult because message passing mixes signals and internal channels rarely align with human concepts. We study superposition, the sharing of directions by multiple features, directly in the…

Machine Learning · Computer Science 2026-01-19 Lukas Pertl , Han Xuanyuan , Pietro Liò

Graph Neural Networks (GNNs) have enjoyed wide spread applications in graph-structured data. However, existing graph based applications commonly lack annotated data. GNNs are required to learn latent patterns from a limited amount of…

Machine Learning · Computer Science 2023-03-22 Wenqi Wei , Mu Qiao , Divyesh Jadav

Graph neural networks (GNNs) are powerful graph-based deep-learning models that have gained significant attention and demonstrated remarkable performance in various domains, including natural language processing, drug discovery, and…

Machine Learning · Computer Science 2023-06-06 Jaykumar Kakkad , Jaspal Jannu , Kartik Sharma , Charu Aggarwal , Sourav Medya

The drastic performance degradation of Graph Neural Networks (GNNs) as the depth of the graph propagation layers exceeds 8-10 is widely attributed to a phenomenon of Over-smoothing. Although recent research suggests that Over-smoothing may…

Machine Learning · Computer Science 2024-08-08 Jie Peng , Runlin Lei , Zhewei Wei

We consider graph representation learning in a self-supervised manner. Graph neural networks (GNNs) use neighborhood aggregation as a core component that results in feature smoothing among nodes in proximity. While successful in various…

Machine Learning · Computer Science 2021-07-20 Wei Zhuo , Guang Tan

Oversmoothing has been recognized as a main obstacle to building deep Graph Neural Networks (GNNs), limiting the performance. This position paper argues that the influence of oversmoothing has been overstated and advocates for a further…

Machine Learning · Computer Science 2025-06-06 MoonJeong Park , Sunghyun Choi , Jaeseung Heo , Eunhyeok Park , Dongwoo Kim

Graph convolutional networks (GCNs) are a widely used method for graph representation learning. To elucidate the capabilities and limitations of GCNs, we investigate their power, as a function of their number of layers, to distinguish…

Machine Learning · Statistics 2020-05-14 Abram Magner , Mayank Baranwal , Alfred O. Hero

Graph neural networks (GNN) has been successfully applied to operate on the graph-structured data. Given a specific scenario, rich human expertise and tremendous laborious trials are usually required to identify a suitable GNN architecture.…

Machine Learning · Computer Science 2019-09-11 Kaixiong Zhou , Qingquan Song , Xiao Huang , Xia Hu

Graph Neural Networks (GNNs) are effective tools for graph representation learning. Most GNNs rely on a recursive neighborhood aggregation scheme, named message passing, thereby their theoretical expressive power is limited to the…

Machine Learning · Computer Science 2023-09-19 Dingmin Wang , Shengchao Liu , Hanchen Wang , Bernardo Cuenca Grau , Linfeng Song , Jian Tang , Song Le , Qi Liu

In recent years, Graph Convolutional Networks (GCNs) and their variants have been widely utilized in learning tasks that involve graphs. These tasks include recommendation systems, node classification, among many others. In node…

Machine Learning · Computer Science 2019-12-23 Mustafa Coskun , Burcu Bakir Gungor , Mehmet Koyuturk

Graph neural networks (GNNs) have struggled to outperform traditional optimization methods on combinatorial problems, limiting their practical impact. We address this gap by introducing a novel chaining procedure for the graph alignment…

Machine Learning · Computer Science 2025-10-06 Marc Lelarge

Graph neural networks (GNNs) continue to achieve state-of-the-art performance on many graph learning tasks, but rely on the assumption that a given graph is a sufficient approximation of the true neighborhood structure. When a system…

Machine Learning · Computer Science 2023-02-08 Steven J. Krieg , William C. Burgis , Patrick M. Soga , Nitesh V. Chawla

Deep Graph Neural Networks (GNNs) are essential for capturing complex dependencies in graph-structured data. However, scaling GNNs to depth remains challenging, as stacking layers leads to representation collapse and diminishing sensitivity…

Machine Learning · Computer Science 2026-05-26 Rémi Bourgerie , Šarūnas Girdzijauskas , Viktoria Fodor

The recent rapid growth in mobile data traffic entails a pressing demand for improving the throughput of the underlying wireless communication networks. Network node deployment has been considered as an effective approach for throughput…

Networking and Internet Architecture · Computer Science 2022-09-16 Yifei Yang , Dongmian Zou , Xiaofan He

The application of graph neural networks (GNNs) to the domain of electrical power grids has high potential impact on smart grid monitoring. Even though there is a natural correspondence of power flow to message-passing in GNNs, their…

Deep Graph Networks (DGNs) currently dominate the research landscape of learning from graphs, due to their efficiency and ability to implement an adaptive message-passing scheme between the nodes. However, DGNs are typically limited in…

Machine Learning · Computer Science 2023-02-09 Alessio Gravina , Davide Bacciu , Claudio Gallicchio

Many popular variants of graph neural networks (GNNs) that are capable of handling multi-relational graphs may suffer from vanishing gradients. In this work, we propose a novel GNN architecture based on the Gated Graph Neural Network with…

Machine Learning · Computer Science 2020-07-21 Denis Lukovnikov , Jens Lehmann , Asja Fischer