English
Related papers

Related papers: Towards Understanding and Avoiding Limitations of …

200 papers

Graph neural networks (GNNs) are commonly divided into message-passing neural networks (MPNNs) and spectral graph neural networks, reflecting two largely separate research traditions in machine learning and signal processing. This paper…

Graph convolutional networks (GCNs) have shown promising results in processing graph data by extracting structure-aware features. This gave rise to extensive work in geometric deep learning, focusing on designing network architectures that…

Machine Learning · Computer Science 2022-01-20 Yimeng Min , Frederik Wenkel , Guy Wolf

Graph convolutional networks (GCNs) have emerged as a powerful alternative to multiple instance learning with convolutional neural networks in digital pathology, offering superior handling of structural information across various spatial…

Image and Video Processing · Electrical Eng. & Systems 2024-03-25 Victor Ibañez , Przemyslaw Szostak , Quincy Wong , Konstanty Korski , Samaneh Abbasi-Sureshjani , Alvaro Gomariz

Message Passing Neural Networks (MPNNs) is the building block of graph foundation models, but fundamentally suffer from oversmoothing and oversquashing. There has recently been a surge of interest in fixing both issues. Existing efforts…

Machine Learning · Computer Science 2025-10-21 Li Sun , Zhenhao Huang , Ming Zhang , Philip S. Yu

Message passing neural networks (MPNNs) operate on graphs by exchanging information between neigbouring nodes. MPNNs have been successfully applied to various node-, edge-, and graph-level tasks in areas like molecular science, computer…

Machine Learning · Computer Science 2025-11-05 Lisi Qarkaxhija , Anatol E. Wegner , Ingo Scholtes

In recent years, Graph Convolutional Networks (GCNs) have gained popularity for their exceptional ability to process graph-structured data. Existing GCN-based approaches typically employ a shallow model architecture due to the…

Machine Learning · Computer Science 2025-04-22 Jielong Lu , Zhihao Wu , Zhiling Cai , Yueyang Pi , Shiping Wang

Graph Convolutional Networks (GCNs) are one of the most popular architectures that are used to solve classification problems accompanied by graphical information. We present a rigorous theoretical understanding of the effects of graph…

Machine Learning · Computer Science 2022-08-03 Aseem Baranwal , Kimon Fountoulakis , Aukosh Jagannath

To deepen our understanding of graph neural networks, we investigate the representation power of Graph Convolutional Networks (GCN) through the looking glass of graph moments, a key property of graph topology encoding path of various…

Machine Learning · Computer Science 2019-11-04 Nima Dehmamy , Albert-László Barabási , Rose Yu

In recent years, Graph Neural Networks (GNNs) have achieved remarkable success in many graph mining tasks. However, scaling them to large graphs is challenging due to the high computational and storage costs of repeated feature propagation…

Machine Learning · Computer Science 2025-04-11 Yuxuan Liang , Wentao Zhang , Zeang Sheng , Ling Yang , Quanqing Xu , Jiawei Jiang , Yunhai Tong , Bin Cui

Message-passing graph neural networks (MPNNs) have emerged as a powerful paradigm for graph-based machine learning. Despite their effectiveness, MPNNs face challenges such as under-reaching and over-squashing, where limited receptive fields…

Machine Learning · Computer Science 2024-12-03 Chendi Qian , Andrei Manolache , Christopher Morris , Mathias Niepert

Multimodal Graph Neural Networks (MGNNs) have shown strong potential for learning from multimodal attributed graphs, yet most existing approaches rely on tightly coupled architectures that suffer from prohibitive computational overhead. In…

Artificial Intelligence · Computer Science 2026-05-13 Daohan Su , Hao Liu , Xunkai Li , Yinlin Zhu , Xiong Yongfu , Yi Liu , Hongchao Qin , Rong-Hua Li , Guoren Wang

Message Passing Neural Networks (MPNNs) have emerged as the {\em de facto} standard in graph representation learning. However, when it comes to link prediction, they often struggle, surpassed by simple heuristics such as Common Neighbor…

Machine Learning · Computer Science 2024-10-15 Kaiwen Dong , Zhichun Guo , Nitesh V. Chawla

The mechanism of message passing in graph neural networks (GNNs) is still mysterious. Apart from convolutional neural networks, no theoretical origin for GNNs has been proposed. To our surprise, message passing can be best understood in…

Machine Learning · Computer Science 2021-04-16 Xue Li , Yuanzhi Cheng

Graph neural networks have shown significant success in the field of graph representation learning. Graph convolutions perform neighborhood aggregation and represent one of the most important graph operations. Nevertheless, one layer of…

Machine Learning · Computer Science 2020-07-21 Meng Liu , Hongyang Gao , Shuiwang Ji

Graph neural networks (GNNs) have achieved strong performance across various real-world domains. Nevertheless, they suffer from oversquashing, where long-range information is distorted as it is compressed through limited message-passing…

Machine Learning · Computer Science 2026-04-03 Tanvir Hossain , Muhammad Ifte Khairul Islam , Lilia Chebbah , Charles Fanning , Esra Akbas

Graph Neural Networks (GNNs) are powerful deep learning methods for Non-Euclidean data. Popular GNNs are message-passing algorithms (MPNNs) that aggregate and combine signals in a local graph neighborhood. However, shallow MPNNs tend to…

Machine Learning · Statistics 2022-11-08 Ningyuan Huang , Soledad Villar , Carey E. Priebe , Da Zheng , Chengyue Huang , Lin Yang , Vladimir Braverman

The dominant paradigm for learning on graph-structured data is message passing. Despite being a strong inductive bias, the local message passing mechanism suffers from pathological issues such as over-smoothing, over-squashing, and limited…

Machine Learning · Computer Science 2025-04-15 Jacob Bamberger , Federico Barbero , Xiaowen Dong , Michael M. Bronstein

Graph representation learning has now become the de facto standard when handling graph-structured data, with the framework of message-passing graph neural networks (MPNN) being the most prevailing algorithmic tool. Despite its popularity,…

Machine Learning · Computer Science 2023-10-18 Jiawang Dan , Ruofan Wu , Yunpeng Liu , Baokun Wang , Changhua Meng , Tengfei Liu , Tianyi Zhang , Ningtao Wang , Xing Fu , Qi Li , Weiqiang Wang

Subgraph GNNs enhance message-passing GNNs expressivity by representing graphs as sets of subgraphs, demonstrating impressive performance across various tasks. However, their scalability is hindered by the need to process large numbers of…

Machine Learning · Computer Science 2025-06-02 Guy Bar-Shalom , Yam Eitan , Fabrizio Frasca , Haggai Maron

Machine learning for node classification on graphs is a prominent area driven by applications such as recommendation systems. State-of-the-art models often use multiple graph convolutions on the data, as empirical evidence suggests they can…

Machine Learning · Computer Science 2024-12-17 Robert Wang , Aseem Baranwal , Kimon Fountoulakis