English
Related papers

Related papers: Scalable Message Passing Neural Networks: No Need …

200 papers

Graph Neural Networks (GNNs) are widely applied to graph learning problems such as node classification. When scaling up the underlying graphs of GNNs to a larger size, we are forced to either train on the complete graph and keep the full…

Machine Learning · Computer Science 2024-06-25 Mucong Ding , Tahseen Rabbani , Bang An , Evan Z Wang , Furong Huang

Graph Neural Networks (GNNs) are eminently suitable for wireless resource management, thanks to their scalability, but they still face computational challenges in large-scale, dense networks in classical computers. The integration of…

Information Theory · Computer Science 2026-01-27 Le Tung Giang , Nguyen Xuan Tung , Trinh Van Chien , Lajos Hanzo , Won-Joo Hwang

Graph learning tasks often hinge on identifying key substructure patterns -- such as triadic closures in social networks or benzene rings in molecular graphs -- that underpin downstream performance. However, most existing graph neural…

Machine Learning · Computer Science 2025-05-27 Zehong Wang , Zheyuan Zhang , Tianyi Ma , Nitesh V Chawla , Chuxu Zhang , Yanfang Ye

Message-passing neural networks (MPNNs) are a powerful framework for learning representations of graph-structured domains. However, weights in MPNNs act on features only, limiting their ability to capture structural patterns. We introduce a…

Machine Learning · Computer Science 2026-05-26 Florian Seiffarth

Graph Neural Network (GNN), with the main idea of encoding graph structure information of graphs by propagation and aggregation, has developed rapidly. It achieved excellent performance in representation learning of multiple types of graphs…

Machine Learning · Computer Science 2024-07-04 Yushan Zhu , Wen Zhang , Yajing Xu , Zhen Yao , Mingyang Chen , Huajun Chen

Graph Neural Network (GNN) has been demonstrated its effectiveness in dealing with non-Euclidean structural data. Both spatial-based and spectral-based GNNs are relying on adjacency matrix to guide message passing among neighbors during…

Machine Learning · Computer Science 2021-06-09 Yang Hu , Haoxuan You , Zhecan Wang , Zhicheng Wang , Erjin Zhou , Yue Gao

Graph neural networks (GNNs) have become an indispensable tool for analyzing relational data. Classical GNNs are broadly classified into three variants: convolutional, attentional, and message-passing. While the standard message-passing…

Machine Learning · Computer Science 2026-01-09 Brian Godwin Lim , Galvin Brice Lim , Renzo Roel Tan , Irwin King , Kazushi Ikeda

There has been tremendous success in the field of graph neural networks (GNNs) as a result of the development of the message-passing (MP) layer, which updates the representation of a node by combining it with its neighbors to address…

Machine Learning · Computer Science 2022-02-11 Hyeokjin Kwon , Jong-Min Lee

Message-passing graph neural networks (MPNNs) have emerged as the leading approach for machine learning on graphs, attracting significant attention in recent years. While a large set of works explored the expressivity of MPNNs, i.e., their…

Machine Learning · Computer Science 2025-03-21 Antonis Vasileiou , Stefanie Jegelka , Ron Levie , Christopher Morris

Message Passing Neural Networks (MPNNs) model local relations effectively but struggle to propagate information over long distances. Graph Transformers (GTs) mitigate this via global self-attention, yet their quadratic cost in the number of…

Machine Learning · Computer Science 2025-09-03 Shuo Wang , Ge Cheng , Yun Zhang

Since the Message Passing (Graph) Neural Networks (MPNNs) have a linear complexity with respect to the number of nodes when applied to sparse graphs, they have been widely implemented and still raise a lot of interest even though their…

Machine Learning · Computer Science 2021-06-15 Muhammet Balcilar , Pierre Héroux , Benoit Gaüzère , Pascal Vasseur , Sébastien Adam , Paul Honeine

Message Passing Neural Networks (MPNNs) is the building block of graph foundation models, but fundamentally suffer from oversmoothing and oversquashing. There has recently been a surge of interest in fixing both issues. Existing efforts…

Machine Learning · Computer Science 2025-10-21 Li Sun , Zhenhao Huang , Ming Zhang , Philip S. Yu

Graph Neural Networks (GNN) have shown a strong potential to be integrated into commercial products for network control and management. Early works using GNN have demonstrated an unprecedented capability to learn from different network…

Networking and Internet Architecture · Computer Science 2021-10-05 Miquel Ferriol-Galmés , José Suárez-Varela , Krzysztof Rusek , Pere Barlet-Ros , Albert Cabellos-Aparicio

Graph Neural Networks (GNNs) have become a prominent approach to machine learning with graphs and have been increasingly applied in a multitude of domains. Nevertheless, since most existing GNN models are based on flat message-passing…

Machine Learning · Computer Science 2022-10-27 Zhiqiang Zhong , Cheng-Te Li , Jun Pang

While Graph Neural Networks (GNNs) have achieved remarkable success, their design largely relies on empirical intuition rather than theoretical understanding. In this paper, we present a comprehensive analysis of GNN behavior through three…

Machine Learning · Computer Science 2025-02-04 Qin Jiang , Chengjia Wang , Michael Lones , Wei Pang

Recently, message-passing Neural networks (MPNN) provide a promising tool for dealing with molecular graphs and have achieved remarkable success in facilitating the discovery and materials design with desired properties. However, the…

Materials Science · Physics 2023-07-12 Hai Lan , Xian Wei

With the increasing use of Graph Neural Networks (GNNs) in critical real-world applications, several post hoc explanation methods have been proposed to understand their predictions. However, there has been no work in generating explanations…

Machine Learning · Computer Science 2022-12-02 Valentina Giunchiglia , Chirag Varun Shukla , Guadalupe Gonzalez , Chirag Agarwal

Graph Convolutional Neural Networks (GCNNs) are generalizations of CNNs to graph-structured data, in which convolution is guided by the graph topology. In many cases where graphs are unavailable, existing methods manually construct graphs…

Machine Learning · Computer Science 2019-09-17 Xiang Gao , Wei Hu , Zongming Guo

The ability of message-passing neural networks (MPNNs) to fit complex functions over graphs is limited as most graph convolutions amplify the same signal across all feature channels, a phenomenon known as rank collapse, and over-smoothing…

Machine Learning · Computer Science 2024-12-10 Andreas Roth , Franka Bause , Nils M. Kriege , Thomas Liebig

Explaining graph neural networks (GNNs) has become more and more important recently. Higher-order interpretation schemes, such as GNN-LRP (layer-wise relevance propagation for GNN), emerged as powerful tools for unraveling how different…

Machine Learning · Computer Science 2026-05-22 Ping Xiong , Thomas Schnake , Grégoire Montavon , Klaus-Robert Müller , Shinichi Nakajima