English
Related papers

Related papers: Scalable Message Passing Neural Networks: No Need …

200 papers

Most Graph Neural Networks (GNNs) operate at the first-order scale, even though multi-scale representations are known to be crucial in domains such as image classification. In this work, we investigate whether GNNs can similarly benefit…

Machine Learning · Computer Science 2026-04-15 Qin Jiang , Chengjia Wang , Michael Lones , Dongdong Chen , Wei Pang

Message passing-based graph neural networks (GNNs) have achieved great success in many real-world applications. For a sampled mini-batch of target nodes, the message passing process is divided into two parts: message passing between nodes…

Machine Learning · Computer Science 2025-02-28 Zhihao Shi , Jie Wang , Zhiwei Zhuang , Xize Liang , Bin Li , Feng Wu

Spatial Message Passing Graph Neural Networks (MPGNNs) are widely used for learning on graph-structured data. However, key limitations of l-step MPGNNs are that their "receptive field" is typically limited to the l-hop neighborhood of a…

Machine Learning · Computer Science 2024-06-04 Simon Geisler , Arthur Kosmala , Daniel Herbst , Stephan Günnemann

Message passing neural networks (MPNNs) operate on graphs by exchanging information between neigbouring nodes. MPNNs have been successfully applied to various node-, edge-, and graph-level tasks in areas like molecular science, computer…

Machine Learning · Computer Science 2025-11-05 Lisi Qarkaxhija , Anatol E. Wegner , Ingo Scholtes

Graph Neural Networks (GNNs) are powerful deep learning methods for Non-Euclidean data. Popular GNNs are message-passing algorithms (MPNNs) that aggregate and combine signals in a local graph neighborhood. However, shallow MPNNs tend to…

Machine Learning · Statistics 2022-11-08 Ningyuan Huang , Soledad Villar , Carey E. Priebe , Da Zheng , Chengyue Huang , Lin Yang , Vladimir Braverman

Graph Neural Networks (GNNs) have shown promising potential in graph representation learning. The majority of GNNs define a local message-passing mechanism, propagating information over the graph by stacking multiple layers. These methods,…

Machine Learning · Computer Science 2024-02-20 Ali Behrouz , Farnoosh Hashemi

Graph neural networks (GNNs) have been predominantly driven by message-passing, where node representations are iteratively updated via local neighborhood aggregation. Despite their success, message-passing suffers from fundamental…

Machine Learning · Computer Science 2025-12-16 Zehong Wang , Zheyuan Zhang , Tianyi Ma , Chuxu Zhang , Yanfang Ye

Message passing neural networks (MPNNs) have emerged as go-to models for learning on graph-structured data in the past decade. Despite their effectiveness, most of such models still incur severe issues such as over-smoothing and…

Machine Learning · Computer Science 2025-11-26 Haoran Zheng , Renchi Yang , Yubo Zhou , Jianliang Xu

Graph Neural Networks (GNNs) have become a popular approach for various applications, ranging from social network analysis to modeling chemical properties of molecules. While GNNs often show remarkable performance on public datasets, they…

Machine Learning · Computer Science 2022-02-03 Krzysztof Sadowski , Michał Szarmach , Eddie Mattia

Graph neural networks (GNNs) are emerging machine learning models on graphs. Permutation-equivariance and proximity-awareness are two important properties highly desirable for GNNs. Both properties are needed to tackle some challenging…

Machine Learning · Computer Science 2022-02-23 Ziwei Zhang , Chenhao Niu , Peng Cui , Jian Pei , Bo Zhang , Wenwu Zhu

Subgraph GNNs enhance message-passing GNNs expressivity by representing graphs as sets of subgraphs, demonstrating impressive performance across various tasks. However, their scalability is hindered by the need to process large numbers of…

Machine Learning · Computer Science 2025-06-02 Guy Bar-Shalom , Yam Eitan , Fabrizio Frasca , Haggai Maron

In this study, we introduce a domain-decomposition-based distributed training and inference approach for message-passing neural networks (MPNN). Our objective is to address the challenge of scaling edge-based graph neural networks as the…

Machine Learning · Computer Science 2025-02-20 Priyesh Kakka , Sheel Nidhan , Rishikesh Ranade , Jay Pathak , Jonathan F. MacArt

We study the generalization capabilities of Message Passing Neural Networks (MPNNs), a prevalent class of Graph Neural Networks (GNN). We derive generalization bounds specifically for MPNNs with normalized sum aggregation and mean…

Machine Learning · Computer Science 2024-04-05 Sohir Maskey , Gitta Kutyniok , Ron Levie

Many real-world phenomena can be modeled as a graph, making them extremely valuable due to their ubiquitous presence. GNNs excel at capturing those relationships and patterns within these graphs, enabling effective learning and prediction…

Machine Learning · Computer Science 2023-11-28 Abhinav Raghuvanshi , Kushal Sokke Malleshappa

Supervised learning on molecules has incredible potential to be useful in chemistry, drug discovery, and materials science. Luckily, several promising and closely related neural network models invariant to molecular symmetries have already…

Machine Learning · Computer Science 2017-06-14 Justin Gilmer , Samuel S. Schoenholz , Patrick F. Riley , Oriol Vinyals , George E. Dahl

This paper is devoted to signal processing on point-clouds by means of neural networks. Nowadays, state-of-the-art in image processing and computer vision is mostly based on training deep convolutional neural networks on large datasets.…

Machine Learning · Computer Science 2021-04-06 Amitoz Azad , Julien Rabin , Abderrahim Elmoataz

Message Passing Neural Networks (MPNNs) are instances of Graph Neural Networks that leverage the graph to send messages over the edges. This inductive bias leads to a phenomenon known as over-squashing, where a node feature is insensitive…

Machine Learning · Computer Science 2023-05-25 Francesco Di Giovanni , Lorenzo Giusti , Federico Barbero , Giulia Luise , Pietro Lio' , Michael Bronstein

Graph neural networks (GNNs) and message passing neural networks (MPNNs) have been proven to be expressive for subgraph structures in many applications. Some applications in heterogeneous graphs require explicit edge modeling, such as…

Machine Learning · Computer Science 2021-12-17 Xin Liu , Yangqiu Song

Constructing appropriate representations of molecules lies at the core of numerous tasks such as material science, chemistry and drug designs. Recent researches abstract molecules as attributed graphs and employ graph neural networks (GNN)…

Machine Learning · Computer Science 2021-07-29 Jianwen Chen , Shuangjia Zheng , Ying Song , Jiahua Rao , Yuedong Yang

Graph Neural Networks (GNNs) have shown remarkable performance in structured data modeling tasks such as node classification. However, mainstream approaches generally rely on a large number of trainable parameters and fixed aggregation…

Machine Learning · Computer Science 2026-02-17 Mingyue Kong , Yinglong Zhang , Chengda Xu , Xuewen Xia , Xing Xu