English
Related papers

Related papers: Pure Message Passing Can Estimate Common Neighbor …

200 papers

We propose Scalable Message Passing Neural Networks (SMPNNs) and demonstrate that, by integrating standard convolutional message passing into a Pre-Layer Normalization Transformer-style block instead of attention, we can produce…

Machine Learning · Computer Science 2026-03-11 Haitz Sáez de Ocáriz Borde , Artem Lukoianov , Anastasis Kratsios , Michael Bronstein , Xiaowen Dong

The message-passing mechanism helps Graph Neural Networks (GNNs) achieve remarkable results on various node classification tasks. Nevertheless, the recursive nodes fetching and aggregation in message-passing cause inference latency when…

Machine Learning · Computer Science 2022-10-19 Jie Chen , Shouzhen Chen , Mingyuan Bai , Junbin Gao , Junping Zhang , Jian Pu

Neural Processes (NPs) are powerful and flexible models able to incorporate uncertainty when representing stochastic processes, while maintaining a linear time complexity. However, NPs produce a latent description by aggregating independent…

Machine Learning · Computer Science 2020-09-30 Ben Day , Cătălina Cangea , Arian R. Jamasb , Pietro Liò

Message-Passing Neural Networks (MPNNs) have become a cornerstone for processing and analyzing graph-structured data. However, their effectiveness is often hindered by phenomena such as over-squashing, where long-range dependencies or…

Machine Learning · Computer Science 2025-05-30 Shahaf E. Finder , Ron Shapira Weber , Moshe Eliasof , Oren Freifeld , Eran Treister

Graph neural networks (GNNs), as the de-facto model class for representation learning on graphs, are built upon the multi-layer perceptrons (MLP) architecture with additional message passing layers to allow features to flow across nodes.…

Machine Learning · Computer Science 2023-08-07 Chenxiao Yang , Qitian Wu , Jiahua Wang , Junchi Yan

Recent years have witnessed great success in handling graph-related tasks with Graph Neural Networks (GNNs). However, most existing GNNs are based on message passing to perform feature aggregation and transformation, where the structural…

Machine Learning · Computer Science 2024-09-10 Lirong Wu , Haitao Lin , Guojiang Zhao , Cheng Tan , Stan Z. Li

Message passing neural networks (MPNNs) have emerged as go-to models for learning on graph-structured data in the past decade. Despite their effectiveness, most of such models still incur severe issues such as over-smoothing and…

Machine Learning · Computer Science 2025-11-26 Haoran Zheng , Renchi Yang , Yubo Zhou , Jianliang Xu

The counting power of Message Passing Neural Networks (MPNN) has been the subject of many recent papers, showing that they can express logic that involves counting up to a threshold or more generally satisfy a linear arithmetic constraint.…

Machine Learning · Computer Science 2026-05-12 Marco Sälzer , Pascal Bergsträßer , Anthony W. Lin

Molecular property prediction (MPP) is a fundamental but challenging task in the computer-aided drug discovery process. More and more recent works employ different graph-based models for MPP, which have made considerable progress in…

Machine Learning · Computer Science 2023-12-29 Bangyi Zhao , Weixia Xu , Jihong Guan , Shuigeng Zhou

Label imbalance and homophily-heterophily mixture are the fundamental problems encountered when applying Graph Neural Networks (GNNs) to Graph Fraud Detection (GFD) tasks. Existing GNN-based GFD models are designed to augment graph…

Artificial Intelligence · Computer Science 2024-12-03 Wei Zhuo , Zemin Liu , Bryan Hooi , Bingsheng He , Guang Tan , Rizal Fathony , Jia Chen

A hallmark of graph neural networks is their ability to distinguish the isomorphism class of their inputs. This study derives hardness results for the classification variant of graph isomorphism in the message-passing model (MPNN). MPNN…

Machine Learning · Computer Science 2020-10-19 Andreas Loukas

The pairwise interaction paradigm of graph machine learning has predominantly governed the modelling of relational systems. However, graphs alone cannot capture the multi-level interactions present in many complex systems and the expressive…

Machine Learning · Computer Science 2021-06-15 Cristian Bodnar , Fabrizio Frasca , Yu Guang Wang , Nina Otter , Guido Montúfar , Pietro Liò , Michael Bronstein

Graph-based neural networks and, specifically, message-passing neural networks (MPNNs) have shown great potential in predicting physical properties of solids. In this work, we train an MPNN to first classify materials through density…

Computational Physics · Physics 2023-09-13 Tim Bechtel , Daniel T. Speckhard , Jonathan Godwin , Claudia Draxl

Message Passing Neural Networks (MPNNs) have demonstrated remarkable success in node classification on homophilic graphs. It has been shown that they do not solely rely on homophily but on neighborhood distributions of nodes, i.e.,…

Machine Learning · Computer Science 2024-12-12 Matthias Kohn , Marcel Hoffmann , Ansgar Scherp

Most of the current hypergraph learning methodologies and benchmarking datasets in the hypergraph realm are obtained by lifting procedures from their graph analogs, leading to overshadowing specific characteristics of hypergraphs. This…

Artificial Intelligence · Computer Science 2025-03-19 Lev Telyatnikov , Maria Sofia Bucarelli , Guillermo Bernardez , Olga Zaghen , Simone Scardapane , Pietro Lio

Graph neural networks (GNNs) are emerging machine learning models on graphs. Permutation-equivariance and proximity-awareness are two important properties highly desirable for GNNs. Both properties are needed to tackle some challenging…

Machine Learning · Computer Science 2022-02-23 Ziwei Zhang , Chenhao Niu , Peng Cui , Jian Pei , Bo Zhang , Wenwu Zhu

Message-passing graph neural networks (MPGNNs) dominate modern graph learning. Typical efforts enhance MPGNN's expressive power by enriching the adjacency-based aggregation. In contrast, we introduce an efficient aggregation over walk…

Machine Learning · Computer Science 2025-09-29 Marek Černý

While message-passing neural networks (MPNNs) have shown promising results, their real-world impact remains limited. Although various limitations have been identified, their theoretical foundations remain poorly understood, leading to…

Machine Learning · Computer Science 2026-02-05 Andreas Roth

Message Passing Neural Networks (MPNNs) are a staple of graph machine learning. MPNNs iteratively update each node's representation in an input graph by aggregating messages from the node's neighbors, which necessitates a memory complexity…

Machine Learning · Computer Science 2024-12-24 Ben Finkelshtein , İsmail İlkan Ceylan , Michael Bronstein , Ron Levie

Link prediction is a fundamental task in dynamic graph learning (DGL), inherently shaped by the topology of the DG. Recent advancements in dynamic graph neural networks (DGNN), primarily by modeling the relationships among nodes via a…

Machine Learning · Computer Science 2025-04-29 Ling Wang , Minglian Han