English
Related papers

Related papers: Message passing all the way up

200 papers

The expressive power of message-passing graph neural networks (MPNNs) is reasonably well understood, primarily through combinatorial techniques from graph isomorphism testing. However, MPNNs' generalization abilities -- making meaningful…

Machine Learning · Computer Science 2024-12-11 Antonis Vasileiou , Ben Finkelshtein , Floris Geerts , Ron Levie , Christopher Morris

This paper studies the problem of learning message propagation strategies for graph neural networks (GNNs). One of the challenges for graph neural networks is that of defining the propagation strategy. For instance, the choices of…

Machine Learning · Computer Science 2023-10-03 Teng Xiao , Zhengyu Chen , Donglin Wang , Suhang Wang

Graph Neural Networks (GNNs) perform computations on graphs by routing the signal between graph regions using a graph shift operator or a message passing scheme. Often, the propagation of the signal leads to a loss of information, where the…

Machine Learning · Computer Science 2026-05-14 Eden Nagar , Ya-Wei Eileen Lin , Ron Levie

Graph neural networks (GNNs) and message passing neural networks (MPNNs) have been proven to be expressive for subgraph structures in many applications. Some applications in heterogeneous graphs require explicit edge modeling, such as…

Machine Learning · Computer Science 2021-12-17 Xin Liu , Yangqiu Song

Long-range interactions are essential for the correct description of complex systems in many scientific fields. The price to pay for including them in the calculations, however, is a dramatic increase in the overall computational costs.…

The algorithms based on message passing neural networks (MPNNs) on graphs have recently achieved great success for various graph applications. However, studies find that these methods always propagate the information to very limited…

Artificial Intelligence · Computer Science 2026-02-10 Mingcan Wang , Junchang Xin , Zhongming Yao , Kaifu Long , Zhiqiong Wang

The trust in the predictions of Graph Neural Networks is limited by their opaque reasoning process. Prior methods have tried to explain graph networks via concept-based explanations extracted from the latent representations obtained after…

Machine Learning · Computer Science 2026-04-23 Lucie Charlotte Magister , Pietro Lio

Graph Neural Networks (GNNs) have seen significant advances in recent years, yet their application to multigraphs, where parallel edges exist between the same pair of nodes, remains under-explored. Standard GNNs, designed for simple graphs,…

Machine Learning · Computer Science 2024-12-11 H. Çağrı Bilgi , Lydia Y. Chen , Kubilay Atasu

Graph signal processing is a framework to handle graph structured data. The fundamental concept is graph shift operator, giving rise to the graph Fourier transform. While the graph Fourier transform is a centralized procedure, distributed…

Signal Processing · Electrical Eng. & Systems 2022-06-10 Feng Ji , Yiqi Lu , Wee Peng Tay , Edwin Chong

Topological deep learning (TDL) has emerged as a powerful tool for modeling higher-order interactions in relational data. However, phenomena such as oversquashing in topological message-passing remain understudied and lack theoretical…

Machine Learning · Computer Science 2025-06-10 Diaaeldin Taha , James Chapman , Marzieh Eidi , Karel Devriendt , Guido Montúfar

Graph neural networks (GNNs) have been predominantly driven by message-passing, where node representations are iteratively updated via local neighborhood aggregation. Despite their success, message-passing suffers from fundamental…

Machine Learning · Computer Science 2025-12-16 Zehong Wang , Zheyuan Zhang , Tianyi Ma , Chuxu Zhang , Yanfang Ye

Graph spanners are sparse subgraphs which approximately preserve all pairwise shortest-path distances in an input graph. The notion of approximation can be additive, multiplicative, or both, and many variants of this problem have been…

Data Structures and Algorithms · Computer Science 2019-11-19 Manuel Fernandez , David P. Woodruff , Taisuke Yasuda

Graph neural networks are popular architectures for graph machine learning, based on iterative computation of node representations of an input graph through a series of invariant transformations. A large class of graph neural networks…

Machine Learning · Computer Science 2024-06-11 Ben Finkelshtein , Xingyue Huang , Michael Bronstein , İsmail İlkan Ceylan

Expressivity theory, characterizing which graphs a GNN can distinguish, has become the predominant framework for analyzing GNNs, with new models striving for higher expressivity. However, we argue that this focus is misguided: First, higher…

Machine Learning · Computer Science 2025-10-23 Niklas Kemper , Tom Wollschläger , Stephan Günnemann

Graph Neural Networks (GNNs) have gained significant attention as a powerful modeling and inference method, especially for homophilic graph-structured data. To empower GNNs in heterophilic graphs, where adjacent nodes exhibit dissimilar…

Machine Learning · Computer Science 2024-06-03 Langzhang Liang , Sunwoo Kim , Kijung Shin , Zenglin Xu , Shirui Pan , Yuan Qi

This paper is devoted to signal processing on point-clouds by means of neural networks. Nowadays, state-of-the-art in image processing and computer vision is mostly based on training deep convolutional neural networks on large datasets.…

Machine Learning · Computer Science 2021-04-06 Amitoz Azad , Julien Rabin , Abderrahim Elmoataz

Graph neural networks have recently emerged as a very effective framework for processing graph-structured data. These models have achieved state-of-the-art performance in many tasks. Most graph neural networks can be described in terms of…

Computation and Language · Computer Science 2019-11-25 Giannis Nikolentzos , Antoine J. -P. Tixier , Michalis Vazirgiannis

Graph Neural Networks (GNNs) have emerged as powerful tools for learning on graph-structured data, but often struggle to balance local and global information. While graph Transformers aim to address this by enabling long-range interactions,…

Machine Learning · Computer Science 2025-11-18 Jeongwhan Choi , Seungjun Park , Sumin Park , Sung-Bae Cho , Noseong Park

Foundation models have achieved remarkable success across many domains, relying on pretraining over vast amounts of data. Graph-structured data often lacks the same scale as unstructured data, making the development of graph foundation…

Graph neural networks (GNNs) are known to be vulnerable to oversmoothing due to their implicit homophily assumption. We mitigate this problem with a novel scheme that regulates the aggregation of messages, modulating the type and extent of…

Machine Learning · Computer Science 2025-12-03 Haishan Wang , Arno Solin , Vikas Garg