English
Related papers

Related papers: Higher-Order Expander Graph Propagation

200 papers

Deploying graph neural networks (GNNs) on whole-graph classification or regression tasks is known to be challenging: it often requires computing node features that are mindful of both local interactions in their neighbourhood and the global…

Machine Learning · Computer Science 2022-12-22 Andreea Deac , Marc Lackenby , Petar Veličković

Most graph neural networks (GNNs) use the message passing paradigm, in which node features are propagated on the input graph. Recent works pointed to the distortion of information flowing from distant nodes as a factor limiting the…

Graph Neural Networks (GNNs) perform computations on graphs by routing the signal between graph regions using a graph shift operator or a message passing scheme. Often, the propagation of the signal leads to a loss of information, where the…

Machine Learning · Computer Science 2026-05-14 Eden Nagar , Ya-Wei Eileen Lin , Ron Levie

Graph Neural Networks (GNNs) revolutionize machine learning for graph-structured data, effectively capturing complex relationships. They disseminate information through interconnected nodes, but long-range interactions face challenges known…

Artificial Intelligence · Computer Science 2025-03-18 Singh Akansha

The quality of signal propagation in message-passing graph neural networks (GNNs) strongly influences their expressivity as has been observed in recent works. In particular, for prediction tasks relying on long-range interactions, recursive…

Machine Learning · Computer Science 2022-08-09 Pradeep Kr. Banerjee , Kedar Karhadkar , Yu Guang Wang , Uri Alon , Guido Montúfar

Expander graphs are widely used in communication problems and construction of error correcting codes. In such graphs, information gets through very quickly. Typically, it is not true for social or biological networks, though we may find a…

Combinatorics · Mathematics 2011-03-04 Marianna Bolla

Graph neural networks compute node representations by performing multiple message-passing steps that consist in local aggregations of node features. Having deep models that can leverage longer-range interactions between nodes is hindered by…

Machine Learning · Computer Science 2025-06-27 Alessio Micheli , Domenico Tortorella

Message Passing Neural Networks (MPNNs) are instances of Graph Neural Networks that leverage the graph to send messages over the edges. This inductive bias leads to a phenomenon known as over-squashing, where a node feature is insensitive…

Machine Learning · Computer Science 2023-05-25 Francesco Di Giovanni , Lorenzo Giusti , Federico Barbero , Giulia Luise , Pietro Lio' , Michael Bronstein

Message passing neural networks iteratively generate node embeddings by aggregating information from neighboring nodes. With increasing depth, information from more distant nodes is included. However, node embeddings may be unable to…

Machine Learning · Computer Science 2024-03-29 Franka Bause , Samir Moustafa , Johannes Langguth , Wilfried N. Gansterer , Nils M. Kriege

Graph Neural Networks (GNNs) have achieved remarkable success across various domains. However, recent theoretical advances have identified fundamental limitations in their information propagation capabilities, such as over-squashing, where…

Machine Learning · Computer Science 2025-11-04 Ivan Marisca , Jacob Bamberger , Cesare Alippi , Michael M. Bronstein

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

Machine Learning · Computer Science 2026-05-05 Hugo Attali , Nathalie Pernelle , Davide Buscaldi , Fragkiskos D. Malliaros

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

Machine Learning · Computer Science 2026-05-04 Hugo Attali , Davide Buscaldi , Nathalie Pernelle , Fragkiskos D. Malliaros

Graph neural network have achieved impressive results in predicting molecular properties, but they do not directly account for local and hidden structures in the graph such as functional groups and molecular geometry. At each propagation…

Machine Learning · Computer Science 2020-02-25 Daniel Flam-Shepherd , Tony Wu , Pascal Friederich , Alan Aspuru-Guzik

Graph neural networks (GNNs) are able to leverage the structure of graph data by passing messages along the edges of the graph. While this allows GNNs to learn features depending on the graph structure, for certain graph topologies it leads…

Machine Learning · Computer Science 2023-02-17 Kedar Karhadkar , Pradeep Kr. Banerjee , Guido Montúfar

Recent research in the field of graph neural network (GNN) has identified a critical issue known as "over-squashing," resulting from the bottleneck phenomenon in graph structures, which impedes the propagation of long-range information.…

Machine Learning · Computer Science 2024-07-23 Jeongwhan Choi , Sumin Park , Hyowon Wi , Sung-Bae Cho , Noseong Park

Graph Neural Networks (GNNs) leverage the graph structure to transmit information between nodes, typically through the message-passing mechanism. While these models have found a wide variety of applications, they are known to suffer from…

Machine Learning · Computer Science 2025-10-23 Hugh Blayney , Álvaro Arroyo , Xiaowen Dong , Michael M. Bronstein

In spite of the plethora of success stories with graph neural networks (GNNs) on modelling graph-structured data, they are notoriously vulnerable to over-squashing, whereby tasks necessitate the mixing of information between distance pairs…

Machine Learning · Computer Science 2025-05-20 JJ Wilson , Maya Bechler-Speicher , Petar Veličković

Hypergraph representations are both more efficient and better suited to describe data characterized by relations between two or more objects. In this work, we present a new graph neural network based on message passing capable of processing…

Machine Learning · Computer Science 2022-09-19 Sajjad Heydari , Lorenzo Livi

Graph spanners are sparse subgraphs which approximately preserve all pairwise shortest-path distances in an input graph. The notion of approximation can be additive, multiplicative, or both, and many variants of this problem have been…

Data Structures and Algorithms · Computer Science 2019-11-19 Manuel Fernandez , David P. Woodruff , Taisuke Yasuda

Graph Neural Networks (GNNs) are the state-of-the-art model for machine learning on graph-structured data. The most popular class of GNNs operate by exchanging information between adjacent nodes, and are known as Message Passing Neural…

‹ Prev 1 2 3 10 Next ›