English
Related papers

Related papers: Exposition on over-squashing problem on GNNs: Curr…

200 papers

Graph Neural Networks (GNNs) are the state-of-the-art model for machine learning on graph-structured data. The most popular class of GNNs operate by exchanging information between adjacent nodes, and are known as Message Passing Neural…

Message Passing Neural Networks (MPNNs) are widely used for learning on graphs, but their ability to process long-range information is limited by the phenomenon of oversquashing. This limitation has led some researchers to advocate Graph…

Machine Learning · Computer Science 2025-11-26 Yaaqov Mishayev , Yonatan Sverdlov , Tal Amir , Nadav Dym

Message-passing neural networks (MPNNs) often suffer from an information bottleneck when capturing long-range dependencies, leading to the oversquashing (OSQ) phenomenon. Alongside spatial connectivity enrichment (e.g., rewiring), recent…

Machine Learning · Computer Science 2026-05-25 Dai Shi , Luke Thompson , Linhan Luo , Lequan Lin , Andi Han , Junbin Gao , José Miguel Hernández Lobato

Message Passing Neural Networks (MPNNs) are instances of Graph Neural Networks that leverage the graph to send messages over the edges. This inductive bias leads to a phenomenon known as over-squashing, where a node feature is insensitive…

Machine Learning · Computer Science 2023-05-25 Francesco Di Giovanni , Lorenzo Giusti , Federico Barbero , Giulia Luise , Pietro Lio' , Michael Bronstein

Graph Neural Networks (GNNs) revolutionize machine learning for graph-structured data, effectively capturing complex relationships. They disseminate information through interconnected nodes, but long-range interactions face challenges known…

Artificial Intelligence · Computer Science 2025-03-18 Singh Akansha

Graph Neural Networks (GNNs) are models that leverage the graph structure to transmit information between nodes, typically through the message-passing operation. While widely successful, this approach is well known to suffer from the…

Most graph neural networks (GNNs) use the message passing paradigm, in which node features are propagated on the input graph. Recent works pointed to the distortion of information flowing from distant nodes as a factor limiting the…

Graph Neural Networks (GNNs) leverage the graph structure to transmit information between nodes, typically through the message-passing mechanism. While these models have found a wide variety of applications, they are known to suffer from…

Machine Learning · Computer Science 2025-10-23 Hugh Blayney , Álvaro Arroyo , Xiaowen Dong , Michael M. Bronstein

Message passing graph neural networks (GNNs) are a popular learning architectures for graph-structured data. However, one problem GNNs experience is oversquashing, where a GNN has difficulty sending information between distant nodes.…

Machine Learning · Computer Science 2023-06-07 Mitchell Black , Zhengchao Wan , Amir Nayyeri , Yusu Wang

Graph Neural Networks (GNNs) face two fundamental challenges when scaled to deep architectures: oversmoothing, where node representations converge to indistinguishable vectors, and oversquashing, where information from distant nodes fails…

Machine Learning · Computer Science 2026-03-30 Mostafa Haghir Chehreghani

Graph neural networks (GNNs) have become pivotal tools for processing graph-structured data, leveraging the message passing scheme as their core mechanism. However, traditional GNNs often grapple with issues such as instability,…

Spectral Theory · Mathematics 2026-05-20 Yuanhong Jiang , Dongmian Zou , Xiaoqun Zhang , Yu Guang Wang

Since the proposal of the graph neural network (GNN) by Gori et al. (2005) and Scarselli et al. (2008), one of the major problems in training GNNs was their struggle to propagate information between distant nodes in the graph. We propose a…

Machine Learning · Computer Science 2021-03-10 Uri Alon , Eran Yahav

Graph neural networks (GNNs) are able to leverage the structure of graph data by passing messages along the edges of the graph. While this allows GNNs to learn features depending on the graph structure, for certain graph topologies it leads…

Machine Learning · Computer Science 2023-02-17 Kedar Karhadkar , Pradeep Kr. Banerjee , Guido Montúfar

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

Machine Learning · Computer Science 2026-05-05 Hugo Attali , Nathalie Pernelle , Davide Buscaldi , Fragkiskos D. Malliaros

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

Machine Learning · Computer Science 2026-05-04 Hugo Attali , Davide Buscaldi , Nathalie Pernelle , Fragkiskos D. Malliaros

Graph Neural Networks (GNNs) have achieved remarkable success across various domains. However, recent theoretical advances have identified fundamental limitations in their information propagation capabilities, such as over-squashing, where…

Machine Learning · Computer Science 2025-11-04 Ivan Marisca , Jacob Bamberger , Cesare Alippi , Michael M. Bronstein

Graph neural networks (GNNs) have achieved strong performance across various real-world domains. Nevertheless, they suffer from oversquashing, where long-range information is distorted as it is compressed through limited message-passing…

Machine Learning · Computer Science 2026-04-03 Tanvir Hossain , Muhammad Ifte Khairul Islam , Lilia Chebbah , Charles Fanning , Esra Akbas

Graph Neural Networks (GNNs) suffer from Oversquashing, which occurs when tasks require long-range interactions. The problem arises from the presence of bottlenecks that limit the propagation of messages among distant nodes. Recently, graph…

Machine Learning · Computer Science 2025-09-09 Kushal Bose , Swagatam Das

While message passing neural networks (MPNNs) have convincing success in a range of applications, they exhibit limitations such as the oversquashing problem and their inability to capture long-range interactions. Augmenting MPNNs with a…

Machine Learning · Computer Science 2025-04-08 Joshua Southern , Francesco Di Giovanni , Michael Bronstein , Johannes F. Lutzeyer

Message Passing Neural Networks (MPNNs) hold a key position in machine learning on graphs, but they struggle with unintended behaviors, such as over-smoothing and over-squashing, due to irregular data structures. The observation and…

Machine Learning · Computer Science 2025-08-26 Junhyun Lee , Veronika Thost , Bumsoo Kim , Jaewoo Kang , Tengfei Ma
‹ Prev 1 2 3 10 Next ›