English
Related papers

Related papers: Locality-Aware Graph-Rewiring in GNNs

200 papers

Over-squashing is a challenge in training graph neural networks for tasks involving long-range dependencies. In such tasks, a GNN's receptive field should be large enough to enable communication between distant nodes. However, gathering…

Machine Learning · Computer Science 2025-08-29 Tuğrul Hasan Karabulut , İnci M. Baytaş

Most graph neural networks (GNNs) use the message passing paradigm, in which node features are propagated on the input graph. Recent works pointed to the distortion of information flowing from distant nodes as a factor limiting the…

Graph neural networks (GNNs) rely mainly on the message-passing paradigm to propagate node features and build interactions, and different graph learning problems require different ranges of node interactions. In this work, we explore the…

Machine Learning · Computer Science 2026-01-08 Fang Wu , Siyuan Li , Stan Z. Li

Graph neural networks (GNNs) are widely used in domains like social networks and biological systems. However, the locality assumption of GNNs, which limits information exchange to neighboring nodes, hampers their ability to capture…

Machine Learning · Computer Science 2023-07-04 Tingting Dan , Jiaqi Ding , Ziquan Wei , Shahar Z Kovalsky , Minjeong Kim , Won Hwa Kim , Guorong Wu

Evolving relations in real-world networks are often modelled by temporal graphs. Temporal Graph Neural Networks (TGNNs) emerged to model evolutionary behaviour of such graphs by leveraging the message passing primitive at the core of Graph…

Machine Learning · Computer Science 2024-10-23 Katarina Petrović , Shenyang Huang , Farimah Poursafaei , Petar Veličković

This paper explores sparsification methods as a form of regularization in Graph Neural Networks (GNNs) to address high memory usage and computational costs in large-scale graph applications. Using techniques from Network Science and Machine…

Machine Learning · Computer Science 2026-02-12 Charlotte Cambier van Nooten , Christos Aronis , Yuliya Shapovalova , Lucia Cavallaro

Graph Neural Networks (GNNs) are models that leverage the graph structure to transmit information between nodes, typically through the message-passing operation. While widely successful, this approach is well known to suffer from the…

Message Passing Neural Networks (MPNNs) are instances of Graph Neural Networks that leverage the graph to send messages over the edges. This inductive bias leads to a phenomenon known as over-squashing, where a node feature is insensitive…

Machine Learning · Computer Science 2023-05-25 Francesco Di Giovanni , Lorenzo Giusti , Federico Barbero , Giulia Luise , Pietro Lio' , Michael Bronstein

Graph Neural Networks (GNNs) set the state-of-the-art in representation learning for graph-structured data. They are used in many domains, from online social networks to complex molecules. Most GNNs leverage the message-passing paradigm and…

Machine Learning · Computer Science 2025-03-06 Tuğrul Hasan Karabulut , İnci M. Baytaş

Several recent works use positional encodings to extend the receptive fields of graph neural network (GNN) layers equipped with attention mechanisms. These techniques, however, extend receptive fields to the complete graph, at substantial…

Machine Learning · Computer Science 2023-12-14 Rickard Brüel-Gabrielsson , Mikhail Yurochkin , Justin Solomon

Graph neural networks (GNNs) emerge as a powerful family of representation learning models on graphs. To derive node representations, they utilize a global model that recursively aggregates information from the neighboring nodes. However,…

Machine Learning · Computer Science 2021-11-04 Zemin Liu , Yuan Fang , Chenghao Liu , Steven C. H. Hoi

Graph Neural Networks struggle to capture long-range dependencies due to over-squashing, where information from exponentially growing neighborhoods must pass through a small number of structural bottlenecks. While recent rewiring methods…

Machine Learning · Computer Science 2026-03-13 Bertran Miquel-Oliver , Manel Gil-Sorribes , Victor Guallar , Alexis Molina

Graph Neural Networks (GNNs) excel at analyzing graph-structured data but struggle on heterophilic graphs, where connected nodes often belong to different classes. While this challenge is commonly addressed with specialized GNN…

Machine Learning · Computer Science 2025-05-20 Harel Mendelman , Haggai Maron , Ronen Talmon

Graph Neural Networks (GNNs) have emerged as powerful tools for learning from graph-structured data, leveraging message passing to diffuse information and update node representations. However, most efforts have suggested that native…

Machine Learning · Computer Science 2025-09-23 Sujia Huang , Lele Fu , Zhen Cui , Tong Zhang , Na Song , Bo Huang

Graph Neural Networks (GNNs) have attracted considerable attention and have emerged as a new promising paradigm to process graph-structured data. GNNs are usually stacked to multiple layers and the node representations in each layer are…

Machine Learning · Computer Science 2020-09-25 Yihao Chen , Xin Tang , Xianbiao Qi , Chun-Guang Li , Rong Xiao

Message-passing graph neural networks (MPNNs) emerged as powerful tools for processing graph-structured input. However, they operate on a fixed input graph structure, ignoring potential noise and missing information. Furthermore, their…

Machine Learning · Computer Science 2024-03-27 Chendi Qian , Andrei Manolache , Kareem Ahmed , Zhe Zeng , Guy Van den Broeck , Mathias Niepert , Christopher Morris

Graph Neural Networks (GNNs) have been shown to achieve competitive results to tackle graph-related tasks, such as node and graph classification, link prediction and node and graph clustering in a variety of domains. Most GNNs use a message…

Machine Learning · Computer Science 2023-03-07 Adrian Arnaiz-Rodriguez , Ahmed Begga , Francisco Escolano , Nuria Oliver

Graph neural networks (GNNs) are a powerful solution for various structure learning applications due to their strong representation capabilities for graph data. However, traditional GNNs, relying on message-passing mechanisms that gather…

Machine Learning · Computer Science 2024-03-19 Wei Duan , Jie Lu , Yu Guang Wang , Junyu Xuan

While Graph Neural Networks (GNNs) have demonstrated significant efficacy in node classification tasks, where predictions rely on local neighborhood information, the performance of GNNs often drops when prediction tasks depend on long-range…

Graph Neural Networks (GNNs) have emerged as the leading paradigm for learning over graph-structured data. However, their performance is limited by issues inherent to graph topology, most notably oversquashing and oversmoothing. Recent…

Machine Learning · Computer Science 2025-08-29 Hugo Attali , Thomas Papastergiou , Nathalie Pernelle , Fragkiskos D. Malliaros