English
Related papers

Related papers: Uplifting Message Passing Neural Network with Grap…

200 papers

Graph neural networks (GNNs) are a powerful architecture for tackling graph learning tasks, yet have been shown to be oblivious to eminent substructures such as cycles. We present TOGL, a novel layer that incorporates global topological…

Machine Learning · Computer Science 2022-03-18 Max Horn , Edward De Brouwer , Michael Moor , Yves Moreau , Bastian Rieck , Karsten Borgwardt

Graph neural networks (GNNs) are widely used in graph learning and most architectures propagate information by passing messages between vertices. In this work, we shift our attention to GNNs that perform message passing on edges and…

Machine Learning · Computer Science 2026-02-03 Pablo Barceló , Fabian Jogl , Alexander Kozachinskiy , Matthias Lanzinger , Stefan Neumann , Cristóbal Rojas

Recently, the Weisfeiler-Lehman (WL) graph isomorphism test was used to measure the expressive power of graph neural networks (GNN). It was shown that the popular message passing GNN cannot distinguish between graphs that are…

Machine Learning · Computer Science 2020-06-11 Haggai Maron , Heli Ben-Hamu , Hadar Serviansky , Yaron Lipman

Graph Neural Networks (GNNs) have become a prominent approach to machine learning with graphs and have been increasingly applied in a multitude of domains. Nevertheless, since most existing GNN models are based on flat message-passing…

Machine Learning · Computer Science 2022-10-27 Zhiqiang Zhong , Cheng-Te Li , Jun Pang

Graph Neural Network (GNN) has been demonstrated its effectiveness in dealing with non-Euclidean structural data. Both spatial-based and spectral-based GNNs are relying on adjacency matrix to guide message passing among neighbors during…

Machine Learning · Computer Science 2021-06-09 Yang Hu , Haoxuan You , Zhecan Wang , Zhicheng Wang , Erjin Zhou , Yue Gao

Graph Neural Networks (GNNs) have demonstrated remarkable success in learning from graph-structured data. However, they face significant limitations in expressive power, struggling with long-range interactions and lacking a principled…

Machine Learning · Computer Science 2023-06-07 Lorenzo Giusti , Teodora Reu , Francesco Ceccarelli , Cristian Bodnar , Pietro Liò

Graph Neural Networks (GNNs) have demonstrated superior performance on various graph learning tasks, including recommendation, where they leverage user-item collaborative filtering signals in graphs. However, theoretical formulations of…

Information Retrieval · Computer Science 2023-09-19 Xuheng Cai , Lianghao Xia , Xubin Ren , Chao Huang

Message-passing graph neural networks (MPNNs) have emerged as a powerful paradigm for graph-based machine learning. Despite their effectiveness, MPNNs face challenges such as under-reaching and over-squashing, where limited receptive fields…

Machine Learning · Computer Science 2024-12-03 Chendi Qian , Andrei Manolache , Christopher Morris , Mathias Niepert

Despite significant advances in Graph Neural Networks (GNNs), their limited expressivity remains a fundamental challenge. Research on GNN expressivity has produced many expressive architectures, leading to architecture hierarchies with…

Machine Learning · Computer Science 2025-10-06 Yam Eitan , Moshe Eliasof , Yoav Gelberg , Fabrizio Frasca , Guy Bar-Shalom , Haggai Maron

Recently, message-passing graph neural networks (MPNNs) have shown potential for solving combinatorial and continuous optimization problems due to their ability to capture variable-constraint interactions. While existing approaches leverage…

Artificial Intelligence · Computer Science 2025-02-05 Chendi Qian , Christopher Morris

Traditional Graph Self-Supervised Learning (GSSL) struggles to capture complex structural properties well. This limitation stems from two main factors: (1) the inadequacy of conventional Graph Neural Networks (GNNs) in representing…

Machine Learning · Computer Science 2025-02-25 Asiri Wijesinghe , Hao Zhu , Piotr Koniusz

Training deep graph neural networks (GNNs) poses a challenging task, as the performance of GNNs may suffer from the number of hidden message-passing layers. The literature has focused on the proposals of {over-smoothing} and…

Machine Learning · Statistics 2023-02-27 Yirui Liu , Xinghao Qiao , Liying Wang , Jessica Lam

Graph Neural Networks (GNNs), originally proposed for node classification, have also motivated many recent works on edge prediction (a.k.a., link prediction). However, existing methods lack elaborate design regarding the distinctions…

Machine Learning · Computer Science 2024-01-24 Jiarui Jin , Yangkun Wang , Weinan Zhang , Quan Gan , Xiang Song , Yong Yu , Zheng Zhang , David Wipf

Graph Neural Networks (GNNs) traditionally employ a message-passing mechanism that resembles diffusion over undirected graphs, which often leads to homogenization of node features and reduced discriminative power in tasks such as node…

Machine Learning · Computer Science 2025-03-04 Seong Ho Pahng , Sahand Hormoz

Graph Transformers (GTs) have recently emerged as popular alternatives to traditional message-passing Graph Neural Networks (GNNs), due to their theoretically superior expressiveness and impressive performance reported on standard node…

Machine Learning · Computer Science 2024-10-29 Yuankai Luo , Lei Shi , Xiao-Ming Wu

Hypergraphs are crucial for modelling higher-order interactions in real-world data. Hypergraph neural networks (HNNs) effectively utilise these structures by message passing to generate informative node features for various downstream tasks…

Machine Learning · Computer Science 2025-03-12 Bohan Tang , Zexi Liu , Keyue Jiang , Siheng Chen , Xiaowen Dong

Graph Neural Networks (GNNs) have attracted increasing attention in recent years and have achieved excellent performance in semi-supervised node classification tasks. The success of most GNNs relies on one fundamental assumption, i.e., the…

Machine Learning · Computer Science 2024-12-03 Junchao Lin , Yuan Wan , Jingwen Xu , Xingchen Qi

Characterizing the separation power of graph neural networks (GNNs) provides an understanding of their limitations for graph learning tasks. Results regarding separation power are, however, usually geared at specific GNN architectures, and…

Machine Learning · Computer Science 2022-04-12 Floris Geerts , Juan L. Reutter

Graph Neural Networks (GNNs) have seen significant advances in recent years, yet their application to multigraphs, where parallel edges exist between the same pair of nodes, remains under-explored. Standard GNNs, designed for simple graphs,…

Machine Learning · Computer Science 2024-12-11 H. Çağrı Bilgi , Lydia Y. Chen , Kubilay Atasu

Graph Neural Networks (GNNs) face fundamental limitations in expressivity and capturing structural heterogeneity. Standard message-passing architectures are constrained by the 1-dimensional Weisfeiler-Leman (1-WL) test, unable to…

Machine Learning · Computer Science 2026-05-19 Asela Hevapathige , Ahad N. Zehmakan , Asiri Wijesinghe , Saman Halgamuge