English
Related papers

Related papers: Breaking the Limits of Message Passing Graph Neura…

200 papers

Graph neural networks (GNNs) use graph convolutions to exploit network invariances and learn meaningful feature representations from network data. However, on large-scale graphs convolutions incur in high computational cost, leading to…

Machine Learning · Computer Science 2022-06-29 Juan Cervino , Luana Ruiz , Alejandro Ribeiro

Graph Neural Networks (GNNs) suffer from over-smoothing in deep architectures and expressiveness bounded by the 1-Weisfeiler-Leman (1-WL) test. We adapt Manifold-Constrained Hyper-Connections (\mhc)~\citep{xie2025mhc}, recently proposed for…

Machine Learning · Computer Science 2026-01-07 Subhankar Mishra

A hallmark of graph neural networks is their ability to distinguish the isomorphism class of their inputs. This study derives hardness results for the classification variant of graph isomorphism in the message-passing model (MPNN). MPNN…

Machine Learning · Computer Science 2020-10-19 Andreas Loukas

Message passing Graph Neural Networks (GNNs) are known to be limited in expressive power by the 1-WL color-refinement test for graph isomorphism. Other more expressive models either are computationally expensive or need preprocessing to…

Machine Learning · Computer Science 2024-02-01 Mohammed Haroon Dupty , Yanfei Dong , Wee Sun Lee

Graph neural networks have shown significant success in the field of graph representation learning. Graph convolutions perform neighborhood aggregation and represent one of the most important graph operations. Nevertheless, one layer of…

Machine Learning · Computer Science 2020-07-21 Meng Liu , Hongyang Gao , Shuiwang Ji

Message passing neural networks (MPNN) have seen a steep rise in popularity since their introduction as generalizations of convolutional neural networks to graph-structured data, and are now considered state-of-the-art tools for solving a…

Machine Learning · Computer Science 2022-08-05 Sohir Maskey , Ron Levie , Yunseok Lee , Gitta Kutyniok

While Graph Neural Networks (GNNs) have achieved remarkable success, their design largely relies on empirical intuition rather than theoretical understanding. In this paper, we present a comprehensive analysis of GNN behavior through three…

Machine Learning · Computer Science 2025-02-04 Qin Jiang , Chengjia Wang , Michael Lones , Wei Pang

Graph neural networks (GNNs) are deep learning architectures for machine learning problems on graphs. It has recently been shown that the expressiveness of GNNs can be characterised precisely by the combinatorial Weisfeiler-Leman algorithms…

Machine Learning · Computer Science 2022-01-11 Martin Grohe

Graph Transformer has recently received wide attention in the research community with its outstanding performance, yet its structural expressive power has not been well analyzed. Inspired by the connections between Weisfeiler-Lehman (WL)…

Machine Learning · Computer Science 2023-05-24 Wenhao Zhu , Tianyu Wen , Guojie Song , Liang Wang , Bo Zheng

Graph neural networks (GNNs) have recently emerged as a dominant paradigm for machine learning with graphs. Research on GNNs has mainly focused on the family of message passing neural networks (MPNNs). Similar to the Weisfeiler-Leman (WL)…

Machine Learning · Statistics 2022-07-05 Giannis Nikolentzos , George Dasoulas , Michalis Vazirgiannis

Graph Neural Networks (graph NNs) are a promising deep learning approach for analyzing graph-structured data. However, it is known that they do not improve (or sometimes worsen) their predictive performance as we pile up many layers and add…

Machine Learning · Computer Science 2021-01-07 Kenta Oono , Taiji Suzuki

Graph neural networks (GNNs), consisting of a cascade of layers applying a graph convolution followed by a pointwise nonlinearity, have become a powerful architecture to process signals supported on graphs. Graph convolutions (and thus,…

Machine Learning · Computer Science 2019-10-23 Fernando Gama , Joan Bruna , Alejandro Ribeiro

Line graph transformation has been widely studied in graph theory, where each node in a line graph corresponds to an edge in the original graph. This has inspired a series of graph neural networks (GNNs) applied to transformed line graphs,…

Machine Learning · Computer Science 2025-03-21 Fan Yang , Xingyue Huang

Graph Neural Networks (GNNs) have demonstrated superior performance on various graph learning tasks, including recommendation, where they leverage user-item collaborative filtering signals in graphs. However, theoretical formulations of…

Information Retrieval · Computer Science 2023-09-19 Xuheng Cai , Lianghao Xia , Xubin Ren , Chao Huang

While Graph Neural Networks (GNNs) are powerful models for learning representations on graphs, most state-of-the-art models do not have significant accuracy gain beyond two to three layers. Deep GNNs fundamentally need to address: 1).…

This paper aims to provide a novel design of a multiscale framelet convolution for spectral graph neural networks (GNNs). While current spectral methods excel in various graph learning tasks, they often lack the flexibility to adapt to…

Machine Learning · Computer Science 2024-07-30 Mengxi Yang , Dai Shi , Xuebin Zheng , Jie Yin , Junbin Gao

The message-passing scheme is the core of graph representation learning. While most existing message-passing graph neural networks (MPNNs) are permutation-invariant in graph-level representation learning and permutation-equivariant in node-…

Machine Learning · Computer Science 2022-11-22 Chang Liu , Yuwen Yang , Yue Ding , Hongtao Lu

Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph-structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed…

Machine Learning · Computer Science 2021-06-14 Seongjun Yun , Minbyul Jeong , Sungdong Yoo , Seunghun Lee , Sean S. Yi , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Message-Passing Neural Networks (MPNNs) have become a cornerstone for processing and analyzing graph-structured data. However, their effectiveness is often hindered by phenomena such as over-squashing, where long-range dependencies or…

Machine Learning · Computer Science 2025-05-30 Shahaf E. Finder , Ron Shapira Weber , Moshe Eliasof , Oren Freifeld , Eran Treister

Message-passing neural networks (MPNNs) are a powerful framework for learning representations of graph-structured domains. However, weights in MPNNs act on features only, limiting their ability to capture structural patterns. We introduce a…

Machine Learning · Computer Science 2026-05-26 Florian Seiffarth
‹ Prev 1 3 4 5 6 7 10 Next ›