English
Related papers

Related papers: Beyond Weisfeiler-Lehman: A Quantitative Framework…

200 papers

Recently, many works studied the expressive power of graph neural networks (GNNs) by linking it to the $1$-dimensional Weisfeiler--Leman algorithm ($1\text{-}\mathsf{WL}$). Here, the $1\text{-}\mathsf{WL}$ is a well-studied heuristic for…

Machine Learning · Computer Science 2023-05-31 Christopher Morris , Floris Geerts , Jan Tönshoff , Martin Grohe

Despite the celebrated popularity of Graph Neural Networks (GNNs) across numerous applications, the ability of GNNs to generalize remains less explored. In this work, we propose to study the generalization of GNNs through a novel…

Machine Learning · Computer Science 2024-04-17 Shouheng Li , Dongwoo Kim , Qing Wang

Graph Neural Networks (GNNs) are learning models aimed at processing graphs and signals on graphs. The most popular and successful GNNs are based on message passing schemes. Such schemes inherently have limited expressive power when it…

Machine Learning · Computer Science 2022-06-24 Jacob Bamberger

Graph neural networks (GNNs) have been widely used in graph-related contexts. It is known that the separation power of GNNs is equivalent to that of the Weisfeiler-Lehman (WL) test; hence, GNNs are imperfect at identifying all…

Machine Learning · Computer Science 2025-02-07 Ziang Chen , Qiao Zhang , Runzhong Wang

Numerous subgraph-enhanced graph neural networks (GNNs) have emerged recently, provably boosting the expressive power of standard (message-passing) GNNs. However, there is a limited understanding of how these approaches relate to each other…

Machine Learning · Computer Science 2022-10-18 Chendi Qian , Gaurav Rattan , Floris Geerts , Christopher Morris , Mathias Niepert

Graph Neural Networks (GNNs) face fundamental limitations in expressivity and capturing structural heterogeneity. Standard message-passing architectures are constrained by the 1-dimensional Weisfeiler-Leman (1-WL) test, unable to…

Machine Learning · Computer Science 2026-05-19 Asela Hevapathige , Ahad N. Zehmakan , Asiri Wijesinghe , Saman Halgamuge

Rethink convolution-based graph neural networks (GNN) -- they characteristically suffer from limited expressiveness, over-smoothing, and over-squashing, and require specialized sparse kernels for efficient computation. Here, we design a…

Machine Learning · Computer Science 2024-10-01 Yuanqing Wang , Kyunghyun Cho

Graph Neural Networks (GNNs) are widely used for graph representation learning in many application domains. The expressiveness of vanilla GNNs is upper-bounded by 1-dimensional Weisfeiler-Leman (1-WL) test as they operate on rooted subtrees…

Machine Learning · Computer Science 2024-01-10 Jiaxing Xu , Aihu Zhang , Qingtian Bian , Vijay Prakash Dwivedi , Yiping Ke

It is well established that spectral graph neural networks (GNNs) can universally approximate node signals; however, their expressive power remains bounded by the 1-dimensional Weisfeiler-Lehman test, which is mirrored in their lack of…

Machine Learning · Computer Science 2026-05-26 Xiaohan Wang , Deyu Bo , Longlong Li , Kelin Xia

A large body of work has investigated the properties of graph neural networks and identified several limitations, particularly pertaining to their expressive power. Their inability to count certain patterns (e.g., cycles) in a graph lies at…

Machine Learning · Computer Science 2024-06-11 Emily Jin , Michael Bronstein , İsmail İlkan Ceylan , Matthias Lanzinger

Message passing Graph Neural Networks (GNNs) provide a powerful modeling framework for relational data. However, the expressive power of existing GNNs is upper-bounded by the 1-Weisfeiler-Lehman (1-WL) graph isomorphism test, which means…

Machine Learning · Computer Science 2021-02-08 Jiaxuan You , Jonathan Gomes-Selman , Rex Ying , Jure Leskovec

We propose and study Hierarchical Ego Graph Neural Networks (HEGNNs), an expressive extension of graph neural networks (GNNs) with hierarchical node individualization, inspired by the Individualization-Refinement paradigm for isomorphism…

Machine Learning · Computer Science 2026-01-26 Arie Soeteman , Balder ten Cate

Relational pooling is a framework for building more expressive and permutation-invariant graph neural networks. However, there is limited understanding of the exact enhancement in the expressivity of RP and its connection with the…

Machine Learning · Computer Science 2023-05-10 Cai Zhou , Xiyuan Wang , Muhan Zhang

Traditional Graph Self-Supervised Learning (GSSL) struggles to capture complex structural properties well. This limitation stems from two main factors: (1) the inadequacy of conventional Graph Neural Networks (GNNs) in representing…

Machine Learning · Computer Science 2025-02-25 Asiri Wijesinghe , Hao Zhu , Piotr Koniusz

Despite significant advances in Graph Neural Networks (GNNs), their limited expressivity remains a fundamental challenge. Research on GNN expressivity has produced many expressive architectures, leading to architecture hierarchies with…

Machine Learning · Computer Science 2025-10-06 Yam Eitan , Moshe Eliasof , Yoav Gelberg , Fabrizio Frasca , Guy Bar-Shalom , Haggai Maron

Identifying similar network structures is key to capture graph isomorphisms and learn representations that exploit structural information encoded in graph data. This work shows that ego-networks can produce a structural encoding scheme for…

Machine Learning · Computer Science 2022-12-09 Nurudin Alvarez-Gonzalez , Andreas Kaltenbrunner , Vicenç Gómez

Graph Neural Networks (GNNs) have emerged as a dominant paradigm for graph classification. Specifically, most existing GNNs mainly rely on the message passing strategy between neighbor nodes, where the expressivity is limited by the…

Machine Learning · Computer Science 2025-12-12 Lin Du , Lu Bai , Jincheng Li , Lixin Cui , Hangyuan Du , Lichi Zhang , Yuting Chen , Zhao Li

A large driver of the complexity of graph learning is the interplay between structure and features. When analyzing the expressivity of graph neural networks, however, existing approaches ignore features in favor of structure, making it…

Machine Learning · Computer Science 2026-03-04 Martin Carrasco , Olga Zaghen , Kavir Sumaraj , Erik Bekkers , Bastian Rieck

Various recent proposals increase the distinguishing power of Graph Neural Networks GNNs by propagating features between $k$-tuples of vertices. The distinguishing power of these "higher-order'' GNNs is known to be bounded by the…

Machine Learning · Computer Science 2021-06-15 Pablo Barceló , Floris Geerts , Juan Reutter , Maksimilian Ryschkov

Graph Neural Networks (GNNs) have achieved remarkable success across diverse applications, yet they remain limited by oversmoothing and poor performance on heterophilic graphs. To address these challenges, we introduce a novel framework…

Machine Learning · Computer Science 2025-11-19 Cristina López Amado , Tassilo Schwarz , Yu Tian , Renaud Lambiotte