English
Related papers

Related papers: A Practical, Progressively-Expressive GNN

200 papers

Recently, subgraph GNNs have emerged as an important direction for developing expressive graph neural networks (GNNs). While numerous architectures have been proposed, so far there is still a limited understanding of how various design…

Machine Learning · Computer Science 2023-03-30 Bohang Zhang , Guhao Feng , Yiheng Du , Di He , Liwei Wang

Graph Neural Networks (GNNs) have emerged as a dominant paradigm for graph classification. Specifically, most existing GNNs mainly rely on the message passing strategy between neighbor nodes, where the expressivity is limited by the…

Machine Learning · Computer Science 2025-12-12 Lin Du , Lu Bai , Jincheng Li , Lixin Cui , Hangyuan Du , Lichi Zhang , Yuting Chen , Zhao Li

Graph Neural Networks (GNNs) are limited in their expressive power, struggle with long-range interactions and lack a principled way to model higher-order structures. These problems can be attributed to the strong coupling between the…

Machine Learning · Computer Science 2022-02-01 Cristian Bodnar , Fabrizio Frasca , Nina Otter , Yu Guang Wang , Pietro Liò , Guido Montúfar , Michael Bronstein

Recently, subgraphs-enhanced Graph Neural Networks (SGNNs) have been introduced to enhance the expressive power of Graph Neural Networks (GNNs), which was proved to be not higher than the 1-dimensional Weisfeiler-Leman isomorphism test. The…

Machine Learning · Computer Science 2023-01-20 Michele Guerra , Indro Spinelli , Simone Scardapane , Filippo Maria Bianchi

Message-passing neural networks (MPNNs) are the leading architecture for deep learning on graph-structured data, in large part due to their simplicity and scalability. Unfortunately, it was shown that these architectures are limited in…

Characterizing the separation power of graph neural networks (GNNs) provides an understanding of their limitations for graph learning tasks. Results regarding separation power are, however, usually geared at specific GNN architectures, and…

Machine Learning · Computer Science 2022-04-12 Floris Geerts , Juan L. Reutter

Relational pooling is a framework for building more expressive and permutation-invariant graph neural networks. However, there is limited understanding of the exact enhancement in the expressivity of RP and its connection with the…

Machine Learning · Computer Science 2023-05-10 Cai Zhou , Xiyuan Wang , Muhan Zhang

Graph Neural Networks (GNNs) have become essential in high-stakes domains such as drug discovery, yet their black-box nature remains a significant barrier to trustworthiness. While self-explainable GNNs attempt to bridge this gap, they…

Machine Learning · Computer Science 2026-02-25 Chuqin Geng , Li Zhang , Haolin Ye , Ziyu Zhao , Yuhe Jiang , Tara Saba , Xinyu Wang , Xujie Si

Graph Neural Networks (GNNs) are widely used to compute representations of node pairs for downstream tasks such as link prediction. Yet, theoretical understanding of their expressive power has focused almost entirely on graph-level…

Machine Learning · Computer Science 2025-07-01 Veronica Lachi , Francesco Ferrini , Antonio Longa , Bruno Lepri , Andrea Passerini , Manfred Jaeger

Message passing Graph Neural Networks (GNNs) provide a powerful modeling framework for relational data. However, the expressive power of existing GNNs is upper-bounded by the 1-Weisfeiler-Lehman (1-WL) graph isomorphism test, which means…

Machine Learning · Computer Science 2021-02-08 Jiaxuan You , Jonathan Gomes-Selman , Rex Ying , Jure Leskovec

The expressive power of graph neural networks is usually measured by comparing how many pairs of graphs or nodes an architecture can possibly distinguish as non-isomorphic to those distinguishable by the $k$-dimensional Weisfeiler-Leman…

Machine Learning · Computer Science 2024-04-02 Arjun Subramonian , Adina Williams , Maximilian Nickel , Yizhou Sun , Levent Sagun

Knowledge graphs, modeling multi-relational data, improve numerous applications such as question answering or graph logical reasoning. Many graph neural networks for such data emerged recently, often outperforming shallow architectures.…

Machine Learning · Computer Science 2022-12-01 Pablo Barcelo , Mikhail Galkin , Christopher Morris , Miguel Romero Orth

Graph Neural Networks (GNNs) have demonstrated superior performance on various graph learning tasks, including recommendation, where they leverage user-item collaborative filtering signals in graphs. However, theoretical formulations of…

Information Retrieval · Computer Science 2023-09-19 Xuheng Cai , Lianghao Xia , Xubin Ren , Chao Huang

The Weisfeiler-Leman algorithm ($1$-WL) is a well-studied heuristic for the graph isomorphism problem. Recently, the algorithm has played a prominent role in understanding the expressive power of message-passing graph neural networks…

Machine Learning · Computer Science 2024-05-29 Billy J. Franks , Christopher Morris , Ameya Velingker , Floris Geerts

The expressive power of Graph Neural Networks (GNNs) has been studied extensively through the Weisfeiler-Leman (WL) graph isomorphism test. However, standard GNNs and the WL framework are inapplicable for geometric graphs embedded in…

Machine Learning · Computer Science 2024-03-05 Chaitanya K. Joshi , Cristian Bodnar , Simon V. Mathis , Taco Cohen , Pietro Liò

We propose a Graph Neural Network with greater expressive power than commonly used GNNs - not constrained to only differentiate between graphs that Weisfeiler-Lehman test recognizes to be non-isomorphic. We use a graph attention network…

Machine Learning · Computer Science 2020-04-14 Stanisław Purgał

In recent years, graph neural networks (GNNs) have emerged as a powerful neural architecture to learn vector representations of nodes and graphs in a supervised, end-to-end fashion. Up to now, GNNs have only been evaluated empirically --…

Despite significant advances in Graph Neural Networks (GNNs), their limited expressivity remains a fundamental challenge. Research on GNN expressivity has produced many expressive architectures, leading to architecture hierarchies with…

Machine Learning · Computer Science 2025-10-06 Yam Eitan , Moshe Eliasof , Yoav Gelberg , Fabrizio Frasca , Guy Bar-Shalom , Haggai Maron

While graph neural networks (GNNs) have achieved great success in learning from graph-structured data, their reliance on local, pairwise message passing restricts their ability to capture complex, high-order subgraph patterns. leading to…

Machine Learning · Computer Science 2025-09-12 Junda Ye , Zhongbao Zhang , Li Sun , Siqiang Luo

The expressive power of message passing GNNs is upper-bounded by Weisfeiler-Lehman (WL) test. To achieve high expressive GNNs beyond WL test, we propose a novel graph isomorphism test method, namely Twin-WL, which simultaneously passes node…

Machine Learning · Computer Science 2022-03-23 Zhaohui Wang , Qi Cao , Huawei Shen , Bingbing Xu , Xueqi Cheng