English
Related papers

Related papers: Improving the Expressive Power of Graph Neural Net…

200 papers

Graph Neural Networks (GNNs) have become essential in high-stakes domains such as drug discovery, yet their black-box nature remains a significant barrier to trustworthiness. While self-explainable GNNs attempt to bridge this gap, they…

Machine Learning · Computer Science 2026-02-25 Chuqin Geng , Li Zhang , Haolin Ye , Ziyu Zhao , Yuhe Jiang , Tara Saba , Xinyu Wang , Xujie Si

In recent years, there has been a significant amount of research focused on expanding the expressivity of Graph Neural Networks (GNNs) beyond the Weisfeiler-Lehman (1-WL) framework. While many of these studies have yielded advancements in…

Machine Learning · Computer Science 2024-03-12 Shouheng Li , Dongwoo Kim , Qing Wang

Although recent advances in higher-order Graph Neural Networks (GNNs) improve the theoretical expressiveness and molecular property predictive performance, they often fall short of the empirical performance of models that explicitly use…

Machine Learning · Computer Science 2024-07-26 Tom Wollschläger , Niklas Kemper , Leon Hetzel , Johanna Sommer , Stephan Günnemann

Graph Neural Networks (GNNs) are effective tools for graph representation learning. Most GNNs rely on a recursive neighborhood aggregation scheme, named message passing, thereby their theoretical expressive power is limited to the…

Machine Learning · Computer Science 2023-09-19 Dingmin Wang , Shengchao Liu , Hanchen Wang , Bernardo Cuenca Grau , Linfeng Song , Jian Tang , Song Le , Qi Liu

The pairwise interaction paradigm of graph machine learning has predominantly governed the modelling of relational systems. However, graphs alone cannot capture the multi-level interactions present in many complex systems and the expressive…

Machine Learning · Computer Science 2021-06-15 Cristian Bodnar , Fabrizio Frasca , Yu Guang Wang , Nina Otter , Guido Montúfar , Pietro Liò , Michael Bronstein

Current GNN architectures use a vertex neighborhood aggregation scheme, which limits their discriminative power to that of the 1-dimensional Weisfeiler-Lehman (WL) graph isomorphism test. Here, we propose a novel graph convolution operator…

Machine Learning · Computer Science 2020-09-22 Clemens Damke , Vitalik Melnikov , Eyke Hüllermeier

Designing expressive Graph Neural Networks (GNNs) is a fundamental topic in the graph learning community. So far, GNN expressiveness has been primarily assessed via the Weisfeiler-Lehman (WL) hierarchy. However, such an expressivity measure…

Machine Learning · Computer Science 2024-01-17 Bohang Zhang , Jingchu Gai , Yiheng Du , Qiwei Ye , Di He , Liwei Wang

Graph neural networks (GNNs) have emerged recently as a powerful architecture for learning node and graph representations. Standard GNNs have the same expressive power as the Weisfeiler-Leman test of graph isomorphism in terms of…

Machine Learning · Statistics 2020-08-11 Giannis Nikolentzos , George Dasoulas , Michalis Vazirgiannis

Graph neural networks (GNNs) are deep learning architectures for machine learning problems on graphs. It has recently been shown that the expressiveness of GNNs can be characterised precisely by the combinatorial Weisfeiler-Leman algorithms…

Machine Learning · Computer Science 2022-01-11 Martin Grohe

Graph neural networks (GNNs) have been widely used in graph-related contexts. It is known that the separation power of GNNs is equivalent to that of the Weisfeiler-Lehman (WL) test; hence, GNNs are imperfect at identifying all…

Machine Learning · Computer Science 2025-02-07 Ziang Chen , Qiao Zhang , Runzhong Wang

It has been shown that a message passing neural networks (MPNNs), a popular family of neural networks for graph-structured data, are at most as expressive as the first-order Weisfeiler-Leman (1-WL) graph isomorphism test, which has…

Machine Learning · Computer Science 2022-02-22 Markus Zopf

Numerous subgraph-enhanced graph neural networks (GNNs) have emerged recently, provably boosting the expressive power of standard (message-passing) GNNs. However, there is a limited understanding of how these approaches relate to each other…

Machine Learning · Computer Science 2022-10-18 Chendi Qian , Gaurav Rattan , Floris Geerts , Christopher Morris , Mathias Niepert

Graph neural networks are designed to learn functions on graphs. Typically, the relevant target functions are invariant with respect to actions by permutations. Therefore the design of some graph neural network architectures has been…

Machine Learning · Statistics 2022-11-03 Ningyuan Huang , Soledad Villar

The Weisfeiler-Leman algorithm ($1$-WL) is a well-studied heuristic for the graph isomorphism problem. Recently, the algorithm has played a prominent role in understanding the expressive power of message-passing graph neural networks…

Machine Learning · Computer Science 2024-05-29 Billy J. Franks , Christopher Morris , Ameya Velingker , Floris Geerts

In recent years, graph neural networks (GNNs) have emerged as a powerful neural architecture to learn vector representations of nodes and graphs in a supervised, end-to-end fashion. Up to now, GNNs have only been evaluated empirically --…

Graph isomorphism testing is usually approached via the comparison of graph invariants. Two popular alternatives that offer a good trade-off between expressive power and computational efficiency are combinatorial (i.e., obtained via the…

Machine Learning · Computer Science 2022-03-03 Or Feldman , Amit Boyarski , Shai Feldman , Dani Kogan , Avi Mendelson , Chaim Baskin

In this paper we cast neural networks defined on graphs as message-passing neural networks (MPNNs) in order to study the distinguishing power of different classes of such models. We are interested in whether certain architectures are able…

Machine Learning · Computer Science 2020-04-07 Floris Geerts , Filip Mazowiecki , Guillermo A. Pérez

Graph neural networks (GNNs) are effective machine learning models for various graph learning problems. Despite their empirical successes, the theoretical limitations of GNNs have been revealed recently. Consequently, many GNN models have…

Machine Learning · Computer Science 2020-10-19 Ryoma Sato

The expressive power of graph neural networks (GNNs) is typically understood through their correspondence with graph isomorphism tests such as the Weisfeiler-Leman (WL) hierarchy. While more expressive GNNs can distinguish a richer set of…

Hypergraph, an expressive structure with flexibility to model the higher-order correlations among entities, has recently attracted increasing attention from various research domains. Despite the success of Graph Neural Networks (GNNs) for…

Machine Learning · Computer Science 2021-05-04 Jing Huang , Jie Yang