中文
相关论文

相关论文: Beyond Weisfeiler-Lehman: A Quantitative Framework…

200 篇论文

The expressive power of message passing GNNs is upper-bounded by Weisfeiler-Lehman (WL) test. To achieve high expressive GNNs beyond WL test, we propose a novel graph isomorphism test method, namely Twin-WL, which simultaneously passes node…

机器学习 · 计算机科学 2022-03-23 Zhaohui Wang , Qi Cao , Huawei Shen , Bingbing Xu , Xueqi Cheng

We propose a novel expressivity framework for Graph Neural Networks (GNNs) grounded in Boolean function theory, enabling a fine-grained analysis of their ability to capture complex subpopulation structures. We introduce the notion of…

机器学习 · 计算机科学 2026-01-21 Manjish Pal

The expressive power of graph neural networks is usually measured by comparing how many pairs of graphs or nodes an architecture can possibly distinguish as non-isomorphic to those distinguishable by the $k$-dimensional Weisfeiler-Leman…

机器学习 · 计算机科学 2024-04-02 Arjun Subramonian , Adina Williams , Maximilian Nickel , Yizhou Sun , Levent Sagun

Despite the remarkable success of Graph Neural Networks (GNNs), the common belief is that their representation power is limited and that they are at most as expressive as the Weisfeiler-Lehman (WL) algorithm. In this paper, we argue the…

机器学习 · 计算机科学 2023-07-25 Charilaos I. Kanatsoulis , Alejandro Ribeiro

The Weisfeiler-Leman algorithm ($1$-WL) is a well-studied heuristic for the graph isomorphism problem. Recently, the algorithm has played a prominent role in understanding the expressive power of message-passing graph neural networks…

机器学习 · 计算机科学 2024-05-29 Billy J. Franks , Christopher Morris , Ameya Velingker , Floris Geerts

Although recent advances in higher-order Graph Neural Networks (GNNs) improve the theoretical expressiveness and molecular property predictive performance, they often fall short of the empirical performance of models that explicitly use…

机器学习 · 计算机科学 2024-07-26 Tom Wollschläger , Niklas Kemper , Leon Hetzel , Johanna Sommer , Stephan Günnemann

The study of Graph Neural Networks has received considerable interest in the past few years. By extending deep learning to graph-structured data, GNNs can solve a diverse set of tasks in fields including social science, chemistry, and…

机器学习 · 计算机科学 2024-03-12 Ashwin Nalwade , Kelly Marshall , Axel Eladi , Umang Sharma

Recent work shows that the expressive power of Graph Neural Networks (GNNs) in distinguishing non-isomorphic graphs is exactly the same as that of the Weisfeiler-Lehman (WL) graph test. In particular, they show that the WL test can be…

Recently, the Weisfeiler-Lehman (WL) graph isomorphism test was used to measure the expressive power of graph neural networks (GNN). It was shown that the popular message passing GNN cannot distinguish between graphs that are…

机器学习 · 计算机科学 2020-06-11 Haggai Maron , Heli Ben-Hamu , Hadar Serviansky , Yaron Lipman

We study and compare different Graph Neural Network extensions that increase the expressive power of GNNs beyond the Weisfeiler-Leman test. We focus on (i) GNNs based on higher order WL methods, (ii) GNNs that preprocess small substructures…

机器学习 · 计算机科学 2022-02-01 Pál András Papp , Roger Wattenhofer

Graph spectra are an important class of structural features on graphs that have shown promising results in enhancing Graph Neural Networks (GNNs). Despite their widespread practical use, the theoretical understanding of the power of…

机器学习 · 计算机科学 2025-03-04 Jingchu Gai , Yiheng Du , Bohang Zhang , Haggai Maron , Liwei Wang

It has been shown that a message passing neural networks (MPNNs), a popular family of neural networks for graph-structured data, are at most as expressive as the first-order Weisfeiler-Leman (1-WL) graph isomorphism test, which has…

机器学习 · 计算机科学 2022-02-22 Markus Zopf

Graph Neural Networks (GNNs) are an effective framework for representation learning of graphs. GNNs follow a neighborhood aggregation scheme, where the representation vector of a node is computed by recursively aggregating and transforming…

机器学习 · 计算机科学 2019-02-26 Keyulu Xu , Weihua Hu , Jure Leskovec , Stefanie Jegelka

In recent years, graph neural networks (GNNs) have emerged as a powerful neural architecture to learn vector representations of nodes and graphs in a supervised, end-to-end fashion. Up to now, GNNs have only been evaluated empirically --…

Graph Transformer has recently received wide attention in the research community with its outstanding performance, yet its structural expressive power has not been well analyzed. Inspired by the connections between Weisfeiler-Lehman (WL)…

机器学习 · 计算机科学 2023-05-24 Wenhao Zhu , Tianyu Wen , Guojie Song , Liang Wang , Bo Zheng

In recent years, there has been a significant amount of research focused on expanding the expressivity of Graph Neural Networks (GNNs) beyond the Weisfeiler-Lehman (1-WL) framework. While many of these studies have yielded advancements in…

机器学习 · 计算机科学 2024-03-12 Shouheng Li , Dongwoo Kim , Qing Wang

Graph Neural Networks (GNNs) are widely used to compute representations of node pairs for downstream tasks such as link prediction. Yet, theoretical understanding of their expressive power has focused almost entirely on graph-level…

机器学习 · 计算机科学 2025-07-01 Veronica Lachi , Francesco Ferrini , Antonio Longa , Bruno Lepri , Andrea Passerini , Manfred Jaeger

Graph neural networks (GNNs) are effective machine learning models for many graph-related applications. Despite their empirical success, many research efforts focus on the theoretical limitations of GNNs, i.e., the GNNs expressive power.…

机器学习 · 计算机科学 2025-01-13 Bingxu Zhang , Changjun Fan , Shixuan Liu , Kuihua Huang , Xiang Zhao , Jincai Huang , Zhong Liu

Recently, subgraphs-enhanced Graph Neural Networks (SGNNs) have been introduced to enhance the expressive power of Graph Neural Networks (GNNs), which was proved to be not higher than the 1-dimensional Weisfeiler-Leman isomorphism test. The…

机器学习 · 计算机科学 2023-01-20 Michele Guerra , Indro Spinelli , Simone Scardapane , Filippo Maria Bianchi

Knowledge graphs, modeling multi-relational data, improve numerous applications such as question answering or graph logical reasoning. Many graph neural networks for such data emerged recently, often outperforming shallow architectures.…

机器学习 · 计算机科学 2022-12-01 Pablo Barcelo , Mikhail Galkin , Christopher Morris , Miguel Romero Orth