English
Related papers

Related papers: On Structural Expressive Power of Graph Transforme…

200 papers

Graph neural network (GNN)'s success in graph classification is closely related to the Weisfeiler-Lehman (1-WL) algorithm. By iteratively aggregating neighboring node features to a center node, both 1-WL and GNN obtain a node representation…

Machine Learning · Computer Science 2021-10-27 Muhan Zhang , Pan Li

The isomorphism problem is a fundamental problem in network analysis, which involves capturing both low-order and high-order structural information. In terms of extracting low-order structural information, graph isomorphism algorithms…

Data Structures and Algorithms · Computer Science 2023-07-28 Yifan Feng , Jiashu Han , Shihui Ying , Yue Gao

In recent years, graph neural networks (GNNs) have emerged as a promising tool for solving machine learning problems on graphs. Most GNNs are members of the family of message passing neural networks (MPNNs). There is a close connection…

Machine Learning · Computer Science 2023-03-01 Giannis Nikolentzos , Michail Chatzianastasis , Michalis Vazirgiannis

Graph Neural Networks (GNNs) have emerged as the de facto standard for representation learning on graphs, owing to their ability to effectively integrate graph topology and node attributes. However, the inherent suboptimal nature of node…

Machine Learning · Computer Science 2023-12-27 Zhiyao Zhou , Sheng Zhou , Bochao Mao , Xuanyi Zhou , Jiawei Chen , Qiaoyu Tan , Daochen Zha , Yan Feng , Chun Chen , Can Wang

The ability of a graph neural network (GNN) to leverage both the graph topology and graph labels is fundamental to building discriminative node and graph embeddings. Building on previous work, we theoretically show that edGNN, our model for…

Machine Learning · Computer Science 2019-12-05 Guillaume Jaume , An-phi Nguyen , María Rodríguez Martínez , Jean-Philippe Thiran , Maria Gabrani

Graph neural networks (GNNs) are a widely used class of machine learning models for graph-structured data, based on local aggregation over neighbors. GNNs have close connections to logic. In particular, their expressive power is linked to…

Logic in Computer Science · Computer Science 2026-01-30 Arie Soeteman , Michael Benedikt , Martin Grohe , Balder ten Cate

In this paper we present a novel graph kernel framework inspired the by the Weisfeiler-Lehman (WL) isomorphism tests. Any WL test comprises a relabelling phase of the nodes based on test-specific information extracted from the graph, for…

Machine Learning · Computer Science 2015-09-23 Giovanni Da San Martino , Nicolò Navarin , Alessandro Sperduti

Despite significant advances in Graph Neural Networks (GNNs), their limited expressivity remains a fundamental challenge. Research on GNN expressivity has produced many expressive architectures, leading to architecture hierarchies with…

Machine Learning · Computer Science 2025-10-06 Yam Eitan , Moshe Eliasof , Yoav Gelberg , Fabrizio Frasca , Guy Bar-Shalom , Haggai Maron

Message passing Graph Neural Networks (GNNs) are known to be limited in expressive power by the 1-WL color-refinement test for graph isomorphism. Other more expressive models either are computationally expensive or need preprocessing to…

Machine Learning · Computer Science 2024-02-01 Mohammed Haroon Dupty , Yanfei Dong , Wee Sun Lee

Recent studies suggest that large language models (LLMs) possess the capability to solve graph reasoning tasks. Notably, even when graph structures are embedded within textual descriptions, LLMs can still effectively answer related…

Computation and Language · Computer Science 2025-10-21 Xinnan Dai , Kai Yang , Jay Revolinsky , Kai Guo , Aoran Wang , Bohang Zhang , Jiliang Tang

Graph Neural Networks (GNNs) are widely used to compute representations of node pairs for downstream tasks such as link prediction. Yet, theoretical understanding of their expressive power has focused almost entirely on graph-level…

Machine Learning · Computer Science 2025-07-01 Veronica Lachi , Francesco Ferrini , Antonio Longa , Bruno Lepri , Andrea Passerini , Manfred Jaeger

Graph neural networks (GNNs) are widely applied in graph data modeling. However, existing GNNs are often trained in a task-driven manner that fails to fully capture the intrinsic nature of the graph structure, resulting in sub-optimal node…

Machine Learning · Computer Science 2024-07-17 Zhenhua Huang , Kunhao Li , Shaojie Wang , Zhaohong Jia , Wentao Zhu , Sharad Mehrotra

We propose a novel expressivity framework for Graph Neural Networks (GNNs) grounded in Boolean function theory, enabling a fine-grained analysis of their ability to capture complex subpopulation structures. We introduce the notion of…

Machine Learning · Computer Science 2026-01-21 Manjish Pal

Graph neural networks (GNNs) have limited expressive power, failing to represent many graph classes correctly. While more expressive graph representation learning (GRL) alternatives can distinguish some of these classes, they are…

Machine Learning · Computer Science 2021-12-08 Leonardo Cotta , Christopher Morris , Bruno Ribeiro

Subgraph GNNs are a recent class of expressive Graph Neural Networks (GNNs) which model graphs as collections of subgraphs. So far, the design space of possible Subgraph GNN architectures as well as their basic theoretical properties are…

Machine Learning · Computer Science 2022-10-17 Fabrizio Frasca , Beatrice Bevilacqua , Michael M. Bronstein , Haggai Maron

Graph Structure Learning (GSL) has recently garnered considerable attention due to its ability to optimize both the parameters of Graph Neural Networks (GNNs) and the computation graph structure simultaneously. Despite the proliferation of…

Machine Learning · Computer Science 2023-10-10 Zhixun Li , Liang Wang , Xin Sun , Yifan Luo , Yanqiao Zhu , Dingshuo Chen , Yingtao Luo , Xiangxin Zhou , Qiang Liu , Shu Wu , Liang Wang , Jeffrey Xu Yu

Spectral Graph Neural Network is a kind of Graph Neural Network (GNN) based on graph signal filters. Some models able to learn arbitrary spectral filters have emerged recently. However, few works analyze the expressive power of spectral…

Machine Learning · Computer Science 2022-06-20 Xiyuan Wang , Muhan Zhang

The problem of graph isomorphism is an important but challenging problem in the field of graph analysis, for example: analyzing the similarity of two chemical molecules, or studying the expressive ability of graph neural networks. WL test…

Other Computer Science · Computer Science 2024-02-14 Wanghan Xu

Theoretical studies on the representation power of GNNs have been centered around understanding the equivalence of GNNs, using WL-Tests for detecting graph isomorphism. In this paper, we argue that such equivalence ignores the accompanying…

Machine Learning · Computer Science 2024-08-26 P. Krishna Kumar a , Harish G. Ramaswamy

We present a fully non neural learning framework based on Graph Laplacian Wavelet Transforms (GLWT). Unlike traditional architectures that rely on convolutional, recurrent, or attention based neural networks, our model operates purely in…

Machine Learning · Computer Science 2025-07-30 Andrew Kiruluta , Andreas Lemos , Priscilla Burity