English
Related papers

Related papers: Beyond Weisfeiler-Lehman: A Quantitative Framework…

200 papers

Graph Neural Networks (GNNs) are neural models that leverage the dependency structure in graphical data via message passing among the graph nodes. GNNs have emerged as pivotal architectures in analyzing graph-structured data, and their…

Machine Learning · Computer Science 2024-03-19 Xu Zheng , Farhad Shirani , Tianchun Wang , Wei Cheng , Zhuomin Chen , Haifeng Chen , Hua Wei , Dongsheng Luo

We analyze the universality and generalization of graph neural networks (GNNs) on attributed graphs, i.e., with node attributes. To this end, we propose pseudometrics over the space of all attributed graphs that describe the fine-grained…

Machine Learning · Computer Science 2025-08-27 Levi Rauchwerger , Stefanie Jegelka , Ron Levie

The expressiveness of deep neural network (DNN) is a perspective to understandthe surprising performance of DNN. The number of linear regions, i.e. pieces thata piece-wise-linear function represented by a DNN, is generally used to…

Machine Learning · Computer Science 2020-12-09 Yutong Xie , Gaoxiang Chen , Quanzheng Li

We study the approximation power of Graph Neural Networks (GNNs) on latent position random graphs. In the large graph limit, GNNs are known to converge to certain "continuous" models known as c-GNNs, which directly enables a study of their…

Machine Learning · Statistics 2021-06-01 Nicolas Keriven , Alberto Bietti , Samuel Vaiter

Incorporating spectral information to enhance Graph Neural Networks (GNNs) has shown promising results but raises a fundamental challenge due to the inherent ambiguity of eigenvectors. Various architectures have been proposed to address…

Machine Learning · Computer Science 2024-06-07 Bohang Zhang , Lingxiao Zhao , Haggai Maron

The expressive power of graph neural network formalisms is commonly measured by their ability to distinguish graphs. For many formalisms, the k-dimensional Weisfeiler-Leman (k-WL) graph isomorphism test is used as a yardstick. In this paper…

Machine Learning · Computer Science 2020-07-24 Floris Geerts

Seminal research in the field of graph neural networks (GNNs) has revealed a direct correspondence between the expressive capabilities of GNNs and the $k$-dimensional Weisfeiler-Leman ($k$WL) test, a widely-recognized method for verifying…

Machine Learning · Computer Science 2024-03-29 Matthias Lanzinger , Pablo Barceló

Graph Neural Networks (GNNs) are a powerful tool for machine learning on graphs.GNNs combine node feature information with the graph structure by recursively passing neural messages along edges of the input graph. However, incorporating…

Machine Learning · Computer Science 2019-11-15 Rex Ying , Dylan Bourgeois , Jiaxuan You , Marinka Zitnik , Jure Leskovec

Graph neural networks (GNNs), in general, are built on the assumption of a static set of features characterizing each node in a graph. This assumption is often violated in practice. Existing methods partly address this issue through feature…

Machine Learning · Computer Science 2023-06-07 Shubham Gupta , Sahil Manchanda , Sayan Ranu , Srikanta Bedathur

Graph Neural Networks (GNNs) extend the success of neural networks to graph-structured data by accounting for their intrinsic geometry. While extensive research has been done on developing GNN models with superior performance according to a…

Recent studies on Graph Neural Networks(GNNs) provide both empirical and theoretical evidence supporting their effectiveness in capturing structural patterns on both homophilic and certain heterophilic graphs. Notably, most real-world…

Machine Learning · Computer Science 2023-10-17 Haitao Mao , Zhikai Chen , Wei Jin , Haoyu Han , Yao Ma , Tong Zhao , Neil Shah , Jiliang Tang

Spectral features are widely incorporated within Graph Neural Networks (GNNs) to improve their expressive power, or their ability to distinguish among non-isomorphic graphs. One popular example is the usage of graph Laplacian eigenvectors…

Machine Learning · Computer Science 2025-09-29 Snir Hordan , Maya Bechler-Speicher , Gur Lifshitz , Nadav Dym

Real-world graphs are typically complex, exhibiting heterogeneity in the global structure, as well as strong heterophily within local neighborhoods. While a growing body of literature has revealed the limitations of common graph neural…

Machine Learning · Computer Science 2023-10-19 Jintang Li , Zheng Wei , Jiawang Dan , Jing Zhou , Yuchang Zhu , Ruofan Wu , Baokun Wang , Zhang Zhen , Changhua Meng , Hong Jin , Zibin Zheng , Liang Chen

Graph generation poses a significant challenge as it involves predicting a complete graph with multiple nodes and edges based on simply a given label. This task also carries fundamental importance to numerous real-world applications,…

Machine Learning · Computer Science 2024-02-21 Xiandong Zou , Xiangyu Zhao , Pietro Liò , Yiren Zhao

Graph Neural Networks (GNNs) have emerged in recent years as a powerful tool to learn tasks across a wide range of graph domains in a data-driven fashion; based on a message passing mechanism, GNNs have gained increasing popularity due to…

Machine Learning · Statistics 2024-04-03 Giuseppe Alessio D'Inverno , Monica Bianchini , Franco Scarselli

Graph neural networks are prominent models for representation learning over graph-structured data. While the capabilities and limitations of these models are well-understood for simple graphs, our understanding remains incomplete in the…

Machine Learning · Computer Science 2023-10-27 Xingyue Huang , Miguel Romero Orth , İsmail İlkan Ceylan , Pablo Barceló

Graph neural network (GNN) is a popular tool to learn the lower-dimensional representation of a graph. It facilitates the applicability of machine learning tasks on graphs by incorporating domain-specific features. There are various options…

Machine Learning · Computer Science 2020-08-21 Md. Khaledur Rahman

Subgraph GNNs have emerged as promising architectures that overcome the expressiveness limitations of Graph Neural Networks (GNNs) by processing bags of subgraphs. Despite their compelling empirical performance, these methods are afflicted…

Machine Learning · Computer Science 2025-07-09 Joshua Southern , Yam Eitan , Guy Bar-Shalom , Michael Bronstein , Haggai Maron , Fabrizio Frasca

(1) The enhanced capability of Graph Neural Networks (GNNs) in unsupervised community detection of clustered nodes is attributed to their capacity to encode both the connectivity and feature information spaces of graphs. The identification…

Machine Learning · Computer Science 2024-01-05 William Leeney , Ryan McConville

Message Passing Neural Networks (MPNNs) are a common type of Graph Neural Network (GNN), in which each node's representation is computed recursively by aggregating representations (messages) from its immediate neighbors akin to a…

Machine Learning · Computer Science 2022-04-22 Lingxiao Zhao , Wei Jin , Leman Akoglu , Neil Shah