English
Related papers

Related papers: Weisfeiler-Leman at the margin: When more expressi…

200 papers

Graph Neural Networks (GNNs) are limited in their expressive power, struggle with long-range interactions and lack a principled way to model higher-order structures. These problems can be attributed to the strong coupling between the…

Machine Learning · Computer Science 2022-02-01 Cristian Bodnar , Fabrizio Frasca , Nina Otter , Yu Guang Wang , Pietro Liò , Guido Montúfar , Michael Bronstein

Relational pooling is a framework for building more expressive and permutation-invariant graph neural networks. However, there is limited understanding of the exact enhancement in the expressivity of RP and its connection with the…

Machine Learning · Computer Science 2023-05-10 Cai Zhou , Xiyuan Wang , Muhan Zhang

We propose CRaWl, a novel neural network architecture for graph learning. Like graph neural networks, CRaWl layers update node features on a graph and thus can freely be combined or interleaved with GNN layers. Yet CRaWl operates…

Machine Learning · Computer Science 2023-08-22 Jan Tönshoff , Martin Ritzert , Hinrikus Wolf , Martin Grohe

Graph is an usual representation of relational data, which are ubiquitous in manydomains such as molecules, biological and social networks. A popular approach to learningwith graph structured data is to make use of graph kernels, which…

Machine Learning · Computer Science 2022-08-02 Dai Hai Nguyen , Canh Hao Nguyen , Hiroshi Mamitsuka

Learning to optimize is a rapidly growing area that aims to solve optimization problems or improve existing optimization algorithms using machine learning (ML). In particular, the graph neural network (GNN) is considered a suitable ML model…

Machine Learning · Computer Science 2023-05-29 Ziang Chen , Jialin Liu , Xinshang Wang , Jianfeng Lu , Wotao Yin

The Weisfeiler-Lehman (WL) test is a classical procedure for graph isomorphism testing. The WL test has also been widely used both for designing graph kernels and for analyzing graph neural networks. In this paper, we propose the…

Machine Learning · Computer Science 2022-02-08 Samantha Chen , Sunhyuk Lim , Facundo Mémoli , Zhengchao Wan , Yusu Wang

Message Passing Neural Networks (MPNNs) are a common type of Graph Neural Network (GNN), in which each node's representation is computed recursively by aggregating representations (messages) from its immediate neighbors akin to a…

Machine Learning · Computer Science 2022-04-22 Lingxiao Zhao , Wei Jin , Leman Akoglu , Neil Shah

Twin-width is a graph parameter introduced in the context of first-order model checking, and has since become a central parameter in algorithmic graph theory. While many algorithmic problems become easier on arbitrary classes of bounded…

Combinatorics · Mathematics 2026-01-12 Irene Heinrich , Moritz Lichter , Klara Pakhomenko , Simon Raßmann

Graph Neural Networks (GNNs) excel in handling graph-structured data but often underperform in link prediction tasks compared to classical methods, mainly due to the limitations of the commonly used message-passing principle. Notably, their…

Machine Learning · Computer Science 2025-02-18 Niloofar Azizi , Nils Kriege , Horst Bischof

Numerous subgraph-enhanced graph neural networks (GNNs) have emerged recently, provably boosting the expressive power of standard (message-passing) GNNs. However, there is a limited understanding of how these approaches relate to each other…

Machine Learning · Computer Science 2022-10-18 Chendi Qian , Gaurav Rattan , Floris Geerts , Christopher Morris , Mathias Niepert

Graph Neural Networks (GNNs), despite achieving remarkable performance across different tasks, are theoretically bounded by the 1-Weisfeiler-Lehman test, resulting in limitations in terms of graph expressivity. Even though prior works on…

Machine Learning · Computer Science 2024-04-02 Quang Truong , Peter Chin

Various recent proposals increase the distinguishing power of Graph Neural Networks GNNs by propagating features between $k$-tuples of vertices. The distinguishing power of these "higher-order'' GNNs is known to be bounded by the…

Machine Learning · Computer Science 2021-06-15 Pablo Barceló , Floris Geerts , Juan Reutter , Maksimilian Ryschkov

The $k$-dimensional Weisfeiler-Leman procedure ($k$-WL), which colors $k$-tuples of vertices in rounds based on the neighborhood structure in the graph, has proven to be immensely fruitful in the algorithmic study of Graph Isomorphism. More…

Computational Complexity · Computer Science 2020-06-08 V. Arvind , Frank Fuhlbrück , Johannes Köbler , Oleg Verbitsky

The $k$-dimensional Weisfeiler-Leman algorithm ($k$-WL) is a very useful combinatorial tool in graph isomorphism testing. We address the applicability of $k$-WL to recognition of graph properties. Let $G$ be an input graph with $n$…

Combinatorics · Mathematics 2020-07-31 Frank Fuhlbrück , Johannes Köbler , Ilia Ponomarenko , Oleg Verbitsky

Aligning users across networks using graph representation learning has been found effective where the alignment is accomplished in a low-dimensional embedding space. Yet, achieving highly precise alignment is still challenging, especially…

Social and Information Networks · Computer Science 2023-01-02 Li Liu , Penggang Chen , Xin Li , William K. Cheung , Youmin Zhang , Qun Liu , Guoyin Wang

Graph neural networks (GNNs) are the standard for learning on graphs, yet they have limited expressive power, often expressed in terms of the Weisfeiler-Leman (WL) hierarchy or within the framework of first-order logic. In this context,…

Machine Learning · Computer Science 2026-04-22 Amirreza Akbari , Amauri H. Souza , Vikas Garg

Research on the theoretical expressiveness of Graph Neural Networks (GNNs) has developed rapidly, and many methods have been proposed to enhance the expressiveness. However, most methods do not have a uniform expressiveness measure except…

Machine Learning · Computer Science 2024-06-04 Yanbo Wang , Muhan Zhang

The Weisfeiler-Lehman graph kernels are among the most prevalent graph kernels due to their remarkable time complexity and predictive performance. Their key concept is based on an implicit comparison of neighborhood representing trees with…

Machine Learning · Computer Science 2021-01-21 Till Hendrik Schulz , Tamás Horváth , Pascal Welke , Stefan Wrobel

The majority of popular graph kernels is based on the concept of Haussler's $\mathcal{R}$-convolution kernel and defines graph similarities in terms of mutual substructures. In this work, we enrich these similarity measures by considering…

Machine Learning · Computer Science 2021-10-25 Till Hendrik Schulz , Pascal Welke , Stefan Wrobel

A hypergraph consists of a set of nodes along with a collection of subsets of the nodes called hyperedges. Higher-order link prediction is the task of predicting the existence of a missing hyperedge in a hypergraph. A hyperedge…

Machine Learning · Computer Science 2024-12-04 Simon Zhang , Cheng Xin , Tamal K. Dey