English
Related papers

Related papers: The Weisfeiler-Lehman Distance: Reinterpretation a…

200 papers

Recently, many works studied the expressive power of graph neural networks (GNNs) by linking it to the $1$-dimensional Weisfeiler--Leman algorithm ($1\text{-}\mathsf{WL}$). Here, the $1\text{-}\mathsf{WL}$ is a well-studied heuristic for…

Machine Learning · Computer Science 2023-05-31 Christopher Morris , Floris Geerts , Jan Tönshoff , Martin Grohe

We present a framework for embedding graph structured data into a vector space, taking into account node features and topology of a graph into the optimal transport (OT) problem. Then we propose a novel distance between two graphs, named…

Machine Learning · Computer Science 2023-07-04 Dai Hai Nguyen , Koji Tsuda

While Graph Neural Networks (GNNs) have achieved remarkable results in a variety of applications, recent studies exposed important shortcomings in their ability to capture the structure of the underlying graph. It has been shown that the…

Machine Learning · Computer Science 2023-09-26 Giorgos Bouritsas , Fabrizio Frasca , Stefanos Zafeiriou , Michael M. Bronstein

Various recent proposals increase the distinguishing power of Graph Neural Networks GNNs by propagating features between $k$-tuples of vertices. The distinguishing power of these "higher-order'' GNNs is known to be bounded by the…

Machine Learning · Computer Science 2021-06-15 Pablo Barceló , Floris Geerts , Juan Reutter , Maksimilian Ryschkov

Graph Neural Networks (GNNs), despite achieving remarkable performance across different tasks, are theoretically bounded by the 1-Weisfeiler-Lehman test, resulting in limitations in terms of graph expressivity. Even though prior works on…

Machine Learning · Computer Science 2024-04-02 Quang Truong , Peter Chin

Graph similarity metrics serve far-ranging purposes across many domains in data science. As graph datasets grow in size, scientists need comparative tools that capture meaningful differences, yet are lightweight and scalable. Graph Relative…

Combinatorics · Mathematics 2019-08-08 Sinan G. Aksoy , Kathleen E. Nowak , Stephen J. Young

Providing human-understandable insights into the inner workings of neural networks is an important step toward achieving more explainable and trustworthy AI. Existing approaches to such mechanistic interpretability typically require…

Machine Learning · Computer Science 2025-02-04 Tian Gao , Amit Dhurandhar , Karthikeyan Natesan Ramamurthy , Dennis Wei

We introduce a general framework for analyzing data modeled as parameterized families of networks. Building on a Gromov-Wasserstein variant of optimal transport, we define a family of parameterized Gromov-Wasserstein distances for comparing…

Machine Learning · Statistics 2025-09-29 Mario Gómez , Guanqun Ma , Tom Needham , Bei Wang

The expressive power of Graph Neural Networks (GNNs) has been studied extensively through the Weisfeiler-Leman (WL) graph isomorphism test. However, standard GNNs and the WL framework are inapplicable for geometric graphs embedded in…

Machine Learning · Computer Science 2024-03-05 Chaitanya K. Joshi , Cristian Bodnar , Simon V. Mathis , Taco Cohen , Pietro Liò

Gromov-Wasserstein (GW) distance is a powerful tool for comparing and aligning probability distributions supported on different metric spaces. Recently, GW has become the main modeling technique for aligning heterogeneous data for a wide…

Machine Learning · Computer Science 2023-10-31 Lemin Kong , Jiajin Li , Jianheng Tang , Anthony Man-Cho So

The Weisfeiler-Leman (WL) algorithm is a well-known combinatorial procedure for detecting symmetries in graphs and it is widely used in graph-isomorphism tests. It proceeds by iteratively refining a colouring of vertex tuples. The number of…

Discrete Mathematics · Computer Science 2021-07-01 Martin Grohe , Sandra Kiefer

Comparing probability distributions is at the crux of many machine learning algorithms. Maximum Mean Discrepancies (MMD) and Wasserstein distances are two classes of distances between probability distributions that have attracted abundant…

Machine Learning · Statistics 2023-06-01 Titouan Vayer , Rémi Gribonval

Message passing neural networks (MPNNs) have emerged as the most popular framework of graph neural networks (GNNs) in recent years. However, their expressive power is limited by the 1-dimensional Weisfeiler-Lehman (1-WL) test. Some works…

Machine Learning · Computer Science 2024-01-17 Jiarui Feng , Lecheng Kong , Hao Liu , Dacheng Tao , Fuhai Li , Muhan Zhang , Yixin Chen

We establish a bridge between spectral clustering and Gromov-Wasserstein Learning (GWL), a recent optimal transport-based approach to graph partitioning. This connection both explains and improves upon the state-of-the-art performance of…

Machine Learning · Computer Science 2021-03-04 Samir Chowdhury , Tom Needham

This paper presents the Persistent Weisfeiler-Lehman Random walk scheme (abbreviated as PWLR) for graph representations, a novel mathematical framework which produces a collection of explainable low-dimensional representations of graphs…

Machine Learning · Computer Science 2022-08-30 Sun Woo Park , Yun Young Choi , Dosang Joe , U Jin Choi , Youngho Woo

We propose CRaWl, a novel neural network architecture for graph learning. Like graph neural networks, CRaWl layers update node features on a graph and thus can freely be combined or interleaved with GNN layers. Yet CRaWl operates…

Machine Learning · Computer Science 2023-08-22 Jan Tönshoff , Martin Ritzert , Hinrikus Wolf , Martin Grohe

We propose a scalable Gromov-Wasserstein learning (S-GWL) method and establish a novel and theoretically-supported paradigm for large-scale graph analysis. The proposed method is based on the fact that Gromov-Wasserstein discrepancy is a…

Machine Learning · Computer Science 2019-10-10 Hongteng Xu , Dixin Luo , Lawrence Carin

Similarity measures are used extensively in machine learning and data science algorithms. The newly proposed graph Relative Hausdorff (RH) distance is a lightweight yet nuanced similarity measure for quantifying the closeness of two graphs.…

Discrete Mathematics · Computer Science 2019-06-13 Sinan G. Aksoy , Kathleen E. Nowak , Emilie Purvine , Stephen J. Young

In recent years, algorithms and neural architectures based on the Weisfeiler--Leman algorithm, a well-known heuristic for the graph isomorphism problem, have emerged as a powerful tool for machine learning with graphs and relational data.…

The Levenshtein distance is an important tool for the comparison of symbolic sequences, with many appearances in genome research, linguistics and other areas. For efficient applications, an approximation by a distance of smaller…

Quantitative Methods · Quantitative Biology 2007-05-23 Michael Baake , Uwe Grimm , Robert Giegerich