中文
相关论文

相关论文: The Weisfeiler-Lehman Distance: Reinterpretation a…

200 篇论文

We define a metric---the network Gromov-Wasserstein distance---on weighted, directed networks that is sensitive to the presence of outliers. In addition to proving its theoretical properties, we supply network invariants based on optimal…

离散数学 · 计算机科学 2019-09-05 Samir Chowdhury , Facundo Mémoli

Recently, two concepts from optimal transport theory have successfully been brought to the Gromov--Wasserstein (GW) setting. This introduces a linear version of the GW distance and multi-marginal GW transport. The former can reduce the…

数值分析 · 数学 2022-11-16 Florian Beier , Robert Beinert

The expressive power of message passing GNNs is upper-bounded by Weisfeiler-Lehman (WL) test. To achieve high expressive GNNs beyond WL test, we propose a novel graph isomorphism test method, namely Twin-WL, which simultaneously passes node…

机器学习 · 计算机科学 2022-03-23 Zhaohui Wang , Qi Cao , Huawei Shen , Bingbing Xu , Xueqi Cheng

In recent years, algorithms and neural architectures based on the Weisfeiler-Leman algorithm, a well-known heuristic for the graph isomorphism problem, emerged as a powerful tool for (supervised) machine learning with graphs and relational…

机器学习 · 计算机科学 2021-11-23 Christopher Morris , Matthias Fey , Nils M. Kriege

Graph Neural Networks (GNN) are inherently limited in their expressive power. Recent seminal works (Xu et al., 2019; Morris et al., 2019b) introduced the Weisfeiler-Lehman (WL) hierarchy as a measure of expressive power. Although this…

机器学习 · 计算机科学 2023-06-06 Omri Puny , Derek Lim , Bobak T. Kiani , Haggai Maron , Yaron Lipman

The $k$-dimensional Weisfeiler-Leman algorithm ($k$-WL) is a fruitful approach to the Graph Isomorphism problem. 2-WL corresponds to the original algorithm suggested by Weisfeiler and Leman over 50 years ago. 1-WL is the classical color…

离散数学 · 计算机科学 2019-04-10 V. Arvind , Frank Fuhlbrück , Johannes Köbler , Oleg Verbitsky

Message passing Graph Neural Networks (GNNs) provide a powerful modeling framework for relational data. However, the expressive power of existing GNNs is upper-bounded by the 1-Weisfeiler-Lehman (1-WL) graph isomorphism test, which means…

机器学习 · 计算机科学 2021-02-08 Jiaxuan You , Jonathan Gomes-Selman , Rex Ying , Jure Leskovec

The invariance to permutations of the adjacency matrix, i.e., graph isomorphism, is an overarching requirement for Graph Neural Networks (GNNs). Conventionally, this prerequisite can be satisfied by the invariant operations over node…

机器学习 · 计算机科学 2022-05-31 Zhongyu Huang , Yingheng Wang , Chaozhuo Li , Huiguang He

Recently used in various machine learning contexts, the Gromov-Wasserstein distance (GW) allows for comparing distributions whose supports do not necessarily lie in the same metric space. However, this Optimal Transport (OT) distance…

机器学习 · 统计学 2022-10-21 Titouan Vayer , Rémi Flamary , Romain Tavenard , Laetitia Chapel , Nicolas Courty

Gromov-Wasserstein distance has found many applications in machine learning due to its ability to compare measures across metric spaces and its invariance to isometric transformations. However, in certain applications, this invariance…

机器学习 · 计算机科学 2023-07-20 Pinar Demetci , Quang Huy Tran , Ievgen Redko , Ritambhara Singh

We introduce the notion of Levenshtein graphs, an analog to Hamming graphs but using the edit distance instead of the Hamming distance; in particular, Levenshtein graphs allow for underlying strings (nodes) of different lengths. We…

数据结构与算法 · 计算机科学 2021-07-16 Perrin E. Ruth , Manuel E. Lladser

Modern large language models (LLMs) such as GPT, Claude, and Gemini have transformed the way we learn, work, and communicate. Yet, their ability to produce highly human-like text raises serious concerns about misinformation and academic…

计算与语言 · 计算机科学 2026-03-03 Hongyi Zhou , Jin Zhu , Kai Ye , Ying Yang , Erhan Xu , Chengchun Shi

The Sliced-Wasserstein distance (SW) is being increasingly used in machine learning applications as an alternative to the Wasserstein distance and offers significant computational and statistical benefits. Since it is defined as an…

机器学习 · 统计学 2022-01-05 Kimia Nadjahi , Alain Durmus , Pierre E. Jacob , Roland Badeau , Umut Şimşekli

Graph kernels based on the $1$-dimensional Weisfeiler-Leman algorithm and corresponding neural architectures recently emerged as powerful tools for (supervised) learning with graphs. However, due to the purely local nature of the…

数据结构与算法 · 计算机科学 2020-10-20 Christopher Morris , Gaurav Rattan , Petra Mutzel

Graph limit models, like graphons for limits of dense graphs, have recently been used to study size transferability of graph neural networks (GNNs). While most literature focuses on message passing GNNs (MPNNs), in this work we attend to…

机器学习 · 计算机科学 2025-05-20 Daniel Herbst , Stefanie Jegelka

The Weisfeiler-Leman (WL) dimension of a graph parameter $f$ is the minimum $k$ such that, if $G_1$ and $G_2$ are indistinguishable by the $k$-dimensional WL-algorithm then $f(G_1)=f(G_2)$. The WL-dimension of $f$ is $\infty$ if no such $k$…

离散数学 · 计算机科学 2024-03-12 Andreas Göbel , Leslie Ann Goldberg , Marc Roth

We derive normal approximation bounds in the Wasserstein distance for sums of weighted U-statistics, based on a general distance bound for functionals of independent random variables of arbitrary distributions. Those bounds are applied to…

概率论 · 数学 2020-07-28 Nicolas Privault , Grzegorz Serafin

We propose a novel method for comparing non-aligned graphs of different sizes, based on the Wasserstein distance between graph signal distributions induced by the respective graph Laplacian matrices. Specifically, we cast a new formulation…

This work presents several expected generalization error bounds based on the Wasserstein distance. More specifically, it introduces full-dataset, single-letter, and random-subset bounds, and their analogues in the randomized subsample…

机器学习 · 统计学 2022-03-29 Borja Rodríguez-Gálvez , Germán Bassi , Ragnar Thobaben , Mikael Skoglund

Although recent advances in higher-order Graph Neural Networks (GNNs) improve the theoretical expressiveness and molecular property predictive performance, they often fall short of the empirical performance of models that explicitly use…

机器学习 · 计算机科学 2024-07-26 Tom Wollschläger , Niklas Kemper , Leon Hetzel , Johanna Sommer , Stephan Günnemann