English
Related papers

Related papers: Weisfeiler and Leman Go Walking: Random Walk Kerne…

200 papers

The expressive power of graph neural networks is usually measured by comparing how many pairs of graphs or nodes an architecture can possibly distinguish as non-isomorphic to those distinguishable by the $k$-dimensional Weisfeiler-Leman…

Machine Learning · Computer Science 2024-04-02 Arjun Subramonian , Adina Williams , Maximilian Nickel , Yizhou Sun , Levent Sagun

Node-level random walk has been widely used to improve Graph Neural Networks. However, there is limited attention to random walk on edge and, more generally, on $k$-simplices. This paper systematically analyzes how random walk on different…

Machine Learning · Computer Science 2023-10-31 Cai Zhou , Xiyuan Wang , Muhan Zhang

The expressive power of message passing GNNs is upper-bounded by Weisfeiler-Lehman (WL) test. To achieve high expressive GNNs beyond WL test, we propose a novel graph isomorphism test method, namely Twin-WL, which simultaneously passes node…

Machine Learning · Computer Science 2022-03-23 Zhaohui Wang , Qi Cao , Huawei Shen , Bingbing Xu , Xueqi Cheng

In the study of small and large networks it is customary to perform a simple random walk, where the random walker jumps from one node to one of its neighbours with uniform probability. The properties of this random walk are intimately…

Data Analysis, Statistics and Probability · Physics 2013-09-18 Jean-Charles Delvenne , Anne-Sophie Libert

We study and compare different Graph Neural Network extensions that increase the expressive power of GNNs beyond the Weisfeiler-Leman test. We focus on (i) GNNs based on higher order WL methods, (ii) GNNs that preprocess small substructures…

Machine Learning · Computer Science 2022-02-01 Pál András Papp , Roger Wattenhofer

Graph kernels are historically the most widely-used technique for graph classification tasks. However, these methods suffer from limited performance because of the hand-crafted combinatorial features of graphs. In recent years, graph neural…

Machine Learning · Computer Science 2022-02-28 Aosong Feng , Chenyu You , Shiqiang Wang , Leandros Tassiulas

We precisely characterize the expressivity of computable Recurrent Graph Neural Networks (recurrent GNNs). We prove that recurrent GNNs with finite-precision parameters, sum aggregation, and ReLU activation, can compute any graph algorithm…

Machine Learning · Computer Science 2026-03-17 Eran Rosenbluth , Martin Grohe

A foundation model like GPT elicits many emergent abilities, owing to the pre-training with broad inclusion of data and the use of the powerful Transformer architecture. While foundation models in natural languages are prevalent, can we…

Machine Learning · Computer Science 2025-06-18 Ziyuan Tang , Jie Chen

The invariance to permutations of the adjacency matrix, i.e., graph isomorphism, is an overarching requirement for Graph Neural Networks (GNNs). Conventionally, this prerequisite can be satisfied by the invariant operations over node…

Machine Learning · Computer Science 2022-05-31 Zhongyu Huang , Yingheng Wang , Chaozhuo Li , Huiguang He

Stars' chemical signatures provide invaluable insights into stellar cluster formation. This study utilized the Weisfeiler-Lehman (WL) Graph Kernel to examine a 15-dimensional elemental abundance space. Through simulating chemical…

Astrophysics of Galaxies · Physics 2023-06-27 Yuan-Sen Ting , Bhavesh Sharma

While lifting map has significantly enhanced the expressivity of graph neural networks, extending this paradigm to hypergraphs remains fragmented. To address this, we introduce the categorical Weisfeiler-Lehman framework, which formalizes…

Machine Learning · Computer Science 2026-02-09 Seongjin Choi , Gahee Kim , Se-Young Yun

Hypergraph has been selected as a powerful candidate for characterizing higher-order networks and has received increasing attention in recent years. In this article, we study random walks with resetting on hypergraph by utilizing spectral…

Social and Information Networks · Computer Science 2025-05-08 Fei Ma , Xincheng Hu , Haobin Shi , Wei Pan , Ping Wang

Graph kernels are often used in bioinformatics and network applications to measure the similarity between graphs; therefore, they may be used to construct efficient graph classifiers. Many graph kernels have been developed thus far, but to…

Quantum Physics · Physics 2022-11-01 Kaito Kishi , Takahiko Satoh , Rudy Raymond , Naoki Yamamoto , Yasubumi Sakakibara

We consider a number of graph kernels and proximity measures including commute time kernel, regularized Laplacian kernel, heat kernel, exponential diffusion kernel (also called "communicability"), etc., and the corresponding distances as…

Machine Learning · Computer Science 2017-02-21 Vladimir Ivashkin , Pavel Chebotarev

We propose a random walks based model to generate complex networks. Many authors studied and developed different methods and tools to analyze complex networks by random walk processes. Just to cite a few, random walks have been adopted to…

Physics and Society · Physics 2015-06-19 Marco Alberto Javarone

Graph neural networks have become the de facto model for learning from structured data. However, the decision-making process of GNNs remains opaque to the end user, which undermines their use in safety-critical applications. Several…

Machine Learning · Computer Science 2026-05-12 Michele Fontanesi , Alessio Micheli , Marco Podda , Domenico Tortorella

Current GNN architectures use a vertex neighborhood aggregation scheme, which limits their discriminative power to that of the 1-dimensional Weisfeiler-Lehman (WL) graph isomorphism test. Here, we propose a novel graph convolution operator…

Machine Learning · Computer Science 2020-09-22 Clemens Damke , Vitalik Melnikov , Eyke Hüllermeier

Predicting the occurrence of links is a fundamental problem in networks. In the link prediction problem we are given a snapshot of a network and would like to infer which interactions among existing members are likely to occur in the near…

Social and Information Networks · Computer Science 2010-11-19 L. Backstrom , J. Leskovec

We present a novel quasi-Monte Carlo mechanism to improve graph-based sampling, coined repelling random walks. By inducing correlations between the trajectories of an interacting ensemble such that their marginal transition probabilities…

Machine Learning · Statistics 2024-05-27 Isaac Reid , Eli Berger , Krzysztof Choromanski , Adrian Weller

The random walk formalism is used across a wide range of applications, from modelling share prices to predicting population genetics. Likewise quantum walks have shown much potential as a frame- work for developing new quantum algorithms.…