English
Related papers

Related papers: Weisfeiler and Leman go sparse: Towards scalable h…

200 papers

Graph Neural Networks (GNNs) have emerged as prominent models for representation learning on graph structured data. GNNs follow an approach of message passing analogous to 1-dimensional Weisfeiler Lehman (1-WL) test for graph isomorphism…

Machine Learning · Computer Science 2022-03-18 Mohammed Haroon Dupty , Wee Sun Lee

The expressive power of graph neural networks is usually measured by comparing how many pairs of graphs or nodes an architecture can possibly distinguish as non-isomorphic to those distinguishable by the $k$-dimensional Weisfeiler-Leman…

Machine Learning · Computer Science 2024-04-02 Arjun Subramonian , Adina Williams , Maximilian Nickel , Yizhou Sun , Levent Sagun

We present novel graph kernels for graphs with node and edge labels that have ordered neighborhoods, i.e. when neighbor nodes follow an order. Graphs with ordered neighborhoods are a natural data representation for evolving graphs where…

Machine Learning · Computer Science 2018-05-30 Moez Draief , Konstantin Kutzkov , Kevin Scaman , Milan Vojnovic

The invariance to permutations of the adjacency matrix, i.e., graph isomorphism, is an overarching requirement for Graph Neural Networks (GNNs). Conventionally, this prerequisite can be satisfied by the invariant operations over node…

Machine Learning · Computer Science 2022-05-31 Zhongyu Huang , Yingheng Wang , Chaozhuo Li , Huiguang He

Message passing graph neural networks (GNNs) are known to have their expressiveness upper-bounded by 1-dimensional Weisfeiler-Leman (1-WL) algorithm. To achieve more powerful GNNs, existing attempts either require ad hoc features, or…

Machine Learning · Computer Science 2024-01-24 Meng Liu , Haiyang Yu , Shuiwang Ji

Multi-kernel learning (MKL) has been widely used in function approximation tasks. The key problem of MKL is to combine kernels in a prescribed dictionary. Inclusion of irrelevant kernels in the dictionary can deteriorate accuracy of MKL,…

Machine Learning · Computer Science 2021-02-10 Pouya M Ghari , Yanning Shen

The color refinement algorithm is mainly known as a heuristic method for graph isomorphism testing. It has surprising but natural characterizations in terms of, for example, homomorphism counts from trees and solutions to a system of linear…

Combinatorics · Mathematics 2023-12-20 Jan Böker

Graph kernels are kernel methods measuring graph similarity and serve as a standard tool for graph classification. However, the use of kernel methods for node classification, which is a related problem to graph representation learning, is…

Machine Learning · Computer Science 2019-10-08 Yu Tian , Long Zhao , Xi Peng , Dimitris N. Metaxas

The Weisfeiler-Leman (WL) dimension of a graph is a measure for the inherent descriptive complexity of the graph. While originally derived from a combinatorial graph isomorphism test called the Weisfeiler-Leman algorithm, the WL dimension…

Discrete Mathematics · Computer Science 2019-04-16 Martin Grohe , Sandra Kiefer

Graph Neural Networks (GNNs) are learning models aimed at processing graphs and signals on graphs. The most popular and successful GNNs are based on message passing schemes. Such schemes inherently have limited expressive power when it…

Machine Learning · Computer Science 2022-06-24 Jacob Bamberger

Recently, the Weisfeiler-Lehman (WL) graph isomorphism test was used to measure the expressiveness of graph neural networks (GNNs), showing that the neighborhood aggregation GNNs were at most as powerful as 1-WL test in distinguishing graph…

Machine Learning · Computer Science 2020-12-15 Mingqi Yang , Yanming Shen , Heng Qi , Baocai Yin

Graph Neural Networks (GNN) are inherently limited in their expressive power. Recent seminal works (Xu et al., 2019; Morris et al., 2019b) introduced the Weisfeiler-Lehman (WL) hierarchy as a measure of expressive power. Although this…

Machine Learning · Computer Science 2023-06-06 Omri Puny , Derek Lim , Bobak T. Kiani , Haggai Maron , Yaron Lipman

Stars' chemical signatures provide invaluable insights into stellar cluster formation. This study utilized the Weisfeiler-Lehman (WL) Graph Kernel to examine a 15-dimensional elemental abundance space. Through simulating chemical…

Astrophysics of Galaxies · Physics 2023-06-27 Yuan-Sen Ting , Bhavesh Sharma

Numerous subgraph-enhanced graph neural networks (GNNs) have emerged recently, provably boosting the expressive power of standard (message-passing) GNNs. However, there is a limited understanding of how these approaches relate to each other…

Machine Learning · Computer Science 2022-10-18 Chendi Qian , Gaurav Rattan , Floris Geerts , Christopher Morris , Mathias Niepert

Message Passing Neural Networks (MPNNs) are a common type of Graph Neural Network (GNN), in which each node's representation is computed recursively by aggregating representations (messages) from its immediate neighbors akin to a…

Machine Learning · Computer Science 2022-04-22 Lingxiao Zhao , Wei Jin , Leman Akoglu , Neil Shah

A hypergraph consists of a set of nodes along with a collection of subsets of the nodes called hyperedges. Higher-order link prediction is the task of predicting the existence of a missing hyperedge in a hypergraph. A hyperedge…

Machine Learning · Computer Science 2024-12-04 Simon Zhang , Cheng Xin , Tamal K. Dey

We propose an algorithm for deep learning on networks and graphs. It relies on the notion that many graph algorithms, such as PageRank, Weisfeiler-Lehman, or Message Passing can be expressed as iterative vertex updates. Unlike previous…

Machine Learning · Computer Science 2018-06-05 Emmanouil Antonios Platanios , Alex Smola

Two simple undirected graphs are cospectral if their respective adjacency matrices have the same multiset of eigenvalues. Cospectrality yields an equivalence relation on the family of graphs which is provably weaker than isomorphism. In…

Data Structures and Algorithms · Computer Science 2023-06-21 Gaurav Rattan , Tim Seppelt

Supervised learning has recently garnered significant attention in the field of computational physics due to its ability to effectively extract complex patterns for tasks like solving partial differential equations, or predicting material…

Machine Learning · Statistics 2024-03-12 Raphaël Carpintero Perez , Sébastien da Veiga , Josselin Garnier , Brian Staber

Traditional Graph Self-Supervised Learning (GSSL) struggles to capture complex structural properties well. This limitation stems from two main factors: (1) the inadequacy of conventional Graph Neural Networks (GNNs) in representing…

Machine Learning · Computer Science 2025-02-25 Asiri Wijesinghe , Hao Zhu , Piotr Koniusz