English
Related papers

Related papers: Towards Dynamic Graph Neural Networks with Provabl…

200 papers

Graph Neural Networks (GNN) are inherently limited in their expressive power. Recent seminal works (Xu et al., 2019; Morris et al., 2019b) introduced the Weisfeiler-Lehman (WL) hierarchy as a measure of expressive power. Although this…

Machine Learning · Computer Science 2023-06-06 Omri Puny , Derek Lim , Bobak T. Kiani , Haggai Maron , Yaron Lipman

Graph Neural Networks (GNNs) have achieved remarkable success across diverse applications, yet they remain limited by oversmoothing and poor performance on heterophilic graphs. To address these challenges, we introduce a novel framework…

Machine Learning · Computer Science 2025-11-19 Cristina López Amado , Tassilo Schwarz , Yu Tian , Renaud Lambiotte

Graph neural networks (GNNs) have drawn increasing attention in recent years and achieved remarkable performance in many graph-based tasks, especially in semi-supervised learning on graphs. However, most existing GNNs are based on the…

Machine Learning · Computer Science 2024-01-24 Li Zhou , Wenyu Chen , Dingyi Zeng , Shaohuan Cheng , Wanlong Liu , Malu Zhang , Hong Qu

Graph neural networks (GNNs) have limited expressive power, failing to represent many graph classes correctly. While more expressive graph representation learning (GRL) alternatives can distinguish some of these classes, they are…

Machine Learning · Computer Science 2021-12-08 Leonardo Cotta , Christopher Morris , Bruno Ribeiro

The most popular design paradigm for Graph Neural Networks (GNNs) is 1-hop message passing -- aggregating information from 1-hop neighbors repeatedly. However, the expressive power of 1-hop message passing is bounded by the…

Machine Learning · Computer Science 2023-01-09 Jiarui Feng , Yixin Chen , Fuhai Li , Anindya Sarkar , Muhan Zhang

Graph learning architectures based on the k-dimensional Weisfeiler-Leman (k-WL) hierarchy offer a theoretically well-understood expressive power. However, such architectures often fail to deliver solid predictive performance on real-world…

Machine Learning · Computer Science 2024-11-11 Luis Müller , Daniel Kusuma , Blai Bonet , Christopher Morris

In recent years, Dynamic Graph (DG) representations have been increasingly used for modeling dynamic systems due to their ability to integrate both topological and temporal information in a compact representation. Dynamic graphs allow to…

Machine Learning · Computer Science 2023-04-13 Leshanshui Yang , Sébastien Adam , Clément Chatelain

Hypergraph, an expressive structure with flexibility to model the higher-order correlations among entities, has recently attracted increasing attention from various research domains. Despite the success of Graph Neural Networks (GNNs) for…

Machine Learning · Computer Science 2021-05-04 Jing Huang , Jie Yang

Effectively combining logic reasoning and probabilistic inference has been a long-standing goal of machine learning: the former has the ability to generalize with small training data, while the latter provides a principled framework for…

Machine Learning · Computer Science 2019-09-24 Yuyu Zhang , Xinshi Chen , Yuan Yang , Arun Ramamurthy , Bo Li , Yuan Qi , Le Song

We propose a Graph Neural Network with greater expressive power than commonly used GNNs - not constrained to only differentiate between graphs that Weisfeiler-Lehman test recognizes to be non-isomorphic. We use a graph attention network…

Machine Learning · Computer Science 2020-04-14 Stanisław Purgał

Graph neural networks (GNNs) have emerged recently as a powerful architecture for learning node and graph representations. Standard GNNs have the same expressive power as the Weisfeiler-Leman test of graph isomorphism in terms of…

Machine Learning · Statistics 2020-08-11 Giannis Nikolentzos , George Dasoulas , Michalis Vazirgiannis

Convolutional neural networks (CNNs) leverage the great power in representation learning on regular grid data such as image and video. Recently, increasing attention has been paid on generalizing CNNs to graph or network data which is…

Social and Information Networks · Computer Science 2018-08-21 Yao Ma , Suhang Wang , Charu C. Aggarwal , Dawei Yin , Jiliang Tang

Graph limit models, like graphons for limits of dense graphs, have recently been used to study size transferability of graph neural networks (GNNs). While most literature focuses on message passing GNNs (MPNNs), in this work we attend to…

Machine Learning · Computer Science 2025-05-20 Daniel Herbst , Stefanie Jegelka

Graphs play an important role in many applications. Recently, Graph Neural Networks (GNNs) have achieved promising results in graph analysis tasks. Some state-of-the-art GNN models have been proposed, e.g., Graph Convolutional Networks…

Machine Learning · Computer Science 2021-09-29 Yaoman Li , Irwin King

Numerous subgraph-enhanced graph neural networks (GNNs) have emerged recently, provably boosting the expressive power of standard (message-passing) GNNs. However, there is a limited understanding of how these approaches relate to each other…

Machine Learning · Computer Science 2022-10-18 Chendi Qian , Gaurav Rattan , Floris Geerts , Christopher Morris , Mathias Niepert

Discrete graph generation has emerged as a powerful paradigm for modeling graph data, often relying on highly expressive neural backbones such as transformers or higher-order architectures. We revisit this design choice by introducing…

Machine Learning · Computer Science 2026-03-11 Jay Revolinsky , Harry Shomer , Jiliang Tang

Incorporating spectral information to enhance Graph Neural Networks (GNNs) has shown promising results but raises a fundamental challenge due to the inherent ambiguity of eigenvectors. Various architectures have been proposed to address…

Machine Learning · Computer Science 2024-06-07 Bohang Zhang , Lingxiao Zhao , Haggai Maron

Graph embedding, aiming to learn low-dimensional representations (aka. embeddings) of nodes, has received significant attention recently. Recent years have witnessed a surge of efforts made on static graphs, among which Graph Convolutional…

Machine Learning · Computer Science 2021-04-08 Zeyu Cui , Zekun Li , Shu Wu , Xiaoyu Zhang , Qiang Liu , Liang Wang , Mengmeng Ai

Graph neural networks (GNNs) demonstrate a robust capability for representation learning on graphs with complex structures, showcasing superior performance in various applications. The majority of existing GNNs employ a graph convolution…

Machine Learning · Computer Science 2025-02-19 Jinlu Wang , Jipeng Guo , Yanfeng Sun , Junbin Gao , Shaofan Wang , Yachao Yang , Baocai Yin

Message-passing neural networks (MPNNs) are the leading architecture for deep learning on graph-structured data, in large part due to their simplicity and scalability. Unfortunately, it was shown that these architectures are limited in…