English
Related papers

Related papers: 1-WL Expressiveness Is (Almost) All You Need

200 papers

The ability of a graph neural network (GNN) to leverage both the graph topology and graph labels is fundamental to building discriminative node and graph embeddings. Building on previous work, we theoretically show that edGNN, our model for…

Machine Learning · Computer Science 2019-12-05 Guillaume Jaume , An-phi Nguyen , María Rodríguez Martínez , Jean-Philippe Thiran , Maria Gabrani

Effectively combining logic reasoning and probabilistic inference has been a long-standing goal of machine learning: the former has the ability to generalize with small training data, while the latter provides a principled framework for…

Machine Learning · Computer Science 2019-09-24 Yuyu Zhang , Xinshi Chen , Yuan Yang , Arun Ramamurthy , Bo Li , Yuan Qi , Le Song

Graph Neural Networks (GNNs) suffer from over-smoothing in deep architectures and expressiveness bounded by the 1-Weisfeiler-Leman (1-WL) test. We adapt Manifold-Constrained Hyper-Connections (\mhc)~\citep{xie2025mhc}, recently proposed for…

Machine Learning · Computer Science 2026-01-07 Subhankar Mishra

Graph Neural Networks (GNNs) have emerged as a powerful category of learning architecture for handling graph-structured data. However, existing GNNs typically ignore crucial structural characteristics in node-induced subgraphs, which thus…

Machine Learning · Computer Science 2023-06-13 Kaixuan Chen , Shunyu Liu , Tongtian Zhu , Tongya Zheng , Haofei Zhang , Zunlei Feng , Jingwen Ye , Mingli Song

As a classical approach on graph learning, the propagation-aggregation methodology is widely exploited by many of Graph Neural Networks (GNNs), wherein the representation of a node is updated by aggregating representations from itself and…

Machine Learning · Computer Science 2025-12-08 Xiao Yue , Bo Liu , Feng Zhang , Guangzhi Qu

While (message-passing) graph neural networks have clear limitations in approximating permutation-equivariant functions over graphs or general relational data, more expressive, higher-order graph neural networks do not scale to large…

Machine Learning · Computer Science 2022-08-31 Christopher Morris , Gaurav Rattan , Sandra Kiefer , Siamak Ravanbakhsh

This paper studies Dropout Graph Neural Networks (DropGNNs), a new approach that aims to overcome the limitations of standard GNN frameworks. In DropGNNs, we execute multiple runs of a GNN on the input graph, with some of the nodes randomly…

Machine Learning · Computer Science 2021-11-12 Pál András Papp , Karolis Martinkus , Lukas Faber , Roger Wattenhofer

Diffusion models have gained popularity in graph generation tasks; however, the extent of their expressivity concerning the graph distributions they can learn is not fully understood. Unlike models in other domains, popular backbones for…

Machine Learning · Computer Science 2025-02-05 Xiyuan Wang , Yewei Liu , Lexi Pang , Siwei Chen , Muhan Zhang

Graphical models capture relations between entities in a wide range of applications including social networks, biology, and natural language processing, among others. Graph neural networks (GNN) are neural models that operate over graphs,…

Machine Learning · Computer Science 2024-02-08 Xu Zheng , Farhad Shirani , Tianchun Wang , Shouwei Gao , Wenqian Dong , Wei Cheng , Dongsheng Luo

In Graph Neural Networks (GNNs), hierarchical pooling operators generate local summaries of the data by coarsening the graph structure and the vertex features. While considerable attention has been devoted to analyzing the expressive power…

Machine Learning · Computer Science 2023-10-16 Filippo Maria Bianchi , Veronica Lachi

We present a novel edge-level ego-network encoding for learning on graphs that can boost Message Passing Graph Neural Networks (MP-GNNs) by providing additional node and edge features or extending message-passing formats. The proposed…

Machine Learning · Computer Science 2024-05-03 Nurudin Alvarez-Gonzalez , Andreas Kaltenbrunner , Vicenç Gómez

The growing availability of network data and of scientific interest in distributed systems has led to the rapid development of statistical models of network structure. Typically, however, these are models for the entire network, while the…

Statistics Theory · Mathematics 2022-03-18 Cosma Rohilla Shalizi , Alessandro Rinaldo

Graph Neural Networks (GNNs) address two key challenges in applying deep learning to graph-structured data: they handle varying size input graphs and ensure invariance under graph isomorphism. While GNNs have demonstrated broad…

Artificial Intelligence · Computer Science 2026-02-20 Bernardo Cuenca Grau , Eva Feng , Przemysław Andrzej Wałęga

Temporal graph networks (TGNs) have gained prominence as models for embedding dynamic interactions, but little is known about their theoretical underpinnings. We establish fundamental results about the representational power and limits of…

Machine Learning · Computer Science 2022-10-03 Amauri H. Souza , Diego Mesquita , Samuel Kaski , Vikas Garg

Graph neural networks (GNNs) can effectively model structural information of graphs, making them widely used in knowledge graph (KG) reasoning. However, existing studies on the expressive power of GNNs mainly focuses on simple…

Artificial Intelligence · Computer Science 2026-02-02 Han Yu , Xiaojuan Zhao , Aiping Li , Kai Chen , Ziniu Liu , Zhichao Peng

Message-passing graph neural networks (MPNNs) have emerged as the leading approach for machine learning on graphs, attracting significant attention in recent years. While a large set of works explored the expressivity of MPNNs, i.e., their…

Machine Learning · Computer Science 2025-03-21 Antonis Vasileiou , Stefanie Jegelka , Ron Levie , Christopher Morris

A graph neural network (GNN) is a good choice for predicting the chemical properties of molecules. Compared with other deep networks, however, the current performance of a GNN is limited owing to the "curse of depth." Inspired by…

Machine Learning · Computer Science 2020-08-19 Katsuhiko Ishiguro , Kenta Oono , Kohei Hayashi

We present a new angle on the expressive power of graph neural networks (GNNs) by studying how the predictions of real-valued GNN classifiers, such as those classifying graphs probabilistically, evolve as we apply them on larger graphs…

Machine Learning · Computer Science 2024-11-11 Sam Adam-Day , Michael Benedikt , İsmail İlkan Ceylan , Ben Finkelshtein

Graph neural networks (GNNs) are powerful graph-based machine-learning models that are popular in various domains, e.g., social media, transportation, and drug discovery. However, owing to complex data representations, GNNs do not easily…

Machine Learning · Computer Science 2024-05-14 Pantea Habibi , Peyman Baghershahi , Sourav Medya , Debaleena Chattopadhyay

Graph neural networks (GNNs) are a powerful architecture for tackling graph learning tasks, yet have been shown to be oblivious to eminent substructures such as cycles. We present TOGL, a novel layer that incorporates global topological…

Machine Learning · Computer Science 2022-03-18 Max Horn , Edward De Brouwer , Michael Moor , Yves Moreau , Bastian Rieck , Karsten Borgwardt