English
Related papers

Related papers: Improving the Expressive Power of Graph Neural Net…

200 papers

Various classes of Graph Neural Networks (GNN) have been proposed and shown to be successful in a wide range of applications with graph structured data. In this paper, we propose a theoretical framework able to compare the expressive power…

Machine Learning · Computer Science 2021-06-08 Waïss Azizian , Marc Lelarge

Graph limit models, like graphons for limits of dense graphs, have recently been used to study size transferability of graph neural networks (GNNs). While most literature focuses on message passing GNNs (MPNNs), in this work we attend to…

Machine Learning · Computer Science 2025-05-20 Daniel Herbst , Stefanie Jegelka

Spectral features are widely incorporated within Graph Neural Networks (GNNs) to improve their expressive power, or their ability to distinguish among non-isomorphic graphs. One popular example is the usage of graph Laplacian eigenvectors…

Machine Learning · Computer Science 2025-09-29 Snir Hordan , Maya Bechler-Speicher , Gur Lifshitz , Nadav Dym

Deep learning-based approaches have been developed to solve challenging problems in wireless communications, leading to promising results. Early attempts adopted neural network architectures inherited from applications such as computer…

Information Theory · Computer Science 2022-11-07 Yifei Shen , Jun Zhang , S. H. Song , Khaled B. Letaief

We perform the first adversarial robustness study into Graph Neural Networks (GNNs) that are provably more powerful than traditional Message Passing Neural Networks (MPNNs). In particular, we use adversarial robustness as a tool to uncover…

Machine Learning · Computer Science 2024-07-04 Francesco Campi , Lukas Gosch , Tom Wollschläger , Yan Scholten , Stephan Günnemann

We focus on graph classification using a graph neural network (GNN) model that precomputes the node features using a bank of neighborhood aggregation graph operators arranged in parallel. These GNN models have a natural advantage of reduced…

Machine Learning · Computer Science 2022-11-23 Siddhant Doshi , Sundeep Prabhakar Chepuri

Incorporating spectral information to enhance Graph Neural Networks (GNNs) has shown promising results but raises a fundamental challenge due to the inherent ambiguity of eigenvectors. Various architectures have been proposed to address…

Machine Learning · Computer Science 2024-06-07 Bohang Zhang , Lingxiao Zhao , Haggai Maron

Graph Neural Networks (GNNs) have emerged as a dominant approach in graph representation learning, yet they often struggle to capture consistent similarity relationships among graphs. While graph kernel methods such as the Weisfeiler-Lehman…

Machine Learning · Computer Science 2024-12-12 Xuyuan Liu , Yinghao Cai , Qihui Yang , Yujun Yan

Graph Neural Networks (GNNs) have achieved much success on graph-structured data. In light of this, there have been increasing interests in studying their expressive power. One line of work studies the capability of GNNs to approximate…

Machine Learning · Computer Science 2023-02-14 Zhengdao Chen , Soledad Villar , Lei Chen , Joan Bruna

Despite significant advances in Graph Neural Networks (GNNs), their limited expressivity remains a fundamental challenge. Research on GNN expressivity has produced many expressive architectures, leading to architecture hierarchies with…

Machine Learning · Computer Science 2025-10-06 Yam Eitan , Moshe Eliasof , Yoav Gelberg , Fabrizio Frasca , Guy Bar-Shalom , Haggai Maron

Graph Neural Networks (GNNs) suffer from over-smoothing in deep architectures and expressiveness bounded by the 1-Weisfeiler-Leman (1-WL) test. We adapt Manifold-Constrained Hyper-Connections (\mhc)~\citep{xie2025mhc}, recently proposed for…

Machine Learning · Computer Science 2026-01-07 Subhankar Mishra

Graph neural network (GNN) is a popular tool to learn the lower-dimensional representation of a graph. It facilitates the applicability of machine learning tasks on graphs by incorporating domain-specific features. There are various options…

Machine Learning · Computer Science 2020-08-21 Md. Khaledur Rahman

Effectively combining logic reasoning and probabilistic inference has been a long-standing goal of machine learning: the former has the ability to generalize with small training data, while the latter provides a principled framework for…

Machine Learning · Computer Science 2019-09-24 Yuyu Zhang , Xinshi Chen , Yuan Yang , Arun Ramamurthy , Bo Li , Yuan Qi , Le Song

Graph neural network (GNN) is effective to model graphs for distributed representations of nodes and an entire graph. Recently, research on the expressive power of GNN attracted growing attention. A highly-expressive GNN has the ability to…

Machine Learning · Computer Science 2022-03-01 Chengsheng Mao , Yuan Luo

Graph neural networks (GNNs) are widely used in graph learning and most architectures propagate information by passing messages between vertices. In this work, we shift our attention to GNNs that perform message passing on edges and…

Machine Learning · Computer Science 2026-02-03 Pablo Barceló , Fabian Jogl , Alexander Kozachinskiy , Matthias Lanzinger , Stefan Neumann , Cristóbal Rojas

An important characteristic of temporal graphs is how the directed arrow of time influences their causal topology, i.e., which nodes can possibly influence each other causally via time-respecting paths. The resulting patterns are often…

Machine Learning · Computer Science 2026-05-19 Franziska Heeg , Jonas Sauer , Petra Mutzel , Ingo Scholtes

This paper presents a new Graph Neural Network (GNN) type using feature-wise linear modulation (FiLM). Many standard GNN variants propagate information along the edges of a graph by computing "messages" based only on the representation of…

Machine Learning · Computer Science 2020-06-29 Marc Brockschmidt

Applying machine learning to molecules is challenging because of their natural representation as graphs rather than vectors.Several architectures have been recently proposed for deep learning from molecular graphs, but they suffer from…

Machine Learning · Statistics 2020-09-15 Jaak Simm , Adam Arany , Edward De Brouwer , Yves Moreau

Graph Neural Networks (GNNs) are a powerful representational tool for solving problems on graph-structured inputs. In almost all cases so far, however, they have been applied to directly recovering a final solution from raw inputs, without…

Machine Learning · Statistics 2020-01-16 Petar Veličković , Rex Ying , Matilde Padovano , Raia Hadsell , Charles Blundell

Graph neural networks (GNNs) are composed of layers consisting of graph convolutions and pointwise nonlinearities. Due to their invariance and stability properties, GNNs are provably successful at learning representations from data…

Machine Learning · Computer Science 2023-08-09 Luana Ruiz , Luiz F. O. Chamon , Alejandro Ribeiro