English
Related papers

Related papers: WL meet VC

200 papers

From the perspective of expressive power, this work compares multi-layer Graph Neural Networks (GNNs) with a simplified alternative that we call Graph-Augmented Multi-Layer Perceptrons (GA-MLPs), which first augments node features with…

Machine Learning · Computer Science 2020-12-03 Lei Chen , Zhengdao Chen , Joan Bruna

Recent advances in neural algorithmic reasoning with graph neural networks (GNNs) are propped up by the notion of algorithmic alignment. Broadly, a neural network will be better at learning to execute a reasoning task (in terms of sample…

Machine Learning · Computer Science 2022-10-12 Andrew Dudzik , Petar Veličković

Current graph neural networks (GNNs) lack generalizability with respect to scales (graph sizes, graph diameters, edge weights, etc..) when solving many graph analysis problems. Taking the perspective of synthesizing graph theory programs,…

Machine Learning · Computer Science 2020-10-27 Hao Tang , Zhiao Huang , Jiayuan Gu , Bao-Liang Lu , Hao Su

Graph Neural Networks (GNN) come in many flavors, but should always be either invariant (permutation of the nodes of the input graph does not affect the output) or equivariant (permutation of the input permutes the output). In this paper,…

Machine Learning · Computer Science 2019-10-25 Nicolas Keriven , Gabriel Peyré

Graph neural networks (GNNs) have emerged as powerful tools for processing relational data in applications. However, GNNs suffer from the problem of oversmoothing, the property that the features of all nodes exponentially converge to the…

Machine Learning · Statistics 2025-05-22 Bastian Epping , Alexandre René , Moritz Helias , Michael T. Schaub

Graph Neural Network (GNN) is a powerful tool to perform standard machine learning on graphs. To have a Euclidean representation of every node in the Non-Euclidean graph-like data, GNN follows neighbourhood aggregation and combination of…

Machine Learning · Computer Science 2021-11-18 Sucheta Dawn , Sanghamitra Bandyopadhyay

Graph neural networks (GNNs) are a powerful architecture for tackling graph learning tasks, yet have been shown to be oblivious to eminent substructures such as cycles. We present TOGL, a novel layer that incorporates global topological…

Machine Learning · Computer Science 2022-03-18 Max Horn , Edward De Brouwer , Michael Moor , Yves Moreau , Bastian Rieck , Karsten Borgwardt

Line graph transformation has been widely studied in graph theory, where each node in a line graph corresponds to an edge in the original graph. This has inspired a series of graph neural networks (GNNs) applied to transformed line graphs,…

Machine Learning · Computer Science 2025-03-21 Fan Yang , Xingyue Huang

Representational limits of message-passing graph neural networks (MP-GNNs), e.g., in terms of the Weisfeiler-Leman (WL) test for isomorphism, are well understood. Augmenting these graph models with topological features via persistent…

Machine Learning · Computer Science 2023-11-13 Johanna Immonen , Amauri H. Souza , Vikas Garg

It has been recently shown that general policies for many classical planning domains can be expressed and learned in terms of a pool of features defined from the domain predicates using a description logic grammar. At the same time, most…

Artificial Intelligence · Computer Science 2022-05-09 Simon Ståhlberg , Blai Bonet , Hector Geffner

Graph neural networks (GNNs) are effective machine learning models for various graph learning problems. Despite their empirical successes, the theoretical limitations of GNNs have been revealed recently. Consequently, many GNN models have…

Machine Learning · Computer Science 2020-10-19 Ryoma Sato

Graph Neural Networks (GNN) are currently the most popular approach for learning and prediction on graph-structured data and are deployed in various fields, from social network analysis to drug discovery. However, there is limited…

Methodology · Statistics 2026-05-26 Nil Ayday , Mahalakshmi Sabanayagam , Debarghya Ghoshdastidar

Graph neural network (GNN) is effective to model graphs for distributed representations of nodes and an entire graph. Recently, research on the expressive power of GNN attracted growing attention. A highly-expressive GNN has the ability to…

Machine Learning · Computer Science 2022-03-01 Chengsheng Mao , Yuan Luo

A hallmark of graph neural networks is their ability to distinguish the isomorphism class of their inputs. This study derives hardness results for the classification variant of graph isomorphism in the message-passing model (MPNN). MPNN…

Machine Learning · Computer Science 2020-10-19 Andreas Loukas

Graph Neural Networks (GNNs) rely on graph convolutions to exploit meaningful patterns in networked data. Based on matrix multiplications, convolutions incur in high computational costs leading to scalability limitations in practice. To…

Machine Learning · Computer Science 2022-10-28 Juan Cervino , Luana Ruiz , Alejandro Ribeiro

Graph coloring, a classical and critical NP-hard problem, is the problem of assigning connected nodes as different colors as possible. However, we observe that state-of-the-art GNNs are less successful in the graph coloring problem. We…

Machine Learning · Computer Science 2022-08-22 Wei Li , Ruxuan Li , Yuzhe Ma , Siu On Chan , David Pan , Bei Yu

Graph convolutional networks (GCNs) are a widely used method for graph representation learning. We investigate the power of GCNs, as a function of their number of layers, to distinguish between different random graph models on the basis of…

Machine Learning · Statistics 2020-02-14 Abram Magner , Mayank Baranwal , Alfred O. Hero

The expressivity of Graph Neural Networks (GNNs) has been studied broadly in recent years to reveal the design principles for more powerful GNNs. Graph canonization is known as a typical approach to distinguish non-isomorphic graphs, yet…

Machine Learning · Computer Science 2024-02-12 Zehao Dong , Muhan Zhang , Philip R. O. Payne , Michael A Province , Carlos Cruchaga , Tianyu Zhao , Fuhai Li , Yixin Chen

Graph Neural Networks (GNNs) have emerged as an efficient alternative to convolutional approaches for vision tasks such as image classification, leveraging patch-based representations instead of raw pixels. These methods construct graphs…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Nikolaos Chaidos , Angeliki Dimitriou , Nikolaos Spanos , Athanasios Voulodimos , Giorgos Stamou

Graphical models capture relations between entities in a wide range of applications including social networks, biology, and natural language processing, among others. Graph neural networks (GNN) are neural models that operate over graphs,…

Machine Learning · Computer Science 2024-02-08 Xu Zheng , Farhad Shirani , Tianchun Wang , Shouwei Gao , Wenqian Dong , Wei Cheng , Dongsheng Luo