English
Related papers

Related papers: What graph neural networks cannot learn: depth vs …

200 papers

Graph neural networks (GNNs) are effective machine learning models for various graph learning problems. Despite their empirical successes, the theoretical limitations of GNNs have been revealed recently. Consequently, many GNN models have…

Machine Learning · Computer Science 2020-10-19 Ryoma Sato

Graph Neural Networks (GNNs) have become the standard approach for learning and reasoning over relational data, leveraging the message-passing mechanism that iteratively propagates node embeddings through graph structures. While GNNs have…

Machine Learning · Computer Science 2025-01-14 Xiaoyu Li , Yingyu Liang , Zhenmei Shi , Zhao Song , Wei Wang , Jiahao Zhang

This extended abstract describes a framework for analyzing the expressiveness, learning, and (structural) generalization of hypergraph neural networks (HyperGNNs). Specifically, we focus on how HyperGNNs can learn from finite datasets and…

Machine Learning · Computer Science 2023-03-10 Zhezheng Luo , Jiayuan Mao , Joshua B. Tenenbaum , Leslie Pack Kaelbling

We address two fundamental questions about graph neural networks (GNNs). First, we prove that several important graph properties cannot be computed by GNNs that rely entirely on local information. Such GNNs include the standard message…

Machine Learning · Computer Science 2020-02-17 Vikas K. Garg , Stefanie Jegelka , Tommi Jaakkola

The study of Graph Neural Networks has received considerable interest in the past few years. By extending deep learning to graph-structured data, GNNs can solve a diverse set of tasks in fields including social science, chemistry, and…

Machine Learning · Computer Science 2024-03-12 Ashwin Nalwade , Kelly Marshall , Axel Eladi , Umang Sharma

Various classes of Graph Neural Networks (GNN) have been proposed and shown to be successful in a wide range of applications with graph structured data. In this paper, we propose a theoretical framework able to compare the expressive power…

Machine Learning · Computer Science 2021-06-08 Waïss Azizian , Marc Lelarge

Graph neural networks (GNNs) are effective machine learning models for many graph-related applications. Despite their empirical success, many research efforts focus on the theoretical limitations of GNNs, i.e., the GNNs expressive power.…

Machine Learning · Computer Science 2025-01-13 Bingxu Zhang , Changjun Fan , Shixuan Liu , Kuihua Huang , Xiang Zhao , Jincai Huang , Zhong Liu

Graph Neural Networks (graph NNs) are a promising deep learning approach for analyzing graph-structured data. However, it is known that they do not improve (or sometimes worsen) their predictive performance as we pile up many layers and add…

Machine Learning · Computer Science 2021-01-07 Kenta Oono , Taiji Suzuki

Expressivity and generalization are two critical aspects of graph neural networks (GNNs). While significant progress has been made in studying the expressivity of GNNs, much less is known about their generalization capabilities,…

Machine Learning · Computer Science 2024-10-15 Shouheng Li , Floris Geerts , Dongwoo Kim , Qing Wang

The expressivity of Graph Neural Networks (GNNs) is dependent on the aggregation functions they employ. Theoretical works have pointed towards Sum aggregation GNNs subsuming every other GNNs, while certain practical works have observed a…

Machine Learning · Computer Science 2023-05-22 Eran Rosenbluth , Jan Toenshoff , Martin Grohe

The expressive power of message-passing graph neural networks (MPNNs) is reasonably well understood, primarily through combinatorial techniques from graph isomorphism testing. However, MPNNs' generalization abilities -- making meaningful…

Machine Learning · Computer Science 2024-12-11 Antonis Vasileiou , Ben Finkelshtein , Floris Geerts , Ron Levie , Christopher Morris

Graph Neural Networks (GNNs) are powerful tools for learning on structured data, yet the relationship between their expressivity and predictive performance remains unclear. We introduce a family of premetrics that capture different degrees…

Machine Learning · Computer Science 2025-05-19 Sohir Maskey , Raffaele Paolino , Fabian Jogl , Gitta Kutyniok , Johannes F. Lutzeyer

Graph neural network (GNN) is effective to model graphs for distributed representations of nodes and an entire graph. Recently, research on the expressive power of GNN attracted growing attention. A highly-expressive GNN has the ability to…

Machine Learning · Computer Science 2022-03-01 Chengsheng Mao , Yuan Luo

We investigate the power of message-passing neural networks (MPNNs) in their capacity to transform the numerical features stored in the nodes of their input graphs. Our focus is on global expressive power, uniformly over all input graphs,…

Artificial Intelligence · Computer Science 2022-07-29 Floris Geerts , Jasper Steegmans , Jan Van den Bussche

Graph neural networks (GNNs) are the most widely adopted model in graph-structured data oriented learning and representation. Despite their extraordinary success in real-world applications, understanding their working mechanism by theory is…

Machine Learning · Computer Science 2023-05-16 Huayi Tang , Yong Liu

We perform the first adversarial robustness study into Graph Neural Networks (GNNs) that are provably more powerful than traditional Message Passing Neural Networks (MPNNs). In particular, we use adversarial robustness as a tool to uncover…

Machine Learning · Computer Science 2024-07-04 Francesco Campi , Lukas Gosch , Tom Wollschläger , Yan Scholten , Stephan Günnemann

Graph neural networks (GNNs) provide state-of-the-art results in a wide variety of tasks which typically involve predicting features at the vertices of a graph. They are built from layers of graph convolutions which serve as a powerful…

Machine Learning · Statistics 2024-11-08 Mauricio Velasco , Kaiying O'Hare , Bernardo Rychtenberg , Soledad Villar

Graph Neural Networks (GNNs) are an effective framework for representation learning of graphs. GNNs follow a neighborhood aggregation scheme, where the representation vector of a node is computed by recursively aggregating and transforming…

Machine Learning · Computer Science 2019-02-26 Keyulu Xu , Weihua Hu , Jure Leskovec , Stefanie Jegelka

Graph neural networks (GNNs) have emerged as powerful tools for processing relational data in applications. However, GNNs suffer from the problem of oversmoothing, the property that the features of all nodes exponentially converge to the…

Machine Learning · Statistics 2025-05-22 Bastian Epping , Alexandre René , Moritz Helias , Michael T. Schaub

While Graph Neural Networks (GNNs) have achieved remarkable results in a variety of applications, recent studies exposed important shortcomings in their ability to capture the structure of the underlying graph. It has been shown that the…

Machine Learning · Computer Science 2023-09-26 Giorgos Bouritsas , Fabrizio Frasca , Stefanos Zafeiriou , Michael M. Bronstein
‹ Prev 1 2 3 10 Next ›