English
Related papers

Related papers: Breaking Symmetry Bottlenecks in GNN Readouts

200 papers

Graph neural networks (GNNs) have achieved tremendous success on multiple graph-based learning tasks by fusing network structure and node features. Modern GNN models are built upon iterative aggregation of neighbor's/proximity features by…

Machine Learning · Computer Science 2021-06-15 Susheel Suresh , Vinith Budde , Jennifer Neville , Pan Li , Jianzhu Ma

Given graphs as input, Graph Neural Networks (GNNs) support the inference of nodes, edges, attributes, or graph properties. Graph Rewriting investigates the rule-based manipulation of graphs to model complex graph transformations. We…

Machine Learning · Computer Science 2023-05-31 Adam Machowczyk , Reiko Heckel

Graph neural networks (GNNs) provide state-of-the-art results in a wide variety of tasks which typically involve predicting features at the vertices of a graph. They are built from layers of graph convolutions which serve as a powerful…

Machine Learning · Statistics 2024-11-08 Mauricio Velasco , Kaiying O'Hare , Bernardo Rychtenberg , Soledad Villar

The mechanism of message passing in graph neural networks (GNNs) is still mysterious. Apart from convolutional neural networks, no theoretical origin for GNNs has been proposed. To our surprise, message passing can be best understood in…

Machine Learning · Computer Science 2021-04-16 Xue Li , Yuanzhi Cheng

Graph neural network interatomic potentials (GNN-IPs) are gaining significant attention due to their capability of learning from large datasets. Specifically, universal interatomic potentials based on GNN, usually trained with crystalline…

Materials Science · Physics 2025-01-08 Sungwoo Kang

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

Machine Learning · Computer Science 2026-05-05 Hugo Attali , Nathalie Pernelle , Davide Buscaldi , Fragkiskos D. Malliaros

Graph Neural Networks are powerful models for learning from graph-structured data, yet their effectiveness is often limited by two critical challenges: over-squashing, where information from distant nodes is excessively compressed, and…

Machine Learning · Computer Science 2026-05-04 Hugo Attali , Davide Buscaldi , Nathalie Pernelle , Fragkiskos D. Malliaros

Despite much research, Graph Neural Networks (GNNs) still do not display the favorable scaling properties of other deep neural networks such as Convolutional Neural Networks and Transformers. Previous work has identified issues such as…

Machine Learning · Computer Science 2023-12-19 Ameen Ali , Hakan Cevikalp , Lior Wolf

Graph neural networks (GNNs) integrate deep architectures and topological structure modeling in an effective way. However, the performance of existing GNNs would decrease significantly when they stack many layers, because of the…

Machine Learning · Computer Science 2021-07-07 Kaixiong Zhou , Xiao Huang , Daochen Zha , Rui Chen , Li Li , Soo-Hyun Choi , Xia Hu

Graph Neural Network (GNN) aggregates the neighborhood of each node into the node embedding and shows its powerful capability for graph representation learning. However, most existing GNN variants aggregate the neighborhood information in a…

Machine Learning · Computer Science 2020-10-13 Chengsheng Mao , Liang Yao , Yuan Luo

Graph Neural Networks (GNNs) are learning models aimed at processing graphs and signals on graphs. The most popular and successful GNNs are based on message passing schemes. Such schemes inherently have limited expressive power when it…

Machine Learning · Computer Science 2022-06-24 Jacob Bamberger

Graph Neural Networks (GNNs) are neural models that leverage the dependency structure in graphical data via message passing among the graph nodes. GNNs have emerged as pivotal architectures in analyzing graph-structured data, and their…

Machine Learning · Computer Science 2024-03-19 Xu Zheng , Farhad Shirani , Tianchun Wang , Wei Cheng , Zhuomin Chen , Haifeng Chen , Hua Wei , Dongsheng Luo

Graph Neural Networks (graph NNs) are a promising deep learning approach for analyzing graph-structured data. However, it is known that they do not improve (or sometimes worsen) their predictive performance as we pile up many layers and add…

Machine Learning · Computer Science 2021-01-07 Kenta Oono , Taiji Suzuki

Learning representations of sets of nodes in a graph is crucial for applications ranging from node-role discovery to link prediction and molecule classification. Graph Neural Networks (GNNs) have achieved great success in graph…

Machine Learning · Computer Science 2020-10-30 Pan Li , Yanbang Wang , Hongwei Wang , Jure Leskovec

Graph Neural Networks (GNNs) have shown great power in various domains. However, their predictions may inherit societal biases on sensitive attributes, limiting their adoption in real-world applications. Although many efforts have been…

Machine Learning · Computer Science 2023-06-21 Huaisheng Zhu , Guoji Fu , Zhimeng Guo , Zhiwei Zhang , Teng Xiao , Suhang Wang

Graph neural networks (GNNs) update the hidden representations of vertices (called Vertex-GNNs) or hidden representations of edges (called Edge-GNNs) by processing and pooling the information of neighboring vertices and edges and combining…

Machine Learning · Computer Science 2023-12-27 Yao Peng , Jia Guo , Chenyang Yang

Graph Neural Networks (GNNs) have emerged as an efficient alternative to convolutional approaches for vision tasks such as image classification, leveraging patch-based representations instead of raw pixels. These methods construct graphs…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Nikolaos Chaidos , Angeliki Dimitriou , Nikolaos Spanos , Athanasios Voulodimos , Giorgos Stamou

Graph neural networks (GNNs) have emerged recently as a powerful architecture for learning node and graph representations. Standard GNNs have the same expressive power as the Weisfeiler-Leman test of graph isomorphism in terms of…

Machine Learning · Statistics 2020-08-11 Giannis Nikolentzos , George Dasoulas , Michalis Vazirgiannis

Recently, graph neural networks (GNNs) have revolutionized the field of graph representation learning through effectively learned node embeddings, and achieved state-of-the-art results in tasks such as node classification and link…

Machine Learning · Computer Science 2019-02-21 Rex Ying , Jiaxuan You , Christopher Morris , Xiang Ren , William L. Hamilton , Jure Leskovec

Graph Neural Networks (GNNs) are limited in their propagation operators. In many cases, these operators often contain non-negative elements only and are shared across channels, limiting the expressiveness of GNNs. Moreover, some GNNs suffer…

Machine Learning · Computer Science 2023-05-08 Moshe Eliasof , Lars Ruthotto , Eran Treister