English
Related papers

Related papers: On the Computational Capability of Graph Neural Ne…

200 papers

This extended abstract describes a framework for analyzing the expressiveness, learning, and (structural) generalization of hypergraph neural networks (HyperGNNs). Specifically, we focus on how HyperGNNs can learn from finite datasets and…

Machine Learning · Computer Science 2023-03-10 Zhezheng Luo , Jiayuan Mao , Joshua B. Tenenbaum , Leslie Pack Kaelbling

Graph Neural Networks (GNNs) face two fundamental challenges when scaled to deep architectures: oversmoothing, where node representations converge to indistinguishable vectors, and oversquashing, where information from distant nodes fails…

Machine Learning · Computer Science 2026-03-30 Mostafa Haghir Chehreghani

Deep learning has consistently defied state-of-the-art techniques in many fields over the last decade. However, we are just beginning to understand the capabilities of neural learning in symbolic domains. Deep learning architectures that…

Machine Learning · Computer Science 2020-03-10 Henrique Lemos , Marcelo Prates , Pedro Avelar , Luis Lamb

Graph Neural Networks (GNNs) are recently proposed neural network structures for the processing of graph-structured data. Due to their employed neighbor aggregation strategy, existing GNNs focus on capturing node-level information and…

Machine Learning · Computer Science 2022-01-05 Xing Ai , Chengyu Sun , Zhihong Zhang , Edwin R Hancock

Recent years have seen the vast potential of Graph Neural Networks (GNN) in many fields where data is structured as graphs (e.g., chemistry, recommender systems). In particular, GNNs are becoming increasingly popular in the field of…

Graph Neural Networks (GNNs) have paved the way for being a cornerstone in graph-related learning tasks. Yet, the ability of GNNs to capture structural interactions within graphs remains under-explored. In this work, we address this gap by…

Machine Learning · Computer Science 2025-03-04 Asela Hevapathige , Qing Wang

Graph Neural Networks (GNNs) show strong expressive power on graph data mining, by aggregating information from neighbors and using the integrated representation in the downstream tasks. The same aggregation methods and parameters for each…

Machine Learning · Computer Science 2022-03-22 Xiaojun Ma , Qin Chen , Yuanyi Ren , Guojie Song , Liang Wang

Training deep graph neural networks (GNNs) is notoriously hard. Besides the standard plights in training deep architectures such as vanishing gradients and overfitting, it also uniquely suffers from over-smoothing, information squashing,…

Machine Learning · Computer Science 2022-05-10 Tianlong Chen , Kaixiong Zhou , Keyu Duan , Wenqing Zheng , Peihao Wang , Xia Hu , Zhangyang Wang

Developing models that can learn to reason is a notoriously challenging problem. We focus on reasoning in relational domains, where the use of Graph Neural Networks (GNNs) seems like a natural choice. However, previous work has shown that…

Artificial Intelligence · Computer Science 2025-03-03 Irtaza Khalid , Steven Schockaert

Graph Neural Networks (GNNs) have emerged as an efficient alternative to convolutional approaches for vision tasks such as image classification, leveraging patch-based representations instead of raw pixels. These methods construct graphs…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Nikolaos Chaidos , Angeliki Dimitriou , Nikolaos Spanos , Athanasios Voulodimos , Giorgos Stamou

Graph convolutional neural networks (GCNs) generalize tradition convolutional neural networks (CNNs) from low-dimensional regular graphs (e.g., image) to high dimensional irregular graphs (e.g., text documents on word embeddings). Due to…

Machine Learning · Computer Science 2021-03-30 Mehrnaz Najafi , Philip S. Yu

Graph Neural Networks (GNNs) have become increasingly important due to their representational power and state-of-the-art predictive performance on many fundamental learning tasks. Despite this success, GNNs suffer from fairness issues that…

Machine Learning · Computer Science 2023-07-11 April Chen , Ryan A. Rossi , Namyong Park , Puja Trivedi , Yu Wang , Tong Yu , Sungchul Kim , Franck Dernoncourt , Nesreen K. Ahmed

Deep learning's performance has been extensively recognized recently. Graph neural networks (GNNs) are designed to deal with graph-structural data that classical deep learning does not easily manage. Since most GNNs were created using…

Machine Learning · Computer Science 2023-09-20 Zhiqian Chen , Fanglan Chen , Lei Zhang , Taoran Ji , Kaiqun Fu , Liang Zhao , Feng Chen , Lingfei Wu , Charu Aggarwal , Chang-Tien Lu

The expressive power of message-passing graph neural networks (MPNNs) is reasonably well understood, primarily through combinatorial techniques from graph isomorphism testing. However, MPNNs' generalization abilities -- making meaningful…

Machine Learning · Computer Science 2024-12-11 Antonis Vasileiou , Ben Finkelshtein , Floris Geerts , Ron Levie , Christopher Morris

Neural networks efficiently encode learned information within their parameters. Consequently, many tasks can be unified by treating neural networks themselves as input data. When doing so, recent studies demonstrated the importance of…

Machine Learning · Computer Science 2024-01-02 Derek Lim , Haggai Maron , Marc T. Law , Jonathan Lorraine , James Lucas

The growing complexity of wireless systems has accelerated the move from traditional methods to learning-based solutions. Graph Neural Networks (GNNs) are especially well-suited here, since wireless networks can be naturally represented as…

Signal Processing · Electrical Eng. & Systems 2025-10-02 Romina Garcia Camargo , Zhiyang Wang , Alejandro Ribeiro

Graph neural networks (GNNs) are widely used in domains like social networks and biological systems. However, the locality assumption of GNNs, which limits information exchange to neighboring nodes, hampers their ability to capture…

Machine Learning · Computer Science 2023-07-04 Tingting Dan , Jiaqi Ding , Ziquan Wei , Shahar Z Kovalsky , Minjeong Kim , Won Hwa Kim , Guorong Wu

Graph Neural Networks (GNNs) have achieved much success on graph-structured data. In light of this, there have been increasing interests in studying their expressive power. One line of work studies the capability of GNNs to approximate…

Machine Learning · Computer Science 2023-02-14 Zhengdao Chen , Soledad Villar , Lei Chen , Joan Bruna

Spectral features are widely incorporated within Graph Neural Networks (GNNs) to improve their expressive power, or their ability to distinguish among non-isomorphic graphs. One popular example is the usage of graph Laplacian eigenvectors…

Machine Learning · Computer Science 2025-09-29 Snir Hordan , Maya Bechler-Speicher , Gur Lifshitz , Nadav Dym

Graph-structured data consisting of objects (i.e., nodes) and relationships among objects (i.e., edges) are ubiquitous. Graph-level learning is a matter of studying a collection of graphs instead of a single graph. Traditional graph-level…

Machine Learning · Computer Science 2022-06-01 Ge Zhang , Jia Wu , Jian Yang , Shan Xue , Wenbin Hu , Chuan Zhou , Hao Peng , Quan Z. Sheng , Charu Aggarwal