中文
相关论文

相关论文: What graph neural networks cannot learn: depth vs …

200 篇论文

We study the generalization capabilities of Message Passing Neural Networks (MPNNs), a prevalent class of Graph Neural Networks (GNN). We derive generalization bounds specifically for MPNNs with normalized sum aggregation and mean…

机器学习 · 计算机科学 2024-04-05 Sohir Maskey , Gitta Kutyniok , Ron Levie

Graph structure learning is a well-established problem that aims at optimizing graph structures adaptive to specific graph datasets to help message passing neural networks (i.e., GNNs) to yield effective and robust node embeddings. However,…

机器学习 · 计算机科学 2023-06-21 Wentao Zhao , Qitian Wu , Chenxiao Yang , Junchi Yan

Learning powerful data embeddings has become a center piece in machine learning, especially in natural language processing and computer vision domains. The crux of these embeddings is that they are pretrained on huge corpus of data in a…

机器学习 · 计算机科学 2019-11-28 Saurabh Verma , Zhi-Li Zhang

Graph neural networks (GNNs) have emerged as a powerful model to capture critical graph patterns. Instead of treating them as black boxes in an end-to-end fashion, attempts are arising to explain the model behavior. Existing works mainly…

机器学习 · 计算机科学 2024-02-22 Yi Nian , Yurui Chang , Wei Jin , Lu Lin

Message passing neural networks (MPNN) have seen a steep rise in popularity since their introduction as generalizations of convolutional neural networks to graph-structured data, and are now considered state-of-the-art tools for solving a…

机器学习 · 计算机科学 2022-08-05 Sohir Maskey , Ron Levie , Yunseok Lee , Gitta Kutyniok

Graph Neural Networks (GNNs) are a powerful representational tool for solving problems on graph-structured inputs. In almost all cases so far, however, they have been applied to directly recovering a final solution from raw inputs, without…

机器学习 · 统计学 2020-01-16 Petar Veličković , Rex Ying , Matilde Padovano , Raia Hadsell , Charles Blundell

Despite the celebrated popularity of Graph Neural Networks (GNNs) across numerous applications, the ability of GNNs to generalize remains less explored. In this work, we propose to study the generalization of GNNs through a novel…

机器学习 · 计算机科学 2024-04-17 Shouheng Li , Dongwoo Kim , Qing Wang

Graph neural networks (GNNs) have become powerful tools for processing graph-based information in various domains. A desirable property of GNNs is transferability, where a trained network can swap in information from a different graph…

机器学习 · 计算机科学 2024-06-24 A. Martina Neuman , Jason J. Bramburger

Graph neural networks (GNNs) are powerful graph-based deep-learning models that have gained significant attention and demonstrated remarkable performance in various domains, including natural language processing, drug discovery, and…

机器学习 · 计算机科学 2023-06-06 Jaykumar Kakkad , Jaspal Jannu , Kartik Sharma , Charu Aggarwal , Sourav Medya

Graph Neural Networks (GNNs) have become a standard approach for learning from graph-structured data. However, their reliance on parametric classifiers (most often linear softmax layers) limits interpretability and sometimes hinders…

机器学习 · 计算机科学 2026-02-03 Zeljko Bolevic , Milos Brajovic , Isidora Stankovic , Ljubisa Stankovic

Graph neural networks (GNNs) are powerful machine learning models for various graph learning tasks. Recently, the limitations of the expressive power of various GNN models have been revealed. For example, GNNs cannot distinguish some…

机器学习 · 计算机科学 2021-01-19 Ryoma Sato , Makoto Yamada , Hisashi Kashima

Graph Neural Networks (GNNs) have emerged as a promising approach for ``learning to branch'' in Mixed-Integer Linear Programming (MILP). While standard Message-Passing GNNs (MPNNs) are efficient, they theoretically lack the expressive power…

机器学习 · 计算机科学 2025-12-11 Junru Zhou , Yicheng Wang , Pan Li

Interpreting graph neural networks (GNNs) is difficult because message passing mixes signals and internal channels rarely align with human concepts. We study superposition, the sharing of directions by multiple features, directly in the…

机器学习 · 计算机科学 2026-01-19 Lukas Pertl , Han Xuanyuan , Pietro Liò

In this paper, we study the generalization capabilities of geometric graph neural networks (GNNs). We consider GNNs over a geometric graph constructed from a finite set of randomly sampled points over an embedded manifold with topological…

信号处理 · 电气工程与系统科学 2025-06-10 Zhiyang Wang , Juan Cervino , Alejandro Ribeiro

Graph Neural Networks (GNNs) extend convolutional neural networks to operate on graphs. Despite their impressive performances in various graph learning tasks, the theoretical understanding of their generalization capability is still…

机器学习 · 计算机科学 2025-06-10 Zhiyang Wang , Juan Cervino , Alejandro Ribeiro

Graph neural networks (GNNs) have become compelling models designed to perform learning and inference on graph-structured data. However, little work has been done to understand the fundamental limitations of GNNs for scaling to larger…

机器学习 · 计算机科学 2023-10-27 Hyungeun Lee , Kijung Yoon

Graph Neural Networks (GNNs) have emerged as a flexible and powerful approach for learning over graphs. Despite this success, existing GNNs are constrained by their local message-passing architecture and are provably limited in their…

机器学习 · 计算机科学 2021-10-29 Rajat Talak , Siyi Hu , Lisa Peng , Luca Carlone

Graph neural networks (GNNs) have been extensively developed for graph representation learning in various application domains. However, similar to all other neural networks models, GNNs suffer from the black-box problem as people cannot…

机器学习 · 计算机科学 2022-03-18 Peibo Li , Yixing Yang , Maurice Pagnucco , Yang Song

Message Passing Neural Networks (MPNNs) hold a key position in machine learning on graphs, but they struggle with unintended behaviors, such as over-smoothing and over-squashing, due to irregular data structures. The observation and…

机器学习 · 计算机科学 2025-08-26 Junhyun Lee , Veronika Thost , Bumsoo Kim , Jaewoo Kang , Tengfei Ma

Graph Neural Networks (GNNs) have emerged as a powerful tool for data-driven learning on various graph domains. They are usually based on a message-passing mechanism and have gained increasing popularity for their intuitive formulation,…

机器学习 · 计算机科学 2023-11-02 Giuseppe Alessio D'Inverno , Simone Brugiapaglia , Mirco Ravanelli