中文
相关论文

相关论文: Deep Graph Neural Networks with Shallow Subgraph S…

200 篇论文

Graph neural networks (GNNs) are designed to process data associated with graphs. They are finding an increasing range of applications; however, as with other modern machine learning techniques, their theoretical understanding is limited.…

无序系统与神经网络 · 物理学 2026-02-23 O. Duranthon , L. Zdeborová

Graph Neural Networks (GNNs), a type of neural network that can learn from graph-structured data through neighborhood information aggregation, have shown superior performance in various downstream tasks. However, as the number of layers…

机器学习 · 计算机科学 2024-11-01 Jingbo Zhou , Yixuan Du , Ruqiong Zhang , Jun Xia , Zhizhi Yu , Zelin Zang , Di Jin , Carl Yang , Rui Zhang , Stan Z. Li

Graph neural networks (GNNs) are widely used for learning node embeddings in graphs, typically adopting a message-passing scheme. This approach, however, leads to the neighbor explosion problem, with exponentially growing computational and…

机器学习 · 计算机科学 2025-07-08 Zichao Yue , Chenhui Deng , Zhiru Zhang

Graph Neural Networks (GNNs) are powerful deep learning methods for Non-Euclidean data. Popular GNNs are message-passing algorithms (MPNNs) that aggregate and combine signals in a local graph neighborhood. However, shallow MPNNs tend to…

Graph Neural Networks (GNNs) face two fundamental challenges when scaled to deep architectures: oversmoothing, where node representations converge to indistinguishable vectors, and oversquashing, where information from distant nodes fails…

机器学习 · 计算机科学 2026-03-30 Mostafa Haghir Chehreghani

Deep graph neural networks (GNNs) have achieved excellent results on various tasks on increasingly large graph datasets with millions of nodes and edges. However, memory complexity has become a major obstacle when training deep GNNs for…

机器学习 · 计算机科学 2022-04-12 Guohao Li , Matthias Müller , Bernard Ghanem , Vladlen Koltun

Graph neural networks (GNNs) are among the most powerful tools in deep learning. They routinely solve complex problems on unstructured networks, such as node classification, graph classification, or link prediction, with high accuracy.…

机器学习 · 计算机科学 2023-08-21 Maciej Besta , Torsten Hoefler

Graph Neural Networks (GNNs) are a new and increasingly popular family of deep neural network architectures to perform learning on graphs. Training them efficiently is challenging due to the irregular nature of graph data. The problem…

机器学习 · 计算机科学 2021-06-15 Marco Serafini , Hui Guan

It has been observed that message-passing graph neural networks (GNN) sometimes struggle to maintain a healthy balance between the efficient/scalable modeling of long-range dependencies across nodes while avoiding unintended consequences…

机器学习 · 计算机科学 2025-05-21 Yongyi Yang , Tang Liu , Yangkun Wang , Zengfeng Huang , David Wipf

Graph Neural Networks (GNNs) have proven effective in various medical imaging applications, such as automated disease diagnosis. However, due to the local neighborhood aggregation paradigm in message passing which characterizes these…

机器学习 · 计算机科学 2024-11-05 K. Mancini , I. Rekik

Graph Neural Networks (GNNs) have achieved notable success in various applications over graph data. However, recent research has revealed that real-world graphs often contain noise, and GNNs are susceptible to noise in the graph. To address…

机器学习 · 计算机科学 2024-04-16 Tai Hasegawa , Sukwon Yun , Xin Liu , Yin Jun Phua , Tsuyoshi Murata

Graph Neural Networks (GNNs) require a relatively large number of labeled nodes and a reliable/uncorrupted graph connectivity structure in order to obtain good performance on the semi-supervised node classification task. The performance of…

机器学习 · 计算机科学 2021-07-01 Abdullah Alchihabi , Yuhong Guo

Graph representation learning aims to effectively encode high-dimensional sparse graph-structured data into low-dimensional dense vectors, which is a fundamental task that has been widely studied in a range of fields, including machine…

Graph Neural Networks (GNNs), which aggregate features from neighbors, are widely used for graph-structured data processing due to their powerful representation learning capabilities. It is generally believed that GNNs can implicitly remove…

机器学习 · 计算机科学 2022-09-30 Songtao Liu , Rex Ying , Hanze Dong , Lu Lin , Jinghui Chen , Dinghao Wu

Graph Neural Networks (GNNs) are an effective framework for representation learning of graphs. GNNs follow a neighborhood aggregation scheme, where the representation vector of a node is computed by recursively aggregating and transforming…

机器学习 · 计算机科学 2019-02-26 Keyulu Xu , Weihua Hu , Jure Leskovec , Stefanie Jegelka

Training deep graph neural networks (GNNs) is notoriously hard. Besides the standard plights in training deep architectures such as vanishing gradients and overfitting, it also uniquely suffers from over-smoothing, information squashing,…

机器学习 · 计算机科学 2022-05-10 Tianlong Chen , Kaixiong Zhou , Keyu Duan , Wenqing Zheng , Peihao Wang , Xia Hu , Zhangyang Wang

Graph Neural Networks (GNNs) are limited in their propagation operators. In many cases, these operators often contain non-negative elements only and are shared across channels, limiting the expressiveness of GNNs. Moreover, some GNNs suffer…

机器学习 · 计算机科学 2023-05-08 Moshe Eliasof , Lars Ruthotto , Eran Treister

Subgraph GNNs enhance message-passing GNNs expressivity by representing graphs as sets of subgraphs, demonstrating impressive performance across various tasks. However, their scalability is hindered by the need to process large numbers of…

机器学习 · 计算机科学 2025-06-02 Guy Bar-Shalom , Yam Eitan , Fabrizio Frasca , Haggai Maron

Graph Convolutional Networks (GCNs) have become a crucial tool on learning representations of graph vertices. The main challenge of adapting GCNs on large-scale graphs is the scalability issue that it incurs heavy cost both in computation…

计算机视觉与模式识别 · 计算机科学 2018-11-20 Wenbing Huang , Tong Zhang , Yu Rong , Junzhou Huang

Graph Neural Networks (GNNs) have become powerful tools for learning from graph-structured data, finding applications across diverse domains. However, as graph sizes and connectivity increase, standard GNN training methods face significant…

机器学习 · 计算机科学 2025-12-01 Eshed Gal , Moshe Eliasof , Carola-Bibiane Schönlieb , Ivan I. Kyrchei , Eldad Haber , Eran Treister