中文
相关论文

相关论文: Mitigating Overfitting in Graph Neural Networks vi…

200 篇论文

The quality of signal propagation in message-passing graph neural networks (GNNs) strongly influences their expressivity as has been observed in recent works. In particular, for prediction tasks relying on long-range interactions, recursive…

机器学习 · 计算机科学 2022-08-09 Pradeep Kr. Banerjee , Kedar Karhadkar , Yu Guang Wang , Uri Alon , Guido Montúfar

Due to inappropriate sample selection and limited training data, a distribution shift often exists between the training and test sets. This shift can adversely affect the test performance of Graph Neural Networks (GNNs). Existing approaches…

机器学习 · 计算机科学 2023-10-16 Rui Ding , Jielong Yang , Feng Ji , Xionghu Zhong , Linbo Xie

Real data collected from different applications that have additional topological structures and connection information are amenable to be represented as a weighted graph. Considering the node labeling problem, Graph Neural Networks (GNNs)…

社会与信息网络 · 计算机科学 2020-02-06 Xiaoxiao Li , Joao Saude

Graph Neural Networks (GNNs) have been highly successful for the node classification task. GNNs typically assume graphs are homophilic, i.e. neighboring nodes are likely to belong to the same class. However, a number of real-world graphs…

机器学习 · 计算机科学 2024-09-20 Yurui Lai , Taiyan Zhang , Rui Fan

We present a new method to regularize graph neural networks (GNNs) for better generalization in graph classification. Observing that the omission of sub-structures does not necessarily change the class label of the whole graph, we develop…

社会与信息网络 · 计算机科学 2020-09-23 Yiwei Wang , Wei Wang , Yuxuan Liang , Yujun Cai , Bryan Hooi

Graph neural networks (GNNs) have received great attention due to their success in various graph-related learning tasks. Several GNN frameworks have then been developed for fast and easy implementation of GNN models. Despite their…

机器学习 · 计算机科学 2022-11-08 Xin Huang , Jongryool Kim , Bradley Rees , Chul-Ho Lee

Recent works have impressively demonstrated that there exists a subnetwork in randomly initialized convolutional neural networks (CNNs) that can match the performance of the fully trained dense networks at initialization, without any…

Graph Neural Networks (GNNs) are widely used to perform different machine learning tasks on graphs. As the size of the graphs grows, and the GNNs get deeper, training and inference time become costly in addition to the memory requirement.…

机器学习 · 计算机科学 2022-08-09 Md. Khaledur Rahman , Ariful Azad

Graph neural networks (GNNs) are effective models for representation learning on relational data. However, standard GNNs are limited in their expressive power, as they cannot distinguish graphs beyond the capability of the Weisfeiler-Leman…

机器学习 · 计算机科学 2021-06-07 Ralph Abboud , İsmail İlkan Ceylan , Martin Grohe , Thomas Lukasiewicz

Graph neural networks (GNNs) use graph convolutions to exploit network invariances and learn meaningful feature representations from network data. However, on large-scale graphs convolutions incur in high computational cost, leading to…

机器学习 · 计算机科学 2022-06-29 Juan Cervino , Luana Ruiz , Alejandro Ribeiro

This paper addresses the challenging problem of retrieval and matching of graph structured objects, and makes two key contributions. First, we demonstrate how Graph Neural Networks (GNN), which have emerged as an effective model for various…

机器学习 · 计算机科学 2019-05-14 Yujia Li , Chenjie Gu , Thomas Dullien , Oriol Vinyals , Pushmeet Kohli

In this paper, we explore a novel model reusing task tailored for graph neural networks (GNNs), termed as "deep graph reprogramming". We strive to reprogram a pre-trained GNN, without amending raw node features nor model parameters, to…

计算机视觉与模式识别 · 计算机科学 2023-05-01 Yongcheng Jing , Chongbin Yuan , Li Ju , Yiding Yang , Xinchao Wang , Dacheng Tao

Most graph neural networks (GNNs) are prone to the phenomenon of over-squashing in which node features become insensitive to information from distant nodes in the graph. Recent works have shown that the topology of the graph has the…

机器学习 · 计算机科学 2023-11-30 Julia Balla

Graph neural networks (GNNs) have been extensively studied for prediction tasks on graphs. As pointed out by recent studies, most GNNs assume local homophily, i.e., strong similarities in local neighborhoods. This assumption however limits…

机器学习 · 计算机科学 2021-10-04 Sean Li , Dongwoo Kim , Qing Wang

The recent rapid growth in mobile data traffic entails a pressing demand for improving the throughput of the underlying wireless communication networks. Network node deployment has been considered as an effective approach for throughput…

网络与互联网体系结构 · 计算机科学 2022-09-16 Yifei Yang , Dongmian Zou , Xiaofan He

Over-parameterized neural network models often lead to significant performance discrepancies between training and test sets, a phenomenon known as overfitting. To address this, researchers have proposed numerous regularization techniques…

机器学习 · 计算机科学 2025-01-27 RuiZhe Jiang , Haotian Lei

Graph Neural Networks (GNNs) have been studied through the lens of expressive power and generalization. However, their optimization properties are less well understood. We take the first step towards analyzing GNN training by studying the…

机器学习 · 计算机科学 2021-05-27 Keyulu Xu , Mozhi Zhang , Stefanie Jegelka , Kenji Kawaguchi

Graph neural networks (GNNs) have exhibited exceptional efficacy in a diverse array of applications. However, the sheer size of large-scale graphs presents a significant challenge to real-time inference with GNNs. Although existing Scalable…

机器学习 · 计算机科学 2023-12-13 Xinyi Gao , Wentao Zhang , Junliang Yu , Yingxia Shao , Quoc Viet Hung Nguyen , Bin Cui , Hongzhi Yin

Graph neural networks (GNNs) work remarkably well in semi-supervised node regression, yet a rigorous theory explaining when and why they succeed remains lacking. To address this gap, we study an aggregate-and-readout model that encompasses…

机器学习 · 统计学 2026-02-20 Juntong Chen , Claire Donnat , Olga Klopp , Johannes Schmidt-Hieber

Graph neural networks (GNNs) achieve strong performance on graph learning tasks, but training on large-scale networks remains computationally challenging. Transferability results show that GNNs with fixed weights can generalize from smaller…

信号处理 · 电气工程与系统科学 2026-04-17 Haoyu Wang , Renyuan Ma , Gonzalo Mateos , Luana Ruiz