English
Related papers

Related papers: When to Pre-Train Graph Neural Networks? From Data…

200 papers

Graph neural networks (GNNs) use graph convolutions to exploit network invariances and learn meaningful feature representations from network data. However, on large-scale graphs convolutions incur in high computational cost, leading to…

Machine Learning · Computer Science 2022-06-29 Juan Cervino , Luana Ruiz , Alejandro Ribeiro

A graph is a very common and powerful data structure used for modeling communication and social networks. Models that generate graphs with arbitrary features are important basic technologies in repeated simulations of networks and…

Machine Learning · Computer Science 2023-09-06 Takahiro Yokoyama , Yoshiki Sato , Sho Tsugawa , Kohei Watabe

Graph Neural Networks (GNNs) are powerful deep learning models to generate node embeddings on graphs. When applying deep GNNs on large graphs, it is still challenging to perform training in an efficient and scalable way. We propose a novel…

Machine Learning · Computer Science 2020-10-08 Hanqing Zeng , Hongkuan Zhou , Ajitesh Srivastava , Rajgopal Kannan , Viktor Prasanna

Graph neural networks (GNNs) have been applied into a variety of graph tasks. Most existing work of GNNs is based on the assumption that the given graph data is optimal, while it is inevitable that there exists missing or incomplete edges…

Machine Learning · Computer Science 2022-05-13 Qianggang Ding , Deheng Ye , Tingyang Xu , Peilin Zhao

Graph neural networks (GNNs) have shown great power in learning on attributed graphs. However, it is still a challenge for GNNs to utilize information faraway from the source node. Moreover, general GNNs require graph attributes as input,…

Machine Learning · Computer Science 2021-12-28 Danhao Zhu , Xin-yu Dai , Jiajun Chen

As powerful tools for representation learning on graphs, graph neural networks (GNNs) have facilitated various applications from drug discovery to recommender systems. Nevertheless, the effectiveness of GNNs is immensely challenged by…

Machine Learning · Computer Science 2023-02-28 Wei Jin , Tong Zhao , Jiayuan Ding , Yozen Liu , Jiliang Tang , Neil Shah

Graph Neural Networks (GNNs) have been extensively used in various real-world applications. However, the predictive uncertainty of GNNs stemming from diverse sources such as inherent randomness in data and model training errors can lead to…

Machine Learning · Computer Science 2025-03-11 Fangxin Wang , Yuqing Liu , Kay Liu , Yibo Wang , Sourav Medya , Philip S. Yu

Graph Neural Networks (GNNs) are a new and increasingly popular family of deep neural network architectures to perform learning on graphs. Training them efficiently is challenging due to the irregular nature of graph data. The problem…

Machine Learning · Computer Science 2021-06-15 Marco Serafini , Hui Guan

In this paper, we explore a novel model reusing task tailored for graph neural networks (GNNs), termed as "deep graph reprogramming". We strive to reprogram a pre-trained GNN, without amending raw node features nor model parameters, to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Yongcheng Jing , Chongbin Yuan , Li Ju , Yiding Yang , Xinchao Wang , Dacheng Tao

The "pre-train, prompt-tuning'' paradigm has demonstrated impressive performance for tuning pre-trained heterogeneous graph neural networks (HGNNs) by mitigating the gap between pre-trained models and downstream tasks. However, most…

Machine Learning · Computer Science 2024-11-05 Yujie Mo , Runpeng Yu , Xiaofeng Zhu , Xinchao Wang

Machine learning on graphs, especially using graph neural networks (GNNs), has seen a surge in interest due to the wide availability of graph data across a broad spectrum of disciplines, from life to social and engineering sciences. Despite…

Graph neural networks (GNNs) are a type of neural network capable of learning on graph-structured data. However, training GNNs on large-scale graphs is challenging due to iterative aggregations of high-dimensional features from neighboring…

Machine Learning · Computer Science 2024-09-18 Nikolai Merkel , Pierre Toussing , Ruben Mayer , Hans-Arno Jacobsen

Training large neural networks is possible by training a smaller hypernetwork that predicts parameters for the large ones. A recently released Graph HyperNetwork (GHN) trained this way on one million smaller ImageNet architectures is able…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Boris Knyazev

Deep learning-based approaches have been developed to solve challenging problems in wireless communications, leading to promising results. Early attempts adopted neural network architectures inherited from applications such as computer…

Information Theory · Computer Science 2022-11-07 Yifei Shen , Jun Zhang , S. H. Song , Khaled B. Letaief

Graph Neural Networks (GNNs) have shown promising results in modeling graphs in various tasks. The training of GNNs, especially on specialized tasks such as bioinformatics, demands extensive expert annotations, which are expensive and…

Machine Learning · Computer Science 2025-05-27 Minhua Lin , Enyan Dai , Junjie Xu , Jinyuan Jia , Xiang Zhang , Suhang Wang

Recently, graph neural networks (GNNs) have gained much attention as a growing area of deep learning capable of learning on graph-structured data. However, the computational and memory requirements for training GNNs on large-scale graphs…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-13 Nikolai Merkel , Daniel Stoll , Ruben Mayer , Hans-Arno Jacobsen

Graph Anomaly Detection (GAD) is a challenging and practical research topic where Graph Neural Networks (GNNs) have recently shown promising results. The effectiveness of existing GNNs in GAD has been mainly attributed to the simultaneous…

Machine Learning · Computer Science 2024-10-25 Jiashun Cheng , Zinan Zheng , Yang Liu , Jianheng Tang , Hongwei Wang , Yu Rong , Jia Li , Fugee Tsung

Graph neural networks (GNNs) build on the success of deep learning models by extending them for use in graph spaces. Transfer learning has proven extremely successful for traditional deep learning problems: resulting in faster training and…

Machine Learning · Computer Science 2022-02-03 Nishai Kooverjee , Steven James , Terence van Zyl

Recent research has demonstrated the efficacy of pre-training graph neural networks (GNNs) to capture the transferable graph semantics and enhance the performance of various downstream tasks. However, the semantic knowledge learned from…

Machine Learning · Computer Science 2023-12-19 Mouxiang Chen , Zemin Liu , Chenghao Liu , Jundong Li , Qiheng Mao , Jianling Sun

Graph neural networks (GNNs) are widely used for learning node embeddings in graphs, typically adopting a message-passing scheme. This approach, however, leads to the neighbor explosion problem, with exponentially growing computational and…

Machine Learning · Computer Science 2025-07-08 Zichao Yue , Chenhui Deng , Zhiru Zhang