English
Related papers

Related papers: Distributed Graph Neural Network Training with Per…

200 papers

Graph neural networks (GNNs), which have emerged as an effective method for handling machine learning tasks on graphs, bring a new approach to building recommender systems, where the task of recommendation can be formulated as the link…

Information Retrieval · Computer Science 2022-11-03 Yuwei Hu , Jiajie Li , Zhongming Yu , Zhiru Zhang

Graph Neural Networks (GNNs) have shown great superiority on non-Euclidean graph data, achieving ground-breaking performance on various graph-related tasks. As a practical solution to train GNN on large graphs with billions of nodes and…

Machine Learning · Computer Science 2024-09-24 Zeyu Zhu , Peisong Wang , Qinghao Hu , Gang Li , Xiaoyao Liang , Jian Cheng

Graph Neural Networks (GNNs) are versatile, powerful machine learning methods that enable graph structure and feature representation learning, and have applications across many domains. For applications critically requiring interpretation,…

Machine Learning · Computer Science 2020-07-02 Chris Lin , Gerald J. Sun , Krishna C. Bulusu , Jonathan R. Dry , Marylens Hernandez

Graph Neural Networks (GNNs) have demonstrated remarkable efficacy in tackling a wide array of graph-related tasks across diverse domains. However, a significant challenge lies in their propensity to generate biased predictions,…

Machine Learning · Computer Science 2025-01-03 Abdullah Alchihabi , Yuhong Guo

Graph neural networks (GNNs) are widely used for learning on graph datasets derived from various real-world scenarios. Learning from extremely large graphs requires distributed training, and mini-batching with sampling is a popular approach…

Dynamic graph representation learning has emerged as a crucial research area, driven by the growing need for analyzing time-evolving graph data in real-world applications. While recent approaches leveraging recurrent neural networks (RNNs)…

Machine Learning · Computer Science 2024-10-28 Shengxiang Hu , Guobing Zou , Song Yang , Shiyi Lin , Yanglan Gan , Bofeng Zhang

Graph clustering aims to divide the graph into different clusters. The recently emerging deep graph clustering approaches are largely built on graph neural networks (GNN). However, GNN is designed for general graph encoding and there is a…

Machine Learning · Computer Science 2025-04-28 Zhiyuan Ning , Zaitian Wang , Ran Zhang , Ping Xu , Kunpeng Liu , Pengyang Wang , Wei Ju , Pengfei Wang , Yuanchun Zhou , Erik Cambria , Chong Chen

Graph neural networks (GNNs) are machine learning models specialized for graph data and widely used in many applications. To train GNNs on large graphs that exceed CPU memory, several systems store data on disk and conduct out-of-core…

Machine Learning · Computer Science 2025-02-18 Renjie Liu , Yichuan Wang , Xiao Yan , Haitian Jiang , Zhenkun Cai , Minjie Wang , Bo Tang , Jinyang Li

Developing scalable solutions for training Graph Neural Networks (GNNs) for link prediction tasks is challenging due to the high data dependencies which entail high computational cost and huge memory footprint. We propose a new method for…

Machine Learning · Computer Science 2022-01-11 Nasrullah Sheikh , Xiao Qin , Berthold Reinwald , Chuan Lei

Distributed training is an effective way to accelerate the training process of large-scale deep learning models. However, the parameter exchange and synchronization of distributed stochastic gradient descent introduce a large amount of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-16 LingFei Dai , Boyu Diao , Chao Li , Yongjun Xu

Graph Neural Networks (GNNs) have recently been applied to graph learning tasks and achieved state-of-the-art (SOTA) results. However, many competitive methods run GNNs multiple times with subgraph extraction and customized labeling to…

Machine Learning · Computer Science 2023-02-14 Lecheng Kong , Yixin Chen , Muhan Zhang

We present GERN, a novel scalable framework for training GNNs in node classification tasks, based on effective resistance, a standard tool in spectral graph theory. Our method progressively refines the GNN weights on a sequence of random…

Machine Learning · Computer Science 2025-02-25 Francesco Bonchi , Claudio Gentile , Francesco Paolo Nerini , André Panisson , Fabio Vitale

While Graph Neural Networks (GNNs) have recently become the de facto standard for modeling relational data, they impose a strong assumption on the availability of the node or edge features of the graph. In many real-world applications,…

Machine Learning · Computer Science 2022-05-24 Emanuele Rossi , Henry Kenlay , Maria I. Gorinova , Benjamin Paul Chamberlain , Xiaowen Dong , Michael Bronstein

Graph neural networks (GNNs) have achieved breakthroughs in various real-world downstream tasks due to their powerful expressiveness. As the scale of real-world graphs has been continuously growing, a storage-based approach to GNN training…

Machine Learning · Computer Science 2026-01-07 Myung-Hwan Jang , Jeong-Min Park , Yunyong Ko , Sang-Wook Kim

Graph neural networks (GNNs) have attracted widespread attention for their impressive capability of graph representation learning. However, the increasing prevalence of large-scale graphs presents a significant challenge for GNN training…

Machine Learning · Computer Science 2025-05-13 Xinyi Gao , Hongzhi Yin , Tong Chen , Guanhua Ye , Wentao Zhang , Bin Cui

Graph Neural Networks (GNNs) have demonstrated remarkable performance in a wide range of tasks, such as node classification, link prediction, and graph classification, by exploiting the structural information in graph-structured data.…

Machine Learning · Computer Science 2026-01-09 Oscar Llorente , Jaime Boal , Eugenio F. Sánchez-Úbeda , Antonio Diaz-Cano , Miguel Familiar

Graph Neural Networks (GNNs) are powerful tools for learning from graph-structured data, but their scalability is increasingly strained by the size of real-world graphs in domains like recommender systems, fraud detection, and molecular…

Machine Learning · Computer Science 2026-05-22 Mridul Gupta , Samyak Jain , Vansh Ramani , Hariprasad Kodamana , Sayan Ranu

Graph condensation has emerged as an intriguing technique to save the expensive training costs of Graph Neural Networks (GNNs) by substituting a condensed small graph with the original graph. Despite the promising results achieved, previous…

Social and Information Networks · Computer Science 2025-01-27 Zhenbang Xiao , Yu Wang , Shunyu Liu , Bingde Hu , Huiqiong Wang , Mingli Song , Tongya Zheng

Given the prevalence of large-scale graphs in real-world applications, the storage and time for training neural models have raised increasing concerns. To alleviate the concerns, we propose and study the problem of graph condensation for…

Machine Learning · Computer Science 2022-09-29 Wei Jin , Lingxiao Zhao , Shichang Zhang , Yozen Liu , Jiliang Tang , Neil Shah

Graph neural networks (GNNs) continue to achieve state-of-the-art performance on many graph learning tasks, but rely on the assumption that a given graph is a sufficient approximation of the true neighborhood structure. When a system…

Machine Learning · Computer Science 2023-02-08 Steven J. Krieg , William C. Burgis , Patrick M. Soga , Nitesh V. Chawla