中文
相关论文

相关论文: SDT-GNN: Streaming-based Distributed Training Fram…

200 篇论文

Training Graph Neural Networks (GNN) on large graphs is resource-intensive and time-consuming, mainly due to the large graph data that cannot be fit into the memory of a single machine, but have to be fetched from distributed graph storage…

分布式、并行与集群计算 · 计算机科学 2022-08-23 Ziyue Luo , Yixin Bao , Chuan Wu

Graph neural networks (GNN) have shown great success in learning from graph-structured data. They are widely used in various applications, such as recommendation, fraud detection, and search. In these domains, the graphs are typically large…

分布式、并行与集群计算 · 计算机科学 2022-03-15 Da Zheng , Xiang Song , Chengru Yang , Dominique LaSalle , George Karypis

Graph neural networks (GNNs), an emerging class of machine learning models for graphs, have gained popularity for their superior performance in various graph analytical tasks. Mini-batch training is commonly used to train GNNs on large…

分布式、并行与集群计算 · 计算机科学 2025-12-15 Sandeep Polisetty , Juelin Liu , Kobi Falus , Yi Ren Fung , Seung-Hwan Lim , Hui Guan , Marco Serafini

In recent years, graph neural networks (GNNs) have been widely applied in tackling combinatorial optimization problems. However, existing methods still suffer from limited accuracy when addressing that on complex graphs and exhibit poor…

机器学习 · 计算机科学 2025-11-13 Yuyao Long

Graph Neural Networks (GNNs) are powerful deep learning models to generate node embeddings on graphs. When applying deep GNNs on large graphs, it is still challenging to perform training in an efficient and scalable way. We propose a novel…

机器学习 · 计算机科学 2020-10-08 Hanqing Zeng , Hongkuan Zhou , Ajitesh Srivastava , Rajgopal Kannan , Viktor Prasanna

Spatiotemporal graph neural networks (ST-GNNs) are powerful tools for modeling spatial and temporal data dependencies. However, their applications have been limited primarily to small-scale datasets because of memory constraints. While…

分布式、并行与集群计算 · 计算机科学 2025-09-17 Seth Ockerman , Amal Gueroudji , Tanwi Mallick , Yixuan He , Line Pouchard , Robert Ross , Shivaram Venkataraman

Graph neural networks (GNNs) model nonlinear representations in graph data with applications in distributed agent coordination, control, and planning among others. Current GNN architectures assume ideal scenarios and ignore link…

信号处理 · 电气工程与系统科学 2021-09-01 Zhan Gao , Elvin Isufi , Alejandro Ribeiro

Graph neural networks (GNNs) have been demonstrated as a powerful tool for analyzing non-Euclidean graph data. However, the lack of efficient distributed graph learning systems severely hinders applications of GNNs, especially when graphs…

Graph neural networks (GNNs) are powerful tools for developing scalable, decentralized artificial intelligence in large-scale networked systems, such as wireless networks, power grids, and transportation networks. Currently, GNNs in…

机器学习 · 计算机科学 2024-12-10 Rostyslav Olshevskyi , Zhongyuan Zhao , Kevin Chan , Gunjan Verma , Ananthram Swami , Santiago Segarra

Graph Neural Networks (GNNs) are widely used today in recommendation systems, fraud detection, and node/link classification tasks. Real world GNNs continue to scale in size and require a large memory footprint for storing graphs and…

分布式、并行与集群计算 · 计算机科学 2026-03-31 Jeongmin Brian Park , Kun Wu , Vikram Sharma Mailthody , Zaid Quresh , Scott Mahlke , Wen-mei Hwu

In this study, we introduce a domain-decomposition-based distributed training and inference approach for message-passing neural networks (MPNN). Our objective is to address the challenge of scaling edge-based graph neural networks as the…

机器学习 · 计算机科学 2025-02-20 Priyesh Kakka , Sheel Nidhan , Rishikesh Ranade , Jay Pathak , Jonathan F. MacArt

Despite the recent success of Graph Neural Networks (GNNs), training GNNs on large graphs remains challenging. The limited resource capacities of the existing servers, the dependency between nodes in a graph, and the privacy concern due to…

机器学习 · 计算机科学 2022-03-15 Morteza Ramezani , Weilin Cong , Mehrdad Mahdavi , Mahmut T. Kandemir , Anand Sivasubramaniam

Graph Neural Networks (GNNs) have achieved state-of-the-art (SOTA) performance in diverse domains. However, training GNNs on large-scale graphs poses significant challenges due to high memory demands and significant communication overhead…

分布式、并行与集群计算 · 计算机科学 2025-05-19 Arefin Niam , M S Q Zulkar Nine

In smart mobility, large networks of geographically distributed sensors produce vast amounts of high-frequency spatio-temporal data that must be processed in real time to avoid major disruptions. Traditional centralized approaches are…

机器学习 · 计算机科学 2025-05-23 Ivan Kralj , Lodovico Giaretta , Gordan Ježić , Ivana Podnar Žarko , Šarūnas Girdzijauskas

Graph Neural Network (GNN) models on streaming graphs entail algorithmic challenges to continuously capture its dynamic state, as well as systems challenges to optimize latency, memory, and throughput during both inference and training. We…

分布式、并行与集群计算 · 计算机科学 2024-09-17 Rustam Guliyev , Aparajita Haldar , Hakan Ferhatosmanoglu

We present distributed algorithms for training dynamic Graph Neural Networks (GNN) on large scale graphs spanning multi-node, multi-GPU systems. To the best of our knowledge, this is the first scaling study on dynamic GNN. We devise…

分布式、并行与集群计算 · 计算机科学 2021-09-17 Venkatesan T. Chakaravarthy , Shivmaran S. Pandian , Saurabh Raje , Yogish Sabharwal , Toyotaro Suzumura , Shashanka Ubaru

Several distributed frameworks have been developed to scale Graph Neural Networks (GNNs) on billion-size graphs. On several benchmarks, we observe that the graph partitions generated by these frameworks have heterogeneous data distributions…

机器学习 · 计算机科学 2023-11-07 Dhruv Deshmukh , Gagan Raj Gupta , Manisha Chawla , Vishwesh Jatala , Anirban Haldar

Graph Neural Networks (GNNs) are widely used for learning on graph-structured data, but scaling GNN training to massive graphs remains challenging. To enable scalable distributed training, graphs are divided into smaller partitions that are…

机器学习 · 计算机科学 2026-04-02 Nikolai Merkel , Ruben Mayer , Volker Markl , Hans-Arno Jacobsen

Graph neural networks (GNNs) fuel diverse machine learning tasks involving graph-structured data, ranging from predicting protein structures to serving personalized recommendations. Real-world graph data must often be stored distributed…

机器学习 · 计算机科学 2024-02-13 Aashish Kolluri , Sarthak Choudhary , Bryan Hooi , Prateek Saxena

Training Graph Neural Networks (GNNs) on large graphs presents unique challenges due to the large memory and computing requirements. Distributed GNN training, where the graph is partitioned across multiple machines, is a common approach to…

机器学习 · 计算机科学 2024-06-26 Juan Cervino , Md Asadullah Turja , Hesham Mostafa , Nageen Himayat , Alejandro Ribeiro