English
Related papers

Related papers: CondenseGraph: Communication-Efficient Distributed…

200 papers

Graph embedding, aiming to learn low-dimensional representations (aka. embeddings) of nodes, has received significant attention recently. Recent years have witnessed a surge of efforts made on static graphs, among which Graph Convolutional…

Machine Learning · Computer Science 2021-04-08 Zeyu Cui , Zekun Li , Shu Wu , Xiaoyu Zhang , Qiang Liu , Liang Wang , Mengmeng Ai

Graph Convolutional Networks (GCNs), particularly for large-scale graphs, are crucial across numerous domains. However, training distributed full-batch GCNs on large-scale graphs suffers from inefficient memory access patterns and high…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-27 Chen Zhuang , Lingqi Zhang , Du Wu , Peng Chen , Jiajun Huang , Xin Liu , Rio Yokota , Nikoli Dryden , Toshio Endo , Satoshi Matsuoka , Mohamed Wahib

Recently, distributed GNN training frameworks, such as DistDGL and PyG, have been developed to enable training GNN models on large graphs by leveraging multiple GPUs in a distributed manner. Despite these advances, their memory requirements…

Machine Learning · Computer Science 2025-12-09 Xin Huang , Weipeng Zhuo , Minh Phu Vuong , Shiju Li , Jongryool Kim , Bradley Rees , Chul-Ho Lee

We present a Graph Neural Network (GNN) that accurately simulates a multidisperse suspension of interacting spherical particles. Our machine learning framework is built upon the recent work of Sanchez-Gonzalez et al. ICML, PMLR, 119,…

Computational Physics · Physics 2025-02-20 Aref Hashemi , Aliakbar Izadkhah

Distributed training of GNNs enables learning on massive graphs (e.g., social and e-commerce networks) that exceed the storage and computational capacity of a single machine. To reach performance comparable to centralized training,…

Machine Learning · Computer Science 2023-05-18 Jiong Zhu , Aishwarya Reganti , Edward Huang , Charles Dickens , Nikhil Rao , Karthik Subbian , Danai Koutra

In the area of large-scale training of graph embeddings, effective training frameworks and partitioning methods are critical for handling large networks. However, they face two major challenges: 1) existing synchronized distributed…

Machine Learning · Computer Science 2024-09-17 Yuhe Bai , Camelia Constantin , Hubert Naacke

Training Graph Neural Networks(GNNs) on a large monolithic graph presents unique challenges as the graph cannot fit within a single machine and it cannot be decomposed into smaller disconnected components. Distributed sampling-based…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-30 Hesham Mostafa , Adam Grabowski , Md Asadullah Turja , Juan Cervino , Alejandro Ribeiro , Nageen Himayat

Graph neural networks (GNNs) have been shown promising in improving the efficiency of learning communication policies by leveraging their permutation properties. Nonetheless, existing works design GNNs only for specific wireless policies,…

Signal Processing · Electrical Eng. & Systems 2023-08-22 Shengjie Liu , Jia Guo , Chenyang Yang

Graph neural networks (GNNs) use graph convolutions to exploit network invariances and learn meaningful feature representations from network data. However, on large-scale graphs convolutions incur in high computational cost, leading to…

Machine Learning · Computer Science 2022-06-29 Juan Cervino , Luana Ruiz , Alejandro Ribeiro

Graph Neural Networks (GNNs) are widely used for learning on graph-structured data, but scaling GNN training to massive graphs remains challenging. To enable scalable distributed training, graphs are divided into smaller partitions that are…

Machine Learning · Computer Science 2026-04-02 Nikolai Merkel , Ruben Mayer , Volker Markl , Hans-Arno Jacobsen

This paper addresses the limitations of multi-node perception and delayed scheduling response in distributed systems by proposing a GNN-based multi-node collaborative perception mechanism. The system is modeled as a graph structure.…

Machine Learning · Computer Science 2025-05-23 Wenxuan Zhu , Qiyuan Wu , Tengda Tang , Renzi Meng , Sheng Chai , Xuehui Quan

Graph convolutional learning has led to many exciting discoveries in diverse areas. However, in some applications, traditional graphs are insufficient to capture the structure and intricacies of the data. In such scenarios, multigraphs…

Machine Learning · Computer Science 2023-04-26 Landon Butler , Alejandro Parada-Mayorga , Alejandro Ribeiro

Distributed GNN training is dominated by remote feature fetching, which can be very costly. Multi-hop neighborhood sampling crosses partition boundaries and triggers fine-grained RPCs whose fixed initiation cost and GPU-stall latency waste…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-28 Arefin Niam , Tevfik Kosar , M. S. Q. Zulkar Nine

In wireless networks characterized by dense connectivity, the significant signaling overhead generated by distributed link scheduling algorithms can exacerbate issues like congestion, energy consumption, and radio footprint expansion. To…

Networking and Internet Architecture · Computer Science 2025-09-09 Zhongyuan Zhao , Gunjan Verma , Ananthram Swami , Santiago Segarra

Communication is a key bottleneck for distributed graph neural network (GNN) training. This paper proposes GNNPipe, a new approach that scales the distributed full-graph deep GNN training. Being the first to use layer-level model…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-26 Jingji Chen , Zhuoming Chen , Xuehai Qian

Developing scalable solutions for training Graph Neural Networks (GNNs) for link prediction tasks is challenging due to the high data dependencies which entail high computational cost and huge memory footprint. We propose a new method for…

Machine Learning · Computer Science 2022-01-11 Nasrullah Sheikh , Xiao Qin , Berthold Reinwald , Chuan Lei

Graph Neural Networks (GNNs) rely on graph convolutions to exploit meaningful patterns in networked data. Based on matrix multiplications, convolutions incur in high computational costs leading to scalability limitations in practice. To…

Machine Learning · Computer Science 2022-10-28 Juan Cervino , Luana Ruiz , Alejandro Ribeiro

Graph neural networks (GNNs) learn representations from network data with naturally distributed architectures, rendering them well-suited candidates for decentralized learning. Oftentimes, this decentralized graph support changes with time…

Machine Learning · Computer Science 2020-10-27 Zhan Gao , Fernando Gama , Alejandro Ribeiro

Graph Convolutional Networks (GCNs) have become a crucial tool on learning representations of graph vertices. The main challenge of adapting GCNs on large-scale graphs is the scalability issue that it incurs heavy cost both in computation…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Wenbing Huang , Tong Zhang , Yu Rong , Junzhou Huang

This paper presents TAG, an automatic system to derive optimized DNN training graph and its deployment onto any device topology, for expedited training in device- and topology- heterogeneous ML clusters. We novelly combine both the DNN…

Machine Learning · Computer Science 2023-02-14 Shiwei Zhang , Xiaodong Yi , Lansong Diao , Chuan Wu , Siyu Wang , Wei Lin