English
Related papers

Related papers: Adaptive Message Quantization and Parallelization …

200 papers

Deep neural networks (DNNs) continue to grow rapidly in size, making them infeasible to train on a single device. Pipeline parallelism is commonly used in existing DNN systems to support large-scale DNN training by partitioning a DNN into…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-29 Byungsoo Jeon , Mengdi Wu , Shiyi Cao , Sunghyun Kim , Sunghyun Park , Neeraj Aggarwal , Colin Unger , Daiyaan Arfeen , Peiyuan Liao , Xupeng Miao , Mohammad Alizadeh , Gregory R. Ganger , Tianqi Chen , Zhihao Jia

Graph Neural Networks (GNNs) have already been widely used in various graph mining tasks. However, recent works reveal that the learned weights (channels) in well-trained GNNs are highly redundant, which inevitably limits the performance of…

Machine Learning · Computer Science 2023-10-05 Liang Zeng , Jin Xu , Zijun Yao , Yanqiao Zhu , Jian Li

Graph neural networks (GNNs) are powerful tools for exploring and learning from graph structures and features. As such, achieving high-performance execution for GNNs becomes crucially important. Prior works have proposed to explore the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-30 Yangjie Zhou , Yaoxu Song , Jingwen Leng , Zihan Liu , Weihao Cui , Zhendong Zhang , Cong Guo , Quan Chen , Li Li , Minyi Guo

Graph neural networks (GNNs) are a type of deep learning models that are trained on graphs and have been successfully applied in various domains. Despite the effectiveness of GNNs, it is still challenging for GNNs to efficiently scale to…

Machine Learning · Computer Science 2023-08-28 Yingxia Shao , Hongzheng Li , Xizhi Gu , Hongbo Yin , Yawen Li , Xupeng Miao , Wentao Zhang , Bin Cui , Lei Chen

In this work, we aim to classify nodes of unstructured peer-to-peer networks with communication uncertainty, such as users of decentralized social networks. Graph Neural Networks (GNNs) are known to improve the accuracy of simple…

Machine Learning · Computer Science 2022-03-17 Emmanouil Krasanakis , Symeon Papadopoulos , Ioannis Kompatsiaris

The demand for high speed data transmission has increased rapidly, leading to advanced optical communication techniques. In the past few years, multiple equalizers based on neural network (NN) have been proposed to recover signal from…

Signal Processing · Electrical Eng. & Systems 2020-08-26 Qingyi Zhou , Fan Zhang , Chuanchuan Yang

Graph Neural Networks (GNN) are indispensable in learning from graph-structured data, yet their rising computational costs, especially on massively connected graphs, pose significant challenges in terms of execution performance. To tackle…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-05 Aishwarya Sarkar , Sayan Ghosh , Nathan R. Tallent , Ali Jannesari

The pre-train then fine-tune approach has advanced GNNs by enabling general knowledge capture without task-specific labels. However, an objective gap between pre-training and downstream tasks limits its effectiveness. Recent graph prompting…

Machine Learning · Computer Science 2025-01-28 Qin Chen , Liang Wang , Bo Zheng , Guojie Song

This paper presents TAG, an automatic system to derive optimized DNN training graph and its deployment onto any device topology, for expedited training in device- and topology- heterogeneous ML clusters. We novelly combine both the DNN…

Machine Learning · Computer Science 2023-02-14 Shiwei Zhang , Xiaodong Yi , Lansong Diao , Chuan Wu , Siyu Wang , Wei Lin

Message-passing graph neural network interatomic potentials (GNN-IPs), particularly those with equivariant representations such as NequIP, are attracting significant attention due to their data efficiency and high accuracy. However,…

Materials Science · Physics 2024-06-13 Yutack Park , Jaesun Kim , Seungwoo Hwang , Seungwu Han

In this work we apply model averaging to parallel training of deep neural network (DNN). Parallelization is done in a model averaging manner. Data is partitioned and distributed to different nodes for local model updates, and model…

Machine Learning · Computer Science 2018-07-03 Hang Su , Haoyu Chen

Subgraph GNNs enhance message-passing GNNs expressivity by representing graphs as sets of subgraphs, demonstrating impressive performance across various tasks. However, their scalability is hindered by the need to process large numbers of…

Machine Learning · Computer Science 2025-06-02 Guy Bar-Shalom , Yam Eitan , Fabrizio Frasca , Haggai Maron

Full-batch training on Graph Neural Networks (GNN) to learn the structure of large graphs is a critical problem that needs to scale to hundreds of compute nodes to be feasible. It is challenging due to large memory capacity and bandwidth…

Stochastic Gradient Descent (SGD) is the key learning algorithm for many machine learning tasks. Because of its computational costs, there is a growing interest in accelerating SGD on HPC resources like GPU clusters. However, the…

Machine Learning · Computer Science 2021-01-20 Peng Jiang , Gagan Agrawal

Graph neural networks (GNNs) fuel diverse machine learning tasks involving graph-structured data, ranging from predicting protein structures to serving personalized recommendations. Real-world graph data must often be stored distributed…

Machine Learning · Computer Science 2024-02-13 Aashish Kolluri , Sarthak Choudhary , Bryan Hooi , Prateek Saxena

Although it has been extensively explored in theory, decentralized learning is not yet green-lighted for production use, largely due to a lack of stability, scalability, and generality in large scale DNN training. To shed light on the…

Machine Learning · Computer Science 2025-09-17 Bing Xie , Junqi Yin , Zhenyu Zhou , Sarp Oral , Feiyi Wang

Minimizing transmission delay in wireless multi-hop networks is a fundamental yet challenging task due to the complex coupling among interference, queue dynamics, and distributed control. Traditional scheduling algorithms, such as…

Signal Processing · Electrical Eng. & Systems 2025-12-10 Boxuan Wen , Junyu Luo

Graph Neural Networks (GNNs) have become powerful tools for learning from graph-structured data, finding applications across diverse domains. However, as graph sizes and connectivity increase, standard GNN training methods face significant…

Machine Learning · Computer Science 2025-12-01 Eshed Gal , Moshe Eliasof , Carola-Bibiane Schönlieb , Ivan I. Kyrchei , Eldad Haber , Eran Treister

Graph neural networks (GNNs) are widely used for learning node embeddings in graphs, typically adopting a message-passing scheme. This approach, however, leads to the neighbor explosion problem, with exponentially growing computational and…

Machine Learning · Computer Science 2025-07-08 Zichao Yue , Chenhui Deng , Zhiru Zhang

In recent years, graph neural networks (GNNs) have been widely applied in tackling combinatorial optimization problems. However, existing methods still suffer from limited accuracy when addressing that on complex graphs and exhibit poor…

Machine Learning · Computer Science 2025-11-13 Yuyao Long