English
Related papers

Related papers: Boosting Distributed Full-graph GNN Training with …

200 papers

Graph Neural Networks (GNNs) have shown success in learning from graph-structured data, with applications to fraud detection, recommendation, and knowledge graph reasoning. However, training GNN efficiently is challenging because: 1) GPU…

Machine Learning · Computer Science 2021-11-12 Seung Won Min , Kun Wu , Mert Hidayetoğlu , Jinjun Xiong , Xiang Song , Wen-mei Hwu

Graph Neural Networks (GNNs) have been widely used in various domains, and GNNs with sophisticated computational graph lead to higher latency and larger memory consumption. Optimizing the GNN computational graph suffers from: (1) Redundant…

Machine Learning · Computer Science 2021-10-20 Hengrui Zhang , Zhongming Yu , Guohao Dai , Guyue Huang , Yufei Ding , Yuan Xie , Yu Wang

Graph neural networks (GNNs) are powerful tools for learning from graph data and are widely used in various applications such as social network recommendation, fraud detection, and graph search. The graphs in these applications are…

Machine Learning · Computer Science 2021-06-14 Jialin Dong , Da Zheng , Lin F. Yang , Geroge Karypis

Vertical federated learning (VFL) is a distributed learning paradigm, where computing clients collectively train a model based on the partial features of the same set of samples they possess. Current research on VFL focuses on the case when…

Machine Learning · Computer Science 2023-03-17 Xinwei Zhang , Mingyi Hong , Jie Chen

The increasing size of input graphs for graph neural networks (GNNs) highlights the demand for using multi-GPU platforms. However, existing multi-GPU GNN systems optimize the computation and communication individually based on the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-28 Yuke Wang , Boyuan Feng , Zheng Wang , Tong Geng , Kevin Barker , Ang Li , Yufei Ding

Graph neural networks (GNNs) have achieved state-of-the-art performance for node classification on graphs. The vast majority of existing works assume that genuine node labels are always provided for training. However, there has been very…

Machine Learning · Computer Science 2021-03-08 Yayong Li , Jie yin , Ling Chen

Parallel implementations of stochastic gradient descent (SGD) have received significant research attention, thanks to excellent scalability properties of this algorithm, and to its efficiency in the context of training deep neural networks.…

Machine Learning · Computer Science 2017-12-07 Dan Alistarh , Demjan Grubic , Jerry Li , Ryota Tomioka , Milan Vojnovic

Graph Neural Networks (GNNs) are a promising deep learning approach for circumventing many real-world problems on graph-structured data. However, these models usually have at least one of four fundamental limitations: over-smoothing,…

Machine Learning · Computer Science 2022-10-03 Xun Liu , Alex Hay-Man Ng , Fangyuan Lei , Yikuan Zhang , Zhengmin Li

Graph Neural Networks (GNNs) have demonstrated commendable performance for graph-structured data. Yet, GNNs are often vulnerable to adversarial structural attacks as embedding generation relies on graph topology. Existing efforts are…

Machine Learning · Computer Science 2024-09-04 Xing Ai , Guanyu Zhu , Yulin Zhu , Yu Zheng , Gaolei Li , Jianhua Li , Kai Zhou

Graph Neural Networks (GNNs) unlock new ways of learning from graph-structured data, proving highly effective in capturing complex relationships and patterns. Federated GNNs (FGNNs) have emerged as a prominent distributed learning paradigm…

Machine Learning · Computer Science 2026-01-23 Xiuling Wang , Xin Huang , Haibo Hu , Jianliang Xu

\textit{Graph Neural Network} (GNN) is a promising approach for analyzing graph-structured data that tactfully captures their dependency information via node-level message passing. It has achieved state-of-the-art performances in many…

Machine Learning · Computer Science 2021-05-05 Feng Shi , Ahren Yiqiao Jin , Song-Chun Zhu

Graph Neural Networks (GNNs) have enjoyed wide spread applications in graph-structured data. However, existing graph based applications commonly lack annotated data. GNNs are required to learn latent patterns from a limited amount of…

Machine Learning · Computer Science 2023-03-22 Wenqi Wei , Mu Qiao , Divyesh Jadav

The Graph Neural Network (GNN) has been widely used for graph data representation. However, the existing researches only consider the ideal balanced dataset, and the imbalanced dataset is rarely considered. Traditional methods such as…

Machine Learning · Computer Science 2022-05-10 S. Shi , Kai Qiao , Shuai Yang , L. Wang , J. Chen , Bin Yan

Biological spiking neurons with intrinsic dynamics underlie the powerful representation and learning capabilities of the brain for processing multimodal information in complex environments. Despite recent tremendous progress in spiking…

Neural and Evolutionary Computing · Computer Science 2021-07-15 Mingkun Xu , Yujie Wu , Lei Deng , Faqiang Liu , Guoqi Li , Jing Pei

Presently with technology node scaling, an accurate prediction model at early design stages can significantly reduce the design cycle. Especially during logic synthesis, predicting cell congestion due to improper logic combination can…

Machine Learning · Computer Science 2021-11-12 Amur Ghose , Vincent Zhang , Yingxue Zhang , Dong Li , Wulong Liu , Mark Coates

Graph Neural Networks (GNNs) are models that leverage the graph structure to transmit information between nodes, typically through the message-passing operation. While widely successful, this approach is well known to suffer from the…

Spatial Message Passing Graph Neural Networks (MPGNNs) are widely used for learning on graph-structured data. However, key limitations of l-step MPGNNs are that their "receptive field" is typically limited to the l-hop neighborhood of a…

Machine Learning · Computer Science 2024-06-04 Simon Geisler , Arthur Kosmala , Daniel Herbst , Stephan Günnemann

Graph neural networks (GNNs) have been applied into a variety of graph tasks. Most existing work of GNNs is based on the assumption that the given graph data is optimal, while it is inevitable that there exists missing or incomplete edges…

Machine Learning · Computer Science 2022-05-13 Qianggang Ding , Deheng Ye , Tingyang Xu , Peilin Zhao

Graph Neural Networks (GNNs) have demonstrated significant achievements in processing graph data, yet scalability remains a substantial challenge. To address this, numerous graph coarsening methods have been developed. However, most…

Machine Learning · Computer Science 2024-12-19 Shuyin Xia , Xinjun Ma , Zhiyuan Liu , Cheng Liu , Sen Zhao , Guoyin Wang

Graph Neural Networks (GNNs) often suffer from performance degradation as the network depth increases. This paper addresses this issue by introducing initialization methods that enhance signal propagation (SP) within GNNs. We propose three…

Machine Learning · Computer Science 2025-07-16 Senmiao Wang , Yupeng Chen , Yushun Zhang , Ruoyu Sun , Tian Ding