中文
相关论文

相关论文: Dorylus: Affordable, Scalable, and Accurate GNN Tr…

200 篇论文

Despite the recent success of Graph Neural Networks (GNNs), training GNNs on large graphs remains challenging. The limited resource capacities of the existing servers, the dependency between nodes in a graph, and the privacy concern due to…

机器学习 · 计算机科学 2022-03-15 Morteza Ramezani , Weilin Cong , Mehrdad Mahdavi , Mahmut T. Kandemir , Anand Sivasubramaniam

Full-graph training on graph neural networks (GNN) has emerged as a promising training method for its effectiveness. Full-graph training requires extensive memory and computation resources. To accelerate this training process, researchers…

分布式、并行与集群计算 · 计算机科学 2023-11-28 Qiange Wang , Yao Chen , Weng-Fai Wong , Bingsheng He

Recently, graph neural networks (GNNs) have gained much attention as a growing area of deep learning capable of learning on graph-structured data. However, the computational and memory requirements for training GNNs on large-scale graphs…

分布式、并行与集群计算 · 计算机科学 2024-08-13 Nikolai Merkel , Daniel Stoll , Ruben Mayer , Hans-Arno Jacobsen

Graph Neural Networks (GNNs) are proficient in graph representation learning and achieve promising performance on versatile tasks such as node classification and link prediction. Usually, a comprehensive hyperparameter tuning is essential…

机器学习 · 计算机科学 2024-10-10 Lequan Lin , Dai Shi , Andi Han , Zhiyong Wang , Junbin Gao

Graph Neural Networks (GNNs) are deep-learning architectures designed for graph-type data, where understanding relationships among individual observations is crucial. However, achieving promising GNN performance, especially on unseen data,…

机器学习 · 计算机科学 2024-05-22 Lequan Lin , Dai Shi , Andi Han , Zhiyong Wang , Junbin Gao

Graph Neural Networks (GNNs) are the first choice methods for graph machine learning problems thanks to their ability to learn state-of-the-art level representations from graph-structured data. However, centralizing a massive amount of…

机器学习 · 计算机科学 2021-06-08 Chaoyang He , Emir Ceyani , Keshav Balasubramanian , Murali Annavaram , Salman Avestimehr

Graph neural networks (GNNs) are a type of deep learning models that are trained on graphs and have been successfully applied in various domains. Despite the effectiveness of GNNs, it is still challenging for GNNs to efficiently scale to…

机器学习 · 计算机科学 2023-08-28 Yingxia Shao , Hongzheng Li , Xizhi Gu , Hongbo Yin , Yawen Li , Xupeng Miao , Wentao Zhang , Bin Cui , Lei Chen

Graph neural networks (GNNs) have been demonstrated as a powerful tool for analyzing non-Euclidean graph data. However, the lack of efficient distributed graph learning systems severely hinders applications of GNNs, especially when graphs…

Dynamic Graph Neural Network (DGNN) has shown a strong capability of learning dynamic graphs by exploiting both spatial and temporal features. Although DGNN has recently received considerable attention by AI community and various DGNN…

分布式、并行与集群计算 · 计算机科学 2023-09-08 Fahao Chen , Peng Li , Celimuge Wu

Graph neural networks (GNNs), an emerging class of machine learning models for graphs, have gained popularity for their superior performance in various graph analytical tasks. Mini-batch training is commonly used to train GNNs on large…

分布式、并行与集群计算 · 计算机科学 2025-12-15 Sandeep Polisetty , Juelin Liu , Kobi Falus , Yi Ren Fung , Seung-Hwan Lim , Hui Guan , Marco Serafini

Graph neural networks (GNNs) have emerged as a promising direction. Training large-scale graphs that relies on distributed computing power poses new challenges. Existing distributed GNN systems leverage data parallelism by partitioning the…

分布式、并行与集群计算 · 计算机科学 2024-12-31 Xin Ai , Hao Yuan , Zeyu Ling , Qiange Wang , Yanfeng Zhang , Zhenbo Fu , Chaoyi Chen , Yu Gu , Ge Yu

Graph Neural Networks (GNNs) are a new and increasingly popular family of deep neural network architectures to perform learning on graphs. Training them efficiently is challenging due to the irregular nature of graph data. The problem…

机器学习 · 计算机科学 2021-06-15 Marco Serafini , Hui Guan

Graph neural networks (GNNs) are powerful tools for solving graph-related problems. Distributed GNN frameworks and systems enhance the scalability of GNNs and accelerate model training, yet most are optimized for node classification. Their…

机器学习 · 计算机科学 2025-06-27 Xin Huang , Chul-Ho Lee

Graph Neural Networks (GNNs) have become powerful tools for learning from graph-structured data, finding applications across diverse domains. However, as graph sizes and connectivity increase, standard GNN training methods face significant…

机器学习 · 计算机科学 2025-12-01 Eshed Gal , Moshe Eliasof , Carola-Bibiane Schönlieb , Ivan I. Kyrchei , Eldad Haber , Eran Treister

Graph Convolutional Neural Network (GCNN) is a popular class of deep learning (DL) models in material science to predict material properties from the graph representation of molecular structures. Training an accurate and comprehensive GCNN…

机器学习 · 计算机科学 2022-07-26 Jong Youl Choi , Pei Zhang , Kshitij Mehta , Andrew Blanchard , Massimiliano Lupo Pasini

Graph neural networks (GNNs) have been demonstrated to be a powerful algorithmic model in broad application fields for their effectiveness in learning over graphs. To scale GNN training up for large-scale and ever-growing graphs, the most…

分布式、并行与集群计算 · 计算机科学 2023-11-30 Haiyang Lin , Mingyu Yan , Xiaochun Ye , Dongrui Fan , Shirui Pan , Wenguang Chen , Yuan Xie

Graph Neural Networks (GNNs) have been widely adopted due to their strong performance. However, GNN training often relies on expensive, high-performance computing platforms, limiting accessibility for many tasks. Profiling of representative…

分布式、并行与集群计算 · 计算机科学 2025-11-12 Tong Qiao , Ao Zhou , Yingjie Qi , Yiou Wang , Han Wan , Jianlei Yang , Chunming Hu

Communication is a key bottleneck for distributed graph neural network (GNN) training. This paper proposes GNNPipe, a new approach that scales the distributed full-graph deep GNN training. Being the first to use layer-level model…

分布式、并行与集群计算 · 计算机科学 2023-09-26 Jingji Chen , Zhuoming Chen , Xuehai Qian

Graph Neural Networks (GNNs) have made significant advances on several fundamental inference tasks. As a result, there is a surge of interest in using these models for making potentially important decisions in high-regret applications.…

机器学习 · 计算机科学 2020-02-26 Kaidi Xu , Sijia Liu , Pin-Yu Chen , Mengshu Sun , Caiwen Ding , Bhavya Kailkhura , Xue Lin

Graph-structured data is ubiquitous in the real world, and Graph Neural Networks (GNNs) have become increasingly popular in various fields due to their ability to process such irregular data directly. However, as data scale, GNNs become…

分布式、并行与集群计算 · 计算机科学 2026-02-10 Xianfeng Song , Yi Zou , Zheng Shi