中文
相关论文

相关论文: Dorylus: Affordable, Scalable, and Accurate GNN Tr…

200 篇论文

Training Graph Neural Networks(GNNs) on a large monolithic graph presents unique challenges as the graph cannot fit within a single machine and it cannot be decomposed into smaller disconnected components. Distributed sampling-based…

分布式、并行与集群计算 · 计算机科学 2023-11-30 Hesham Mostafa , Adam Grabowski , Md Asadullah Turja , Juan Cervino , Alejandro Ribeiro , Nageen Himayat

The training process of Deep Neural Network (DNN) is compute-intensive, often taking days to weeks to train a DNN model. Therefore, parallel execution of DNN training on GPUs is a widely adopted approach to speed up the process nowadays.…

分布式、并行与集群计算 · 计算机科学 2019-10-29 Chi-Chung Chen , Chia-Lin Yang , Hsiang-Yun Cheng

Graph Neural Networks (GNNs) are an emerging research field. This specialized Deep Neural Network (DNN) architecture is capable of processing graph structured data and bridges the gap between graph processing and Deep Learning (DL). As…

分布式、并行与集群计算 · 计算机科学 2023-05-24 Jana Vatter , Ruben Mayer , Hans-Arno Jacobsen

Deep neural networks (DNNs) continue to grow rapidly in size, making them infeasible to train on a single device. Pipeline parallelism is commonly used in existing DNN systems to support large-scale DNN training by partitioning a DNN into…

Graph classification is a challenging problem owing to the difficulty in quantifying the similarity between graphs or representing graphs as vectors, though there have been a few methods using graph kernels or graph neural networks (GNNs).…

机器学习 · 计算机科学 2024-08-22 Zixiao Wang , Jicong Fan

Graph neural networks (GNNs) are among the most powerful tools in deep learning. They routinely solve complex problems on unstructured networks, such as node classification, graph classification, or link prediction, with high accuracy.…

机器学习 · 计算机科学 2023-08-21 Maciej Besta , Torsten Hoefler

The deep neural networks (DNNs) have been enormously successful in tasks that were hitherto in the human-only realm such as image recognition, and language translation. Owing to their success the DNNs are being explored for use in ever more…

分布式、并行与集群计算 · 计算机科学 2019-06-20 Sanket Tavarageri , Srinivas Sridharan , Bharat Kaul

Graph neural networks (GNNs) process large-scale graphs consisting of a hundred billion edges. In contrast to traditional deep learning, unique behaviors of the emerging GNNs are engaged with a large set of graphs and embedding data on…

硬件体系结构 · 计算机科学 2022-01-25 Miryeong Kwon , Donghyun Gouk , Sangwon Lee , Myoungsoo Jung

Training graph neural networks on large datasets has long been a challenge. Traditional approaches include efficiently representing the whole graph in-memory, designing parameter efficient and sampling-based models, and graph partitioning…

机器学习 · 计算机科学 2024-11-19 Dmytro Lopushanskyy , Borun Shi

Graph Neural Networks (GNNs) have experienced rapid advancements in recent years due to their ability to learn meaningful representations from graph data structures. Federated Learning (FL) has emerged as a viable machine learning approach…

分布式、并行与集群计算 · 计算机科学 2025-06-17 Pranjal Naman , Yogesh Simmhan

Recently, Graph Neural Networks (GNNs) have been receiving a spotlight as a powerful tool that can effectively serve various inference tasks on graph structured data. As the size of real-world graphs continues to scale, the GNN training…

机器学习 · 计算机科学 2022-08-22 Yeonhong Park , Sunhong Min , Jae W. Lee

Graph Neural Networks (GNN) are indispensable in learning from graph-structured data, yet their rising computational costs, especially on massively connected graphs, pose significant challenges in terms of execution performance. To tackle…

分布式、并行与集群计算 · 计算机科学 2024-11-05 Aishwarya Sarkar , Sayan Ghosh , Nathan R. Tallent , Ali Jannesari

Graph neural networks (GNNs) fuel diverse machine learning tasks involving graph-structured data, ranging from predicting protein structures to serving personalized recommendations. Real-world graph data must often be stored distributed…

机器学习 · 计算机科学 2024-02-13 Aashish Kolluri , Sarthak Choudhary , Bryan Hooi , Prateek Saxena

We present BatchGNN, a distributed CPU system that showcases techniques that can be used to efficiently train GNNs on terabyte-sized graphs. It reduces communication overhead with macrobatching in which multiple minibatches' subgraph…

机器学习 · 计算机科学 2023-06-27 Loc Hoang , Rita Brugarolas Brufau , Ke Ding , Bo Wu

Graph neural networks (GNNs), which have emerged as an effective method for handling machine learning tasks on graphs, bring a new approach to building recommender systems, where the task of recommendation can be formulated as the link…

信息检索 · 计算机科学 2022-11-03 Yuwei Hu , Jiajie Li , Zhongming Yu , Zhiru Zhang

Graph neural networks (GNNs) are powerful tools for developing scalable, decentralized artificial intelligence in large-scale networked systems, such as wireless networks, power grids, and transportation networks. Currently, GNNs in…

机器学习 · 计算机科学 2024-12-10 Rostyslav Olshevskyi , Zhongyuan Zhao , Kevin Chan , Gunjan Verma , Ananthram Swami , Santiago Segarra

Graph Neural Networks (GNNs) present a fundamental hardware challenge by fusing irregular, memory-bound graph traversals with regular, compute-intensive dense matrix operations. While frameworks such as PyTorch Geometric (PyG) and Deep…

机器学习 · 计算机科学 2026-05-27 Anubhab , Rupesh Nasre

With the ever-growing popularity of Graph Neural Networks (GNNs), efficient GNN inference is gaining tremendous attention. Field-Programming Gate Arrays (FPGAs) are a promising execution platform due to their fine-grained parallelism,…

机器学习 · 计算机科学 2023-09-29 Chenfeng Zhao , Zehao Dong , Yixin Chen , Xuan Zhang , Roger D. Chamberlain

Graph Convolutional Network (GCN) has been widely used in graph learning tasks. However, GCN-based models (GCNs) is an inherently coupled training framework repetitively conducting the complex neighboring aggregation, which leads to the…

机器学习 · 计算机科学 2020-07-23 Dalong Yang , Chuan Chen , Youhao Zheng , Zibin Zheng , Shih-wei Liao

Graph Neural Networks (GNN) show great promise in problems dealing with graph-structured data. One of the unique points of GNNs is their flexibility to adapt to multiple problems, which not only leads to wide applicability, but also poses…

机器学习 · 计算机科学 2022-06-17 Axel Wassington , Sergi Abadal