中文
相关论文

相关论文: CDFGNN: a Systematic Design of Cache-based Distrib…

200 篇论文

Methods for training models on graphs distributed across multiple clients have recently grown in popularity, due to the size of these graphs as well as regulations on keeping data where it is generated. However, the cross-client edges…

机器学习 · 计算机科学 2023-12-19 Yuhang Yao , Weizhao Jin , Srivatsan Ravi , Carlee Joe-Wong

Unsupervised graph representation learning aims to learn low-dimensional node embeddings without supervision while preserving graph topological structures and node attributive features. Previous graph neural networks (GNN) require a large…

机器学习 · 计算机科学 2020-09-04 Yanqiao Zhu , Yichen Xu , Feng Yu , Shu Wu , Liang Wang

Graph neural networks (GNNs) have been demonstrated to be a powerful algorithmic model in broad application fields for their effectiveness in learning over graphs. To scale GNN training up for large-scale and ever-growing graphs, the most…

分布式、并行与集群计算 · 计算机科学 2023-11-30 Haiyang Lin , Mingyu Yan , Xiaochun Ye , Dongrui Fan , Shirui Pan , Wenguang Chen , Yuan Xie

Graph neural networks (GNNs) are a type of deep learning models that are trained on graphs and have been successfully applied in various domains. Despite the effectiveness of GNNs, it is still challenging for GNNs to efficiently scale to…

机器学习 · 计算机科学 2023-08-28 Yingxia Shao , Hongzheng Li , Xizhi Gu , Hongbo Yin , Yawen Li , Xupeng Miao , Wentao Zhang , Bin Cui , Lei Chen

Graph neural networks (GNNs) are powerful tools for learning from graph data and are widely used in various applications such as social network recommendation, fraud detection, and graph search. The graphs in these applications are…

机器学习 · 计算机科学 2021-06-14 Jialin Dong , Da Zheng , Lin F. Yang , Geroge Karypis

Graph Neural Networks (GNN) are indispensable in learning from graph-structured data, yet their rising computational costs, especially on massively connected graphs, pose significant challenges in terms of execution performance. To tackle…

分布式、并行与集群计算 · 计算机科学 2024-11-05 Aishwarya Sarkar , Sayan Ghosh , Nathan R. Tallent , Ali Jannesari

In recent years, Graph Convolutional Networks (GCNs) have achieved great success in learning from graph-structured data. With the growing tendency of graph nodes and edges, GCN training by single processor cannot meet the demand for time…

机器学习 · 计算机科学 2021-10-08 Taige Zhao , Xiangyu Song , Jianxin Li , Wei Luo , Imran Razzak

The aim of this work is to develop a fully-distributed algorithmic framework for training graph convolutional networks (GCNs). The proposed method is able to exploit the meaningful relational structure of the input data, which are collected…

机器学习 · 计算机科学 2022-12-21 Simone Scardapane , Indro Spinelli , Paolo Di Lorenzo

Graph neural networks (GNNs) are powerful tools for developing scalable, decentralized artificial intelligence in large-scale networked systems, such as wireless networks, power grids, and transportation networks. Currently, GNNs in…

机器学习 · 计算机科学 2024-12-10 Rostyslav Olshevskyi , Zhongyuan Zhao , Kevin Chan , Gunjan Verma , Ananthram Swami , Santiago Segarra

Full-graph and mini-batch Graph Neural Network (GNN) training approaches have distinct system design demands, making it crucial to choose the appropriate approach to develop. A core challenge in comparing these two GNN training approaches…

机器学习 · 计算机科学 2026-05-19 Mengfan Liu , Da Zheng , Junwei Su , Chuan Wu

Despite the recent success of Graph Neural Networks, it remains challenging to train a GNN on large graphs with millions of nodes and billions of edges, which are prevalent in many graph-based applications. Traditional sampling-based…

机器学习 · 计算机科学 2022-10-04 Zheng Chai , Guangji Bai , Liang Zhao , Yue Cheng

Graph neural networks (GNN) have shown great success in learning from graph-structured data. They are widely used in various applications, such as recommendation, fraud detection, and search. In these domains, the graphs are typically…

机器学习 · 计算机科学 2021-08-04 Da Zheng , Chao Ma , Minjie Wang , Jinjing Zhou , Qidong Su , Xiang Song , Quan Gan , Zheng Zhang , George Karypis

Graph-based computations are crucial in a wide range of applications, where graphs can scale to trillions of edges. To enable efficient training on such large graphs, mini-batch subgraph sampling is commonly used, which allows training…

机器学习 · 计算机科学 2025-04-04 Yue Jin , Yongchao Liu , Chuntao Hong

Graph Convolutional Networks (GCNs) is the state-of-the-art method for learning graph-structured data, and training large-scale GCNs requires distributed training across multiple accelerators such that each accelerator is able to hold a…

机器学习 · 计算机科学 2022-03-22 Cheng Wan , Youjie Li , Cameron R. Wolfe , Anastasios Kyrillidis , Nam Sung Kim , Yingyan Lin

Graph neural networks (GNNs) are widely used for learning on graph datasets derived from various real-world scenarios. Learning from extremely large graphs requires distributed training, and mini-batching with sampling is a popular approach…

Despite the recent success of Graph Neural Networks (GNNs), training GNNs on large graphs remains challenging. The limited resource capacities of the existing servers, the dependency between nodes in a graph, and the privacy concern due to…

机器学习 · 计算机科学 2022-03-15 Morteza Ramezani , Weilin Cong , Mehrdad Mahdavi , Mahmut T. Kandemir , Anand Sivasubramaniam

Distributed full-graph training of Graph Neural Networks (GNNs) over large graphs is bandwidth-demanding and time-consuming. Frequent exchanges of node features, embeddings and embedding gradients (all referred to as messages) across…

机器学习 · 计算机科学 2023-06-05 Borui Wan , Juntao Zhao , Chuan Wu

Graph neural networks (GNNs) achieve strong performance on relational data, but real-world graphs are often distributed across organizations that cannot share raw data due to privacy and policy constraints. Existing federated GNN methods…

机器学习 · 计算机科学 2026-05-27 Zhishuai Guo , Wenhan Wu , Chen Chen , Lei Zhang , Olivera Kotevska , Ravi K Madduri

Dynamic Graph Neural Network (DGNN) has shown a strong capability of learning dynamic graphs by exploiting both spatial and temporal features. Although DGNN has recently received considerable attention by AI community and various DGNN…

分布式、并行与集群计算 · 计算机科学 2023-09-08 Fahao Chen , Peng Li , Celimuge Wu

Training Graph Convolutional Networks (GCNs) is expensive as it needs to aggregate data recursively from neighboring nodes. To reduce the computation overhead, previous works have proposed various neighbor sampling methods that estimate the…

机器学习 · 计算机科学 2021-01-20 Peng Jiang , Masuma Akter Rumi