中文
相关论文

相关论文: Accelerating Backward Aggregation in GCN Training …

200 篇论文

Convolutional neural network (CNN) is an important deep learning method. The convolution operation takes a large proportion of the total execution time for CNN. Feature maps for convolution operation are usually sparse. Multiplications and…

分布式、并行与集群计算 · 计算机科学 2023-08-01 Weizhi Xu , Yintai Sun , fhengyu Fan , Hui Yu , Xin Fu

Graph Neural Networks (GNNs) have gained significant momentum recently due to their capability to learn on unstructured graph data. Dynamic GNNs (DGNNs) are the current state-of-the-art for point cloud applications; such applications (viz.…

分布式、并行与集群计算 · 计算机科学 2023-09-19 Dhruv Parikh , Bingyi Zhang , Rajgopal Kannan , Viktor Prasanna , Carl Busart

Graph Neural Networks (GNNs) have shown great superiority on non-Euclidean graph data, achieving ground-breaking performance on various graph-related tasks. As a practical solution to train GNN on large graphs with billions of nodes and…

机器学习 · 计算机科学 2024-09-24 Zeyu Zhu , Peisong Wang , Qinghao Hu , Gang Li , Xiaoyao Liang , Jian Cheng

Graph Neural Networks (GNNs) succeed significantly in many applications recently. However, balancing GNNs training runtime cost, memory consumption, and attainable accuracy for various applications is non-trivial. Previous training…

机器学习 · 计算机科学 2024-04-16 Tong Qiao , Jianlei Yang , Yingjie Qi , Ao Zhou , Chen Bai , Bei Yu , Weisheng Zhao , Chunming Hu

Recently, graph neural networks (GNNs) have gained much attention as a growing area of deep learning capable of learning on graph-structured data. However, the computational and memory requirements for training GNNs on large-scale graphs…

分布式、并行与集群计算 · 计算机科学 2024-08-13 Nikolai Merkel , Daniel Stoll , Ruben Mayer , Hans-Arno Jacobsen

Graph data are pervasive in many real-world applications. Recently, increasing attention has been paid on graph neural networks (GNNs), which aim to model the local graph structures and capture the hierarchical patterns by aggregating the…

机器学习 · 计算机科学 2020-06-29 Kwei-Herng Lai , Daochen Zha , Kaixiong Zhou , Xia Hu

Graph convolutional neural networks (GCNNs) have been attracting increasing research attention due to its great potential in inference over graph structures. However, insufficient effort has been devoted to the aggregation methods between…

机器学习 · 计算机科学 2019-05-15 Penghui Sun , Jingwei Qu , Xiaoqing Lyu , Haibin Ling , Zhi Tang

Graph Neural Networks (graph NNs) are a promising deep learning approach for analyzing graph-structured data. However, it is known that they do not improve (or sometimes worsen) their predictive performance as we pile up many layers and add…

机器学习 · 计算机科学 2021-01-07 Kenta Oono , Taiji Suzuki

Graph Convolution Network (GCN) has become new state-of-the-art for collaborative filtering. Nevertheless, the reasons of its effectiveness for recommendation are not well understood. Existing work that adapts GCN to recommendation lacks…

信息检索 · 计算机科学 2020-07-08 Xiangnan He , Kuan Deng , Xiang Wang , Yan Li , Yongdong Zhang , Meng Wang

Graph Convolutional Network (GCN) has experienced great success in graph analysis tasks. It works by smoothing the node features across the graph. The current GCN models overwhelmingly assume that the node feature information is complete.…

机器学习 · 计算机科学 2020-12-08 Hibiki Taguchi , Xin Liu , Tsuyoshi Murata

The recent rapid growth in mobile data traffic entails a pressing demand for improving the throughput of the underlying wireless communication networks. Network node deployment has been considered as an effective approach for throughput…

网络与互联网体系结构 · 计算机科学 2022-09-16 Yifei Yang , Dongmian Zou , Xiaofan He

Graph Convolutional Networks (GCNs) are powerful for processing graph-structured data and have achieved state-of-the-art performance in several tasks such as node classification, link prediction, and graph classification. However, it is…

机器学习 · 计算机科学 2021-10-19 Langzhang Liang , Cuiyun Gao , Shiyi Chen , Shishi Duan , Yu pan , Junjin Zheng , Lei Wang , Zenglin Xu

Training a Graph Neural Network (GNN) model on large-scale graphs involves a high volume of data communication and computations. While state-of-the-art CPUs and GPUs feature high computing power, the Standard GNN training protocol adopted…

分布式、并行与集群计算 · 计算机科学 2024-03-28 Yi-Chien Lin , Gangda Deng , Viktor Prasanna

As graphs grow larger, full-batch GNN training becomes hard for single GPU memory. Therefore, to enhance the scalability of GNN training, some studies have proposed sampling-based mini-batch training and distributed graph learning. However,…

机器学习 · 计算机科学 2024-08-22 Zhengjia Xu , Dingyang Lyu , Jinghui Zhang

With the recent success of graph convolutional networks (GCNs), they have been widely applied for recommendation, and achieved impressive performance gains. The core of GCNs lies in its message passing mechanism to aggregate neighborhood…

信息检索 · 计算机科学 2023-12-01 Kelong Mao , Jieming Zhu , Xi Xiao , Biao Lu , Zhaowei Wang , Xiuqiang He

Graph Neural Networks (GNN) have emerged as a popular and standard approach for learning from graph-structured data. The literature on GNN highlights the potential of this evolving research area and its widespread adoption in real-life…

机器学习 · 计算机科学 2024-03-25 Sukhdeep Singh , Anuj Sharma , Vinod Kumar Chauhan

Graph transformer networks (GTN) are a variant of graph convolutional networks (GCN) that are targeted to heterogeneous graphs in which nodes and edges have associated type information that can be exploited to improve inference accuracy.…

人工智能 · 计算机科学 2021-06-17 Loc Hoang , Udit Agarwal , Gurbinder Gill , Roshan Dathathri , Abhik Seal , Brian Martin , Keshav Pingali

Graph neural networks (GNNs) are designed to process data associated with graphs. They are finding an increasing range of applications; however, as with other modern machine learning techniques, their theoretical understanding is limited.…

无序系统与神经网络 · 物理学 2026-02-23 O. Duranthon , L. Zdeborová

Graph neural networks (GNN) analysis engines are vital for real-world problems that use large graph models. Challenges for a GNN hardware platform include the ability to (a) host a variety of GNNs, (b) handle high sparsity in input vertex…

硬件体系结构 · 计算机科学 2021-08-10 Sudipta Mondal , Susmita Dey Manasi , Kishor Kunal , S. Ramprasath , Sachin S. Sapatnekar

Deep graph neural networks (GNNs) have achieved excellent results on various tasks on increasingly large graph datasets with millions of nodes and edges. However, memory complexity has become a major obstacle when training deep GNNs for…

机器学习 · 计算机科学 2022-04-12 Guohao Li , Matthias Müller , Bernard Ghanem , Vladlen Koltun