English
Related papers

Related papers: Multi-node Acceleration for Large-scale GCNs

200 papers

Graph Convolutional Networks (GCNs) are widely used in graph-based applications, such as social networks and recommendation systems. Nevertheless, large-scale graphs or deep aggregation layers in full-batch GCNs consume significant GPU…

Machine Learning · Computer Science 2024-10-15 Shengwei Ji , Yujie Tian , Fei Liu , Xinlu Li , Le Wu

Graph neural networks (GNNs) are one of the rapidly growing fields within deep learning. While many distributed GNN training frameworks have been proposed to increase the training throughput, they face three limitations when applied to…

Machine Learning · Computer Science 2024-08-14 Jaeyong Song , Hongsun Jang , Jaewon Jung , Youngsok Kim , Jinho Lee

Graph convolutional network (GCN), an emerging algorithm for graph computing, has achieved promising performance in graphstructure tasks. To achieve acceleration for data-intensive and sparse graph computing, ASICs such as GCNAX have been…

The increasing application of deep learning technology drives the need for an efficient parallel computing architecture for Convolutional Neural Networks (CNNs). A significant challenge faced when designing a many-core CNN accelerator is to…

Machine Learning · Computer Science 2021-08-06 Binayak Tiwari , Mei Yang , Xiaohang Wang , Yingtao Jiang , Venkatesan Muthukumar

As graphs grow larger, full-batch GNN training becomes hard for single GPU memory. Therefore, to enhance the scalability of GNN training, some studies have proposed sampling-based mini-batch training and distributed graph learning. However,…

Machine Learning · Computer Science 2024-08-22 Zhengjia Xu , Dingyang Lyu , Jinghui Zhang

The current success of Graph Neural Networks (GNNs) usually relies on loading the entire attributed graph for processing, which may not be satisfied with limited memory resources, especially when the attributed graph is large. This paper…

Machine Learning · Computer Science 2022-10-25 Junfu Wang , Yuanfang Guo , Liang Yang , Yunhong Wang

Deep learning systems have been successfully applied to Euclidean data such as images, video, and audio. In many applications, however, information and their relationships are better expressed with graphs. Graph Convolutional Networks…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-14 Tong Geng , Ang Li , Runbin Shi , Chunshu Wu , Tianqi Wang , Yanfei Li , Pouya Haghi , Antonino Tumeo , Shuai Che , Steve Reinhardt , Martin Herbordt

Graph convolutional network (GCN) based approaches have achieved significant progress for solving complex, graph-structured problems. GCNs incorporate the graph structure information and the node (or edge) features through message passing…

Machine Learning · Computer Science 2021-05-04 Saurav Manchanda , Da Zheng , George Karypis

Graph Convolutional Networks (GCNs) have gained great popularity in tackling various analytics tasks on graph and network data. However, some recent studies raise concerns about whether GCNs can optimally integrate node features and…

Machine Learning · Computer Science 2020-07-14 Xiao Wang , Meiqi Zhu , Deyu Bo , Peng Cui , Chuan Shi , Jian Pei

Graph Neural Networks (GNNs) are powerful deep learning models to generate node embeddings on graphs. When applying deep GNNs on large graphs, it is still challenging to perform training in an efficient and scalable way. We propose a novel…

Machine Learning · Computer Science 2020-10-08 Hanqing Zeng , Hongkuan Zhou , Ajitesh Srivastava , Rajgopal Kannan , Viktor Prasanna

Graph neural networks (GNNs) have seen extensive application in domains such as social networks, bioinformatics, and recommendation systems. However, the irregularity and sparsity of graph data challenge traditional computing methods, which…

Machine Learning · Computer Science 2025-02-25 Ka Wai Wu

Graph Convolutional Networks (GCNs) are recently getting much attention in bioinformatics and chemoinformatics as a state-of-the-art machine learning approach with high accuracy. GCNs process convolutional operations along with graph…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-03-28 Yusuke Nagasaka , Akira Nukada , Ryosuke Kojima , Satoshi Matsuoka

Graph Neural Networks (GNNs) have achieved tremendous success in graph representation learning. Unfortunately, current GNNs usually rely on loading the entire attributed graph into network for processing. This implicit assumption may not be…

Machine Learning · Computer Science 2022-02-15 Junfu Wang , Yunhong Wang , Zhen Yang , Liang Yang , Yuanfang Guo

Graph neural networks (GNNs), which have emerged as an effective method for handling machine learning tasks on graphs, bring a new approach to building recommender systems, where the task of recommendation can be formulated as the link…

Information Retrieval · Computer Science 2022-11-03 Yuwei Hu , Jiajie Li , Zhongming Yu , Zhiru Zhang

Graph convolutional networks (GCNs) have emerged as a powerful alternative to multiple instance learning with convolutional neural networks in digital pathology, offering superior handling of structural information across various spatial…

Image and Video Processing · Electrical Eng. & Systems 2024-03-25 Victor Ibañez , Przemyslaw Szostak , Quincy Wong , Konstanty Korski , Samaneh Abbasi-Sureshjani , Alvaro Gomariz

Graph convolutional networks (GCNs) have shown remarkable learning capabilities when processing graph-structured data found inherently in many application areas. GCNs distribute the outputs of neural networks embedded in each vertex over…

Hardware Architecture · Computer Science 2022-05-18 Sumit K. Mandal , Gokul Krishnan , A. Alper Goksoy , Gopikrishnan Ravindran Nair , Yu Cao , Umit Y. Ogras

As the emerging trend of graph-based deep learning, Graph Neural Networks (GNNs) excel for their capability to generate high-quality node feature vectors (embeddings). However, the existing one-size-fits-all GNN implementations are…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-22 Yuke Wang , Boyuan Feng , Gushu Li , Shuangchen Li , Lei Deng , Yuan Xie , Yufei Ding

Graph embedding is an important approach for graph analysis tasks such as node classification and link prediction. The goal of graph embedding is to find a low dimensional representation of graph nodes that preserves the graph information.…

Machine Learning · Computer Science 2019-08-27 Mahsa Ghorbani , Mahdieh Soleymani Baghshah , Hamid R. Rabiee

Graph Convolutional Networks (GCNs) is the state-of-the-art method for learning graph-structured data, and training large-scale GCNs requires distributed training across multiple accelerators such that each accelerator is able to hold a…

Machine Learning · Computer Science 2022-03-22 Cheng Wan , Youjie Li , Cameron R. Wolfe , Anastasios Kyrillidis , Nam Sung Kim , Yingyan Lin

Graph Neural Networks (GNNs) have demonstrated effectiveness in various graph-based tasks. However, their inefficiency in training and inference presents challenges for scaling up to real-world and large-scale graph applications. To address…

Machine Learning · Computer Science 2024-05-08 Lu Ma , Zeang Sheng , Xunkai Li , Xinyi Gao , Zhezheng Hao , Ling Yang , Wentao Zhang , Bin Cui