English
Related papers

Related papers: Accelerating Backward Aggregation in GCN Training …

200 papers

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art deep learning model for representation learning on graphs. It is challenging to accelerate training of GCNs, due to (1) substantial and irregular data communication to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-09 Hanqing Zeng , Viktor Prasanna

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art graph learning model. However, it can be notoriously challenging to inference GCNs over large graph datasets, limiting their application to large real-world graphs and…

Hardware Architecture · Computer Science 2025-03-11 Haoran You , Tong Geng , Yongan Zhang , Ang Li , Yingyan Celine Lin

Graph convolutional networks (GCNs) have been employed as a kind of significant tool on many graph-based applications recently. Inspired by convolutional neural networks (CNNs), GCNs generate the embeddings of nodes by aggregating the…

Machine Learning · Computer Science 2020-11-20 Tao Huang , Yihan Zhang , Jiajing Wu , Junyuan Fang , Zibin Zheng

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art method for graph-based learning tasks. However, training GCNs at scale is still challenging, hindering both the exploration of more sophisticated GCN architectures and…

Machine Learning · Computer Science 2022-03-29 Cheng Wan , Youjie Li , Ang Li , Nam Sung Kim , Yingyan Lin

Graph Convolutional Networks (GCNs), particularly for large-scale graphs, are crucial across numerous domains. However, training distributed full-batch GCNs on large-scale graphs suffers from inefficient memory access patterns and high…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-27 Chen Zhuang , Lingqi Zhang , Du Wu , Peng Chen , Jiajun Huang , Xin Liu , Rio Yokota , Nikoli Dryden , Toshio Endo , Satoshi Matsuoka , Mohamed Wahib

Graph Convolutional Networks (GCNs) are pivotal in extracting latent information from graph data across various domains, yet their acceleration on mainstream GPUs is challenged by workload imbalance and memory access irregularity. To…

Hardware Architecture · Computer Science 2023-08-24 Xi Xie , Hongwu Peng , Amit Hasan , Shaoyi Huang , Jiahui Zhao , Haowen Fang , Wei Zhang , Tong Geng , Omer Khan , Caiwen Ding

Graph Convolutional Networks (GCNs) are increasingly adopted in large-scale graph-based recommender systems. Training GCN requires the minibatch generator traversing graphs and sampling the sparsely located neighboring nodes to obtain their…

Machine Learning · Computer Science 2021-08-17 Seung Won Min , Kun Wu , Sitao Huang , Mert Hidayetoğlu , Jinjun Xiong , Eiman Ebrahimi , Deming Chen , Wen-mei Hwu

The Graph Convolutional Network (GCN) model and its variants are powerful graph embedding tools for facilitating classification and clustering on graphs. However, a major challenge is to reduce the complexity of layered GCNs and make them…

Machine Learning · Computer Science 2020-08-06 Hanqing Zeng , Hongkuan Zhou , Ajitesh Srivastava , Rajgopal Kannan , Viktor Prasanna

Graph Convolutional Networks (GCNs) are extensively utilized for deep learning on graphs. The large data sizes of graphs and their vertex features make scalable training algorithms and distributed memory systems necessary. Since the…

Machine Learning · Computer Science 2022-12-14 Gunduz Vehbi Demirci , Aparajita Haldar , Hakan Ferhatosmanoglu

We propose an adaptive graph coarsening method to jointly learn graph neural network (GNN) parameters and merge nodes via K-means clustering during training. As real-world graphs grow larger, processing them directly becomes increasingly…

Machine Learning · Computer Science 2025-10-01 Rostyslav Olshevskyi , Madeline Navarro , Santiago Segarra

Graph Convolutional Networks (GCNs) is the state-of-the-art method for learning graph-structured data, and training large-scale GCNs requires distributed training across multiple accelerators such that each accelerator is able to hold a…

Machine Learning · Computer Science 2022-03-22 Cheng Wan , Youjie Li , Cameron R. Wolfe , Anastasios Kyrillidis , Nam Sung Kim , Yingyan Lin

The performance limit of Graph Convolutional Networks (GCNs) and the fact that we cannot stack more of them to increase the performance, which we usually do for other deep learning paradigms, are pervasively thought to be caused by the…

Machine Learning · Computer Science 2023-11-07 Sitao Luan , Mingde Zhao , Xiao-Wen Chang , Doina Precup

In recent years, Graph Convolutional Networks (GCNs) have achieved great success in learning from graph-structured data. With the growing tendency of graph nodes and edges, GCN training by single processor cannot meet the demand for time…

Machine Learning · Computer Science 2021-10-08 Taige Zhao , Xiangyu Song , Jianxin Li , Wei Luo , Imran Razzak

Graph convolutional networks (GCNs) are becoming increasingly popular as they overcome the limited applicability of prior neural networks. A GCN takes as input an arbitrarily structured graph and executes a series of layers which exploit…

Machine Learning · Computer Science 2023-01-26 Mingi Yoo , Jaeyong Song , Jounghoo Lee , Namhyung Kim , Youngsok Kim , Jinho Lee

Full batch training of Graph Convolutional Network (GCN) models is not feasible on a single GPU for large graphs containing tens of millions of vertices or more. Recent work has shown that, for the graphs used in the machine learning…

Machine Learning · Computer Science 2021-10-19 Muhammed Fatih Balın , Kaan Sancak , Ümit V. Çatalyürek

As the emerging trend of graph-based deep learning, Graph Neural Networks (GNNs) excel for their capability to generate high-quality node feature vectors (embeddings). However, the existing one-size-fits-all GNN implementations are…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-22 Yuke Wang , Boyuan Feng , Gushu Li , Shuangchen Li , Lei Deng , Yuan Xie , Yufei Ding

Deep learning systems have been successfully applied to Euclidean data such as images, video, and audio. In many applications, however, information and their relationships are better expressed with graphs. Graph Convolutional Networks…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-14 Tong Geng , Ang Li , Runbin Shi , Chunshu Wu , Tianqi Wang , Yanfei Li , Pouya Haghi , Antonino Tumeo , Shuai Che , Steve Reinhardt , Martin Herbordt

Graph convolutional networks (GCNs) have demonstrated superiority in graph-based learning tasks. However, training GCNs on full graphs is particularly challenging, due to the following two challenges: (1) the associated feature tensors can…

Machine Learning · Computer Science 2025-02-26 Cheng Wan , Runkai Tao , Zheng Du , Yang Katie Zhao , Yingyan Celine Lin

Graph Neural Networks (GNNs) are a powerful tool for handling structured graph data and addressing tasks such as node classification, graph classification, and clustering. However, the sparse nature of GNN computation poses new challenges…

Machine Learning · Computer Science 2023-08-24 Julia Bazinska , Andrei Ivanov , Tal Ben-Nun , Nikoli Dryden , Maciej Besta , Siyuan Shen , Torsten Hoefler

In this paper, we aim at improving the computational efficiency of graph convolutional networks (GCNs) for learning on point clouds. The basic graph convolution that is typically composed of a $K$-nearest neighbor (KNN) search and a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Yawei Li , He Chen , Zhaopeng Cui , Radu Timofte , Marc Pollefeys , Gregory Chirikjian , Luc Van Gool
‹ Prev 1 2 3 10 Next ›