English
Related papers

Related papers: Cluster-GCN: An Efficient Algorithm for Training D…

200 papers

Graph Convolutional Networks (GCNs) have drawn tremendous attention in the past three years. Compared with other deep learning modalities, high-performance hardware acceleration of GCNs is as critical but even more challenging. The hurdles…

Hardware Architecture · Computer Science 2022-03-08 Tong Geng , Chunshu Wu , Yongan Zhang , Cheng Tan , Chenhao Xie , Haoran You , Martin C. Herbordt , Yingyan Lin , Ang Li

While there have been many studies on hardware acceleration for deep learning on images, there has been a rather limited focus on accelerating deep learning applications involving graphs. The unique characteristics of graphs, such as the…

Machine Learning · Computer Science 2021-11-12 Atefeh Sohrabizadeh , Yuze Chi , Jason Cong

Graph Convolutional Networks (GCNs), particularly for large-scale graphs, are crucial across numerous domains. However, training distributed full-batch GCNs on large-scale graphs suffers from inefficient memory access patterns and high…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-27 Chen Zhuang , Lingqi Zhang , Du Wu , Peng Chen , Jiajun Huang , Xin Liu , Rio Yokota , Nikoli Dryden , Toshio Endo , Satoshi Matsuoka , Mohamed Wahib

Graph Convolution Networks (GCNs) have significantly succeeded in learning user and item representations for recommendation systems. The core of their efficacy is the ability to explicitly exploit the collaborative signals from both the…

Information Retrieval · Computer Science 2024-11-11 Fan Liu , Shuai Zhao , Zhiyong Cheng , Liqiang Nie , Mohan Kankanhalli

The graph convolutional networks (GCN) recently proposed by Kipf and Welling are an effective graph model for semi-supervised learning. This model, however, was originally designed to be learned with the presence of both training and test…

Machine Learning · Computer Science 2018-02-01 Jie Chen , Tengfei Ma , Cao Xiao

Graph Convolutional Networks (GCNs) is the state-of-the-art method for learning graph-structured data, and training large-scale GCNs requires distributed training across multiple accelerators such that each accelerator is able to hold a…

Machine Learning · Computer Science 2022-03-22 Cheng Wan , Youjie Li , Cameron R. Wolfe , Anastasios Kyrillidis , Nam Sung Kim , Yingyan Lin

Graph neural networks (GNNs) have extended the success of deep neural networks (DNNs) to non-Euclidean graph data, achieving ground-breaking performance on various tasks such as node classification and graph property prediction.…

Machine Learning · Computer Science 2021-12-17 Tianfeng Liu , Yangrui Chen , Dan Li , Chuan Wu , Yibo Zhu , Jun He , Yanghua Peng , Hongzheng Chen , Hongzhi Chen , Chuanxiong Guo

As graphs grow larger, full-batch GNN training becomes hard for single GPU memory. Therefore, to enhance the scalability of GNN training, some studies have proposed sampling-based mini-batch training and distributed graph learning. However,…

Machine Learning · Computer Science 2024-08-22 Zhengjia Xu , Dingyang Lyu , Jinghui Zhang

Convolutional neural networks (CNNs) have achieved great success on grid-like data such as images, but face tremendous challenges in learning from more generic data such as graphs. In CNNs, the trainable local filters enable the automatic…

Machine Learning · Computer Science 2018-09-05 Hongyang Gao , Zhengyang Wang , Shuiwang Ji

The decoupled Graph Convolutional Network (GCN), a recent development of GCN that decouples the neighborhood aggregation and feature transformation in each convolutional layer, has shown promising performance for graph representation…

Machine Learning · Computer Science 2022-11-16 Jinsong Chen , Boyu Li , Kun He

Graph Convolutional Networks (GCNs) are increasingly adopted in large-scale graph-based recommender systems. Training GCN requires the minibatch generator traversing graphs and sampling the sparsely located neighboring nodes to obtain their…

Machine Learning · Computer Science 2021-08-17 Seung Won Min , Kun Wu , Sitao Huang , Mert Hidayetoğlu , Jinjun Xiong , Eiman Ebrahimi , Deming Chen , Wen-mei Hwu

Graph Convolutional Networks (GCNs) are pivotal in extracting latent information from graph data across various domains, yet their acceleration on mainstream GPUs is challenged by workload imbalance and memory access irregularity. To…

Hardware Architecture · Computer Science 2023-08-24 Xi Xie , Hongwu Peng , Amit Hasan , Shaoyi Huang , Jiahui Zhao , Haowen Fang , Wei Zhang , Tong Geng , Omer Khan , Caiwen Ding

Graph neural networks (GNNs) are designed to process data associated with graphs. They are finding an increasing range of applications; however, as with other modern machine learning techniques, their theoretical understanding is limited.…

Disordered Systems and Neural Networks · Physics 2026-02-23 O. Duranthon , L. Zdeborová

Graph Convolutional Networks (GCNs) are widely used in graph-based applications, such as social networks and recommendation systems. Nevertheless, large-scale graphs or deep aggregation layers in full-batch GCNs consume significant GPU…

Machine Learning · Computer Science 2024-10-15 Shengwei Ji , Yujie Tian , Fei Liu , Xinlu Li , Le Wu

Graph convolutional networks (GCNs) have recently become one of the most powerful tools for graph analytics tasks in numerous applications, ranging from social networks and natural language processing to bioinformatics and chemoinformatics,…

Machine Learning · Computer Science 2019-04-05 Fengwen Chen , Shirui Pan , Jing Jiang , Huan Huo , Guodong Long

To read the final version please go to IEEE TGRS on IEEE Xplore. Convolutional neural networks (CNNs) have been attracting increasing attention in hyperspectral (HS) image classification, owing to their ability to capture spatial-spectral…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Danfeng Hong , Lianru Gao , Jing Yao , Bing Zhang , Antonio Plaza , Jocelyn Chanussot

Recently, graph Convolutional Neural Networks (graph CNNs) have been widely used for graph data representation and semi-supervised learning tasks. However, existing graph CNNs generally use a fixed graph which may be not optimal for…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Bo Jiang , Ziyan Zhang , Doudou Lin , Jin Tang

Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art deep learning model for representation learning on graphs. It is challenging to accelerate training of GCNs, due to (1) substantial and irregular data communication to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-09 Hanqing Zeng , Viktor Prasanna

Graph Neural Networks (GNNs) with attention have been successfully applied for learning visual feature matching. However, current methods learn with complete graphs, resulting in a quadratic complexity in the number of features. Motivated…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Yan Shi , Jun-Xiong Cai , Yoli Shavit , Tai-Jiang Mu , Wensen Feng , Kai Zhang

Graph convolutional networks (GCNs) have achieved remarkable learning ability for dealing with various graph structural data recently. In general, deep GCNs do not work well since graph convolution in conventional GCNs is a special form of…

Machine Learning · Computer Science 2021-12-08 Zhilong Xiong , Jia Cai