English
Related papers

Related papers: Characterizing and Understanding GCNs on GPU

200 papers

Graph convolutional networks (GCNs) have demonstrated superiority in graph-based learning tasks. However, training GCNs on full graphs is particularly challenging, due to the following two challenges: (1) the associated feature tensors can…

Machine Learning · Computer Science 2025-02-26 Cheng Wan , Runkai Tao , Zheng Du , Yang Katie Zhao , Yingyan Celine Lin

Graph neural networks (GNNs) have demonstrated remarkable capabilities in learning from graph-structured data, often outperforming traditional Multilayer Perceptrons (MLPs) in numerous graph-based tasks. Although existing works have…

Machine Learning · Computer Science 2025-06-09 Wei Huang , Yuan Cao , Haonan Wang , Xin Cao , Taiji Suzuki

Many machine learning techniques have been proposed in the last few years to process data represented in graph-structured form. Graphs can be used to model several scenarios, from molecules and materials to RNA secondary structures. Several…

Machine Learning · Computer Science 2018-11-19 Nicolò Navarin , Dinh V. Tran , Alessandro Sperduti

Graph Neural Networks (GNNs) are deep learning models that take graph data as inputs, and they are applied to various tasks such as traffic prediction and molecular property prediction. However, owing to the complexity of the GNNs, it has…

Machine Learning · Computer Science 2021-11-02 Tetsu Kasanishi , Xueting Wang , Toshihiko Yamasaki

Graph neural networks (GNNs) are gaining increasing popularity as a promising approach to machine learning on graphs. Unlike traditional graph workloads where each vertex/edge is associated with a scalar, GNNs attach a feature tensor to…

Machine Learning · Computer Science 2020-09-30 Yuwei Hu , Zihao Ye , Minjie Wang , Jiali Yu , Da Zheng , Mu Li , Zheng Zhang , Zhiru Zhang , Yida Wang

Graph neural networks (GNNs) process large-scale graphs consisting of a hundred billion edges. In contrast to traditional deep learning, unique behaviors of the emerging GNNs are engaged with a large set of graphs and embedding data on…

Hardware Architecture · Computer Science 2022-01-25 Miryeong Kwon , Donghyun Gouk , Sangwon Lee , Myoungsoo Jung

Many Graph Neural Network (GNN) training systems have emerged recently to support efficient GNN training. Since GNNs embody complex data dependencies between training samples, the training of GNNs should address distinct challenges…

Machine Learning · Computer Science 2024-03-21 Hao Yuan , Yajiong Liu , Yanfeng Zhang , Xin Ai , Qiange Wang , Chaoyi Chen , Yu Gu , Ge Yu

Graph convolutional networks (GCNs) have been attracting widespread attentions due to their encouraging performance and powerful generalizations. However, few work provide a general view to interpret various GCNs and guide GCNs' designs. In…

Machine Learning · Computer Science 2023-07-04 Shiping Wang , Zhihao Wu , Yuhong Chen , Yong Chen

Convolutional Neural Networks (CNNs) are currently adopted to solve an ever greater number of problems, ranging from speech recognition to image classification and segmentation. The large amount of processing required by CNNs calls for…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-06 Kamel Abdelouahab , Maxime Pelcat , Jocelyn Serot , François Berry

Convolutional neural network (CNN) is an important deep learning method. The convolution operation takes a large proportion of the total execution time for CNN. Feature maps for convolution operation are usually sparse. Multiplications and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-01 Weizhi Xu , Yintai Sun , fhengyu Fan , Hui Yu , Xin Fu

Graph Neural Networks (GNNs) are a powerful tool for handling structured graph data and addressing tasks such as node classification, graph classification, and clustering. However, the sparse nature of GNN computation poses new challenges…

Machine Learning · Computer Science 2023-08-24 Julia Bazinska , Andrei Ivanov , Tal Ben-Nun , Nikoli Dryden , Maciej Besta , Siyuan Shen , Torsten Hoefler

Graph Convolutional Networks (GCNs) have shown significant improvements in semi-supervised learning on graph-structured data. Concurrently, unsupervised learning of graph embeddings has benefited from the information contained in random…

Machine Learning · Computer Science 2018-02-27 Sami Abu-El-Haija , Amol Kapoor , Bryan Perozzi , Joonseok Lee

Recently, graph neural networks (GNNs) have proved to be suitable in tasks on unstructured data. Particularly in tasks as community detection, node classification, and link prediction. However, most GNN models still operate with static…

Machine Learning · Computer Science 2019-06-07 Darwin Saire Pilco , Adín Ramírez Rivera

We address the efficiency issue for the construction of a deep graph neural network (GNN). The approach exploits the idea of representing each input graph as a fixed point of a dynamical system (implemented through a recurrent neural…

Machine Learning · Computer Science 2019-11-21 Claudio Gallicchio , Alessio Micheli

Graph neural networks (GNNs) are effective machine learning models for many graph-related applications. Despite their empirical success, many research efforts focus on the theoretical limitations of GNNs, i.e., the GNNs expressive power.…

Machine Learning · Computer Science 2025-01-13 Bingxu Zhang , Changjun Fan , Shixuan Liu , Kuihua Huang , Xiang Zhao , Jincai Huang , Zhong Liu

Graph Neural Networks (GNNs) are an effective framework for representation learning of graphs. GNNs follow a neighborhood aggregation scheme, where the representation vector of a node is computed by recursively aggregating and transforming…

Machine Learning · Computer Science 2019-02-26 Keyulu Xu , Weihua Hu , Jure Leskovec , Stefanie Jegelka

Graph convolutional networks (GCNs) aim at extending deep learning to arbitrary irregular domains, namely graphs. Their success is highly dependent on how the topology of input graphs is defined and most of the existing GCN architectures…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Hichem Sahbi

Deep learning, particularly convolutional neural networks (CNNs), have yielded rapid, significant improvements in computer vision and related domains. But conventional deep learning architectures perform poorly when data have an underlying…

Signal Processing · Electrical Eng. & Systems 2020-12-02 Mark Cheung , John Shi , Oren Wright , Lavender Y. Jiang , Xujin Liu , José M. F. Moura

Graph convolutional networks (GCNs) are \emph{discriminative models} that directly model the class posterior $p(y|\mathbf{x})$ for semi-supervised classification of graph data. While being effective, as a representation learning approach,…

Machine Learning · Computer Science 2023-05-30 Tianchun Wang , Farzaneh Mirzazadeh , Xiang Zhang , Jie Chen

The Deep Graph Library (DGL) was designed as a tool to enable structure learning from graphs, by supporting a core abstraction for graphs, including the popular Graph Neural Networks (GNN). DGL contains implementations of all core graph…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-14 Sasikanth Avancha , Vasimuddin Md , Sanchit Misra , Ramanarayan Mohanty