English
Related papers

Related papers: BlockGNN: Towards Efficient GNN Acceleration Using…

200 papers

In this article, we investigate the impact of architectural parameters of array-based DNN accelerators on accelerator's energy consumption and performance in a wide variety of network topologies. For this purpose, we have developed a tool…

Hardware Architecture · Computer Science 2022-06-28 Mohammad Ali Maleki , Mehdi Kamal , Ali Afzali-Kusha

Dynamic graph neural network (DGNN) is becoming increasingly popular because of its widespread use in capturing dynamic features in the real world. A variety of dynamic graph neural networks designed from algorithmic perspectives have…

Hardware Architecture · Computer Science 2023-04-17 Hanqiu Chen , Yahya Alhinai , Yihan Jiang , Eunjee Na , Cong Hao

We define a novel type of ensemble Graph Convolutional Network (GCN) model. Using optimized linear projection operators to map between spatial scales of graph, this ensemble model learns to aggregate information from each scale for its…

Machine Learning · Computer Science 2020-04-08 C. B. Scott , Eric Mjolsness

Training deep neural networks (DNNs) is a computationally expensive job, which can take weeks or months even with high performance GPUs. As a remedy for this challenge, community has started exploring the use of more efficient data…

Machine Learning · Computer Science 2022-03-15 Seock-Hwan Noh , Jahyun Koo , Seunghyun Lee , Jongse Park , Jaeha Kung

Neural networks (NNs) have demonstrated their potential in a wide range of applications such as image recognition, decision making or recommendation systems. However, standard NNs are unable to capture their model uncertainty which is…

Hardware Architecture · Computer Science 2021-12-02 Hongxiang Fan , Martin Ferianc , Miguel Rodrigues , Hongyu Zhou , Xinyu Niu , Wayne Luk

Convolutional Neural Networks (CNNs) have shown outstanding accuracy for many vision tasks during recent years. When deploying CNNs on portable devices and embedded systems, however, the large number of parameters and computations result in…

Signal Processing · Electrical Eng. & Systems 2020-02-19 Mehdi Ahmadi , Shervin Vakili , J. M. Pierre Langlois

Graph convolutional networks (GCNs) have shown remarkable learning capabilities when processing graph-structured data found inherently in many application areas. GCNs distribute the outputs of neural networks embedded in each vertex over…

Hardware Architecture · Computer Science 2022-05-18 Sumit K. Mandal , Gokul Krishnan , A. Alper Goksoy , Gopikrishnan Ravindran Nair , Yu Cao , Umit Y. Ogras

This paper works on Binary Neural Networks (BNNs), a promising avenue for efficient deep learning, offering significant reductions in computational overhead and memory footprint to full precision networks. However, the challenge of…

Machine Learning · Computer Science 2024-10-02 Federico Fontana , Romeo Lanzino , Anxhelo Diko , Gian Luca Foresti , Luigi Cinque

Graph Neural Networks (GNNs) have demonstrated outstanding performance in various applications. Existing frameworks utilize CPU-GPU heterogeneous environments to train GNN models and integrate mini-batch and sampling techniques to overcome…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-13 Xin Ai , Qiange Wang , Chunyu Cao , Yanfeng Zhang , Chaoyi Chen , Hao Yuan , Yu Gu , Ge Yu

While embedded FPGAs are attractive platforms for DNN acceleration on edge-devices due to their low latency and high energy efficiency, the scarcity of resources of edge-scale FPGA devices also makes it challenging for DNN deployment. In…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Cong Hao , Xiaofan Zhang , Yuhong Li , Sitao Huang , Jinjun Xiong , Kyle Rupnow , Wen-mei Hwu , Deming Chen

The inherent diversity of computation types within the deep neural network (DNN) models often requires a variety of specialized units in hardware processors, which limits computational efficiency, increasing both inference latency and power…

Machine Learning · Computer Science 2024-08-21 Ruiqi Sun , Siwei Ye , Jie Zhao , Xin He , Jianzhe Lin , Yiran Li , An Zou

Graph convolutional neural networks (GCNs) have achieved state-of-the-art performance on graph-structured data analysis. Like traditional neural networks, training and inference of GCNs are accelerated with GPUs. Therefore, characterizing…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-29 Mingyu Yan , Zhaodong Chen , Lei Deng , Xiaochun Ye , Zhimin Zhang , Dongrui Fan , Yuan Xie

The Deep Graph Library (DGL) was designed as a tool to enable structure learning from graphs, by supporting a core abstraction for graphs, including the popular Graph Neural Networks (GNN). DGL contains implementations of all core graph…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-14 Sasikanth Avancha , Vasimuddin Md , Sanchit Misra , Ramanarayan Mohanty

Graph Convolutional Networks (GCNs) have drawn tremendous attention in the past three years. Compared with other deep learning modalities, high-performance hardware acceleration of GCNs is as critical but even more challenging. The hurdles…

Hardware Architecture · Computer Science 2022-03-08 Tong Geng , Chunshu Wu , Yongan Zhang , Cheng Tan , Chenhao Xie , Haoran You , Martin C. Herbordt , Yingyan Lin , Ang Li

Binarized neural networks, or BNNs, show great promise in edge-side applications with resource limited hardware, but raise the concerns of reduced accuracy. Motivated by the complex neural networks, in this paper we introduce complex…

Neural and Evolutionary Computing · Computer Science 2021-04-21 Yanfei Li , Tong Geng , Ang Li , Huimin Yu

Graph convolutional network (GCN) emerges as a promising direction to learn the inductive representation in graph data commonly used in widespread applications, such as E-commerce, social networks, and knowledge graphs. However, learning…

Hardware Architecture · Computer Science 2020-09-29 Xiaobing Chen , Yuke Wang , Xinfeng Xie , Xing Hu , Abanti Basak , Ling Liang , Mingyu Yan , Lei Deng , Yufei Ding , Zidong Du , Yunji Chen , Yuan Xie

Graph convolutional network (GCN) has been successfully applied to many graph-based applications; however, training a large-scale GCN remains challenging. Current SGD-based algorithms suffer from either a high computational cost that…

Machine Learning · Computer Science 2019-08-09 Wei-Lin Chiang , Xuanqing Liu , Si Si , Yang Li , Samy Bengio , Cho-Jui Hsieh

Graph-based data present unique challenges and opportunities for machine learning. Graph Neural Networks (GNNs), and especially those algorithms that capture graph topology through message passing for neighborhood aggregation, have been a…

Machine Learning · Computer Science 2024-04-19 Zheyi Qin , Randy Paffenroth , Anura P. Jayasumana

Convolutional neural networks (CNNs) demonstrate excellent performance in various computer vision applications. In recent years, FPGA-based CNN accelerators have been proposed for optimizing performance and power efficiency. Most…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-19 Jung-Woo Chang , Keon-Woo Kang , Suk-Ju Kang

Training Graph Neural Networks (GNNs) on real-world graphs consisting of billions of nodes and edges is quite challenging, primarily due to the substantial memory needed to store the graph and its intermediate node and edge features, and…

Machine Learning · Computer Science 2023-08-08 Kaidi Cao , Rui Deng , Shirley Wu , Edward W Huang , Karthik Subbian , Jure Leskovec