中文
相关论文

相关论文: A Metaprogramming and Autotuning Framework for Dep…

200 篇论文

Training a Graph Neural Network (GNN) model on large-scale graphs involves a high volume of data communication and computations. While state-of-the-art CPUs and GPUs feature high computing power, the Standard GNN training protocol adopted…

分布式、并行与集群计算 · 计算机科学 2024-03-28 Yi-Chien Lin , Gangda Deng , Viktor Prasanna

This work is focused on the pruning of some convolutional neural networks (CNNs) and improving theirs efficiency on graphic processing units (GPU) by using a direct sparse algorithm. The Nvidia deep neural network (cuDnn) library is the…

机器学习 · 计算机科学 2022-08-30 Marcin Pietroń , Dominik Żurek

Deep Neural Networks (DNNs), as a subset of Machine Learning (ML) techniques, entail that real-world data can be learned and that decisions can be made in real-time. However, their wide adoption is hindered by a number of software and…

硬件体系结构 · 计算机科学 2021-09-10 Kamilya Smagulova , Mohammed E. Fouda , Fadi Kurdahi , Khaled Salama , Ahmed Eltawil

General Purpose Graphics Processing Unit (GPGPU) computing plays a transformative role in deep learning and machine learning by leveraging the computational advantages of parallel processing. Through the power of Compute Unified Device…

Advancing research in the emerging field of deep graph learning requires new tools to support tensor computation over graphs. In this paper, we present the design principles and implementation of Deep Graph Library (DGL). DGL distills the…

Deep neural networks (DNNs) are state-of-the-art solutions for many machine learning applications, and have been widely used on mobile devices. Running DNNs on resource-constrained mobile devices often requires the help from edge servers…

网络与互联网体系结构 · 计算机科学 2019-03-11 Wenqi Shi , Yunzhong Hou , Sheng Zhou , Zhisheng Niu , Yang Zhang , Lu Geng

Modern deep neural network (DNN) training jobs use complex and heterogeneous software/hardware stacks. The efficacy of software-level optimizations can vary significantly when used in different deployment configurations. It is onerous and…

分布式、并行与集群计算 · 计算机科学 2020-06-08 Hongyu Zhu , Amar Phanishayee , Gennady Pekhimenko

Deep neural network (DNN) partition is a research problem that involves splitting a DNN into multiple parts and offloading them to specific locations. Because of the recent advancement in multi-access edge computing and edge intelligence,…

分布式、并行与集群计算 · 计算机科学 2023-04-21 Di Xu , Xiang He , Tonghua Su , Zhongjie Wang

Deep neural networks (DNNs) have grown exponentially in size over the past decade, leaving only those who have massive datacenter-based resources with the ability to develop and train such models. One of the main challenges for the long…

分布式、并行与集群计算 · 计算机科学 2022-08-02 Youjie Li , Amar Phanishayee , Derek Murray , Jakub Tarnawski , Nam Sung Kim

Deep neural networks (DNNs) have been proving the effectiveness in various computing fields. To provide more efficient computing platforms for DNN applications, it is essential to have evaluation environments that include assorted benchmark…

分布式、并行与集群计算 · 计算机科学 2019-01-16 Aajna Karki , Chethan Palangotu Keshava , Spoorthi Mysore Shivakumar , Joshua Skow , Goutam Madhukeshwar Hegde , Hyeran Jeon

This paper is focused on the improvement the efficiency of the sparse convolutional neural networks (CNNs) layers on graphic processing units (GPU). The Nvidia deep neural network (cuDnn) library provides the most effective implementation…

机器学习 · 计算机科学 2022-01-03 Marcin Pietroń , Dominik Żurek

Deep neural network (DNN) inference relies increasingly on specialized hardware for high computational efficiency. This work introduces a field-programmable gate array (FPGA)-based dynamically configurable accelerator featuring systolic…

硬件体系结构 · 计算机科学 2025-10-10 Anastasios Petropoulos , Theodore Antonakopoulos

Usage of GPUs as co-processors is a well-established approach to accelerate costly algorithms operating on matrices and vectors. We aim to further improve the performance of the Global Neutrino Analysis framework (GNA) by adding GPU support…

分布式、并行与集群计算 · 计算机科学 2018-04-23 Anna Fatkina , Maxim Gonchar , Liudmila Kolupaeva , Dmitry Naumov , Konstantin Treskov

Running Deep Neural Network (DNN) models on devices with limited computational capability is a challenge due to large compute and memory requirements. Quantized Neural Networks (QNNs) have emerged as a potential solution to this problem,…

计算机视觉与模式识别 · 计算机科学 2018-05-31 Yaman Umuroglu , Magnus Jahre

Long training times for high-accuracy deep neural networks (DNNs) impede research into new DNN architectures and slow the development of high-accuracy DNNs. In this paper we present FireCaffe, which successfully scales deep neural network…

计算机视觉与模式识别 · 计算机科学 2016-01-11 Forrest N. Iandola , Khalid Ashraf , Matthew W. Moskewicz , Kurt Keutzer

Recent breakthroughs in Deep Learning (DL) applications have made DL models a key component in almost every modern computing system. The increased popularity of DL applications deployed on a wide-spectrum of platforms have resulted in a…

机器学习 · 计算机科学 2018-09-17 Diana Marculescu , Dimitrios Stamoulis , Ermao Cai

Graph neural network (GNN) has been demonstrated to be a powerful model in many domains for its effectiveness in learning over graphs. To scale GNN training for large graphs, a widely adopted approach is distributed training which…

分布式、并行与集群计算 · 计算机科学 2022-04-19 Haiyang Lin , Mingyu Yan , Xiaocheng Yang , Mo Zou , Wenming Li , Xiaochun Ye , Dongrui Fan

As the size of real-world graphs increases, training Graph Neural Networks (GNNs) has become time-consuming and requires acceleration. While previous works have demonstrated the potential of utilizing FPGA for accelerating GNN training, few…

分布式、并行与集群计算 · 计算机科学 2023-03-06 Yi-Chien Lin , Bingyi Zhang , Viktor Prasanna

Graph neural networks (GNNs) have extended the success of deep neural networks (DNNs) to non-Euclidean graph data, achieving ground-breaking performance on various tasks such as node classification and graph property prediction.…

机器学习 · 计算机科学 2021-12-17 Tianfeng Liu , Yangrui Chen , Dan Li , Chuan Wu , Yibo Zhu , Jun He , Yanghua Peng , Hongzheng Chen , Hongzhi Chen , Chuanxiong Guo

Ensembles of Deep Neural Networks (DNNs) have achieved qualitative predictions but they are computing and memory intensive. Therefore, the demand is growing to make them answer a heavy workload of requests with available computational…

分布式、并行与集群计算 · 计算机科学 2022-08-31 Pierrick Pochelu , Serge G. Petiton , Bruno Conche