English
Related papers

Related papers: Analysis of Distributed Deep Learning in the Cloud

200 papers

Despite the notable success of deep neural networks (DNNs) in solving complex tasks, the training process still remains considerable challenges. A primary obstacle is the substantial time required for training, particularly as high…

Machine Learning · Computer Science 2025-09-09 Viet Hoang Pham , Hyo-Sung Ahn

Distributed Deep Learning (DDL), as a paradigm, dictates the use of GPU-based clusters as the optimal infrastructure for training large-scale Deep Neural Networks (DNNs). However, the high cost of such resources makes them inaccessible to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-15 Yoochan Kim , Kihyun Kim , Yonghyeon Cho , Jinwoo Kim , Awais Khan , Ki-Dong Kang , Baik-Song An , Myung-Hoon Cha , Hong-Yeon Kim , Youngjae Kim

Distributed deep neural network (DDNN) training constitutes an increasingly important workload that frequently runs in the cloud. Larger DNN models and faster compute engines are shifting DDNN training bottlenecks from computation to…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-22 Liang Luo , Jacob Nelson , Luis Ceze , Amar Phanishayee , Arvind Krishnamurthy

In this paper, we primarily focus on understanding the data preprocessing pipeline for DNN Training in the public cloud. First, we run experiments to test the performance implications of the two major data preprocessing methods using either…

Machine Learning · Computer Science 2023-04-19 Ping Gong , Yuxin Ma , Cheng Li , Xiaosong Ma , Sam H. Noh

Deploying deep neural networks (DNNs) on IoT and mobile devices is a challenging task due to their limited computational resources. Thus, demanding tasks are often entirely offloaded to edge servers which can accelerate inference, however,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Arian Bakhtiarnia , Nemanja Milošević , Qi Zhang , Dragana Bajović , Alexandros Iosifidis

Edge intelligent applications like VR/AR and language model based chatbots have become widespread with the rapid expansion of IoT and mobile devices. However, constrained edge devices often cannot serve the increasingly large and complex…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-28 Zongshun Zhang , Ibrahim Matta

The development of artificial intelligence (AI) provides opportunities for the promotion of deep neural network (DNN)-based applications. However, the large amount of parameters and computational complexity of DNN makes it difficult to…

Machine Learning · Computer Science 2023-10-25 Ce Xu , Jinxuan Li , Yuan Liu , Yushi Ling , Miaowen Wen

GPUs have been favored for training deep learning models due to their highly parallelized architecture. As a result, most studies on training optimization focus on GPUs. There is often a trade-off, however, between cost and efficiency when…

Deep learning (DL) shows its prosperity in a wide variety of fields. The development of a DL model is a time-consuming and resource-intensive procedure. Hence, dedicated GPU accelerators have been collectively constructed into a GPU…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-02 Wei Gao , Qinghao Hu , Zhisheng Ye , Peng Sun , Xiaolin Wang , Yingwei Luo , Tianwei Zhang , Yonggang Wen

This paper studies a deep learning (DL) framework to solve distributed non-convex constrained optimizations in wireless networks where multiple computing nodes, interconnected via backhaul links, desire to determine an efficient assignment…

Information Theory · Computer Science 2019-06-03 Hoon Lee , Sang Hyun Lee , Tony Q. S. Quek

The widespread application of deep learning has changed the landscape of computation in the data center. In particular, personalized recommendation for content ranking is now largely accomplished leveraging deep neural networks. However,…

This letter mainly studies the transmit antenna selection(TAS) based on deep learning (DL) scheme in untrusted relay networks. In previous work, we discover that machine learning (ML)-based antenna selection schemes have small performance…

Signal Processing · Electrical Eng. & Systems 2019-01-11 Rugui Yao , Yuxin Zhang , Shengyao Wang , Nan Qi , Theodoros A. Tsiftsis , Nikos I. Miridakis

Graphics processing units (GPUs) are the de facto standard for processing deep learning (DL) tasks. Meanwhile, GPU failures, which are inevitable, cause severe consequences in DL tasks: they disrupt distributed trainings, crash inference…

Machine Learning · Computer Science 2022-01-31 Heting Liu , Zhichao Li , Cheng Tan , Rongqiu Yang , Guohong Cao , Zherui Liu , Chuanxiong Guo

During the past decade, machine learning has become extremely popular and can be found in many aspects of our every day life. Nowayadays with explosion of data while rapid growth of computation capacity, Distributed Deep Neural Networks…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-16 Sayed Hadi Hashemi , Shadi A. Noghabi , William Gropp , Roy H Campbell

Privacy issues were raised in the process of training deep learning in medical, mobility, and other fields. To solve this problem, we present privacy-preserving distributed deep learning method that allow clients to learn a variety of data…

Machine Learning · Computer Science 2020-09-14 Jongwon Kim , Sungho Shin , Yeonguk Yu , Junseok Lee , Kyoobin Lee

GPUs are currently the platform of choice for training neural networks. However, training a deep neural network (DNN) is a time-consuming process even on GPUs because of the massive number of parameters that have to be learned. As a result,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-29 Behnam Pourghassemi , Chenghao Zhang , Joo Hwan Lee , Aparna Chandramowlishwaran

Distributed deep neural networks (DNNs) have been shown to reduce the computational burden of mobile devices and decrease the end-to-end inference latency in edge computing scenarios. While distributed DNNs have been studied, to the best of…

Machine Learning · Computer Science 2025-10-02 Milin Zhang , Mohammad Abdi , Jonathan Ashdown , Francesco Restuccia

Deep neural networks (DNNs) are state-of-the-art solutions for many machine learning applications, and have been widely used on mobile devices. Running DNNs on resource-constrained mobile devices often requires the help from edge servers…

Networking and Internet Architecture · Computer Science 2019-03-11 Wenqi Shi , Yunzhong Hou , Sheng Zhou , Zhisheng Niu , Yang Zhang , Lu Geng

GPUs are essential to accelerating the latency-sensitive deep neural network (DNN) inference workloads in cloud datacenters. To fully utilize GPU resources, spatial sharing of GPUs among co-located DNN inference workloads becomes…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-04 Fei Xu , Jianian Xu , Jiabin Chen , Li Chen , Ruitao Shang , Zhi Zhou , Fangming Liu

With the fast development of deep neural networks (DNNs), many real-world applications are adopting multiple models to conduct compound tasks, such as co-running classification, detection, and segmentation models on autonomous vehicles.…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-30 Fuxun Yu , Shawn Bray , Di Wang , Longfei Shangguan , Xulong Tang , Chenchen Liu , Xiang Chen