English
Related papers

Related papers: Edge-Cloud Cooperation for DNN Inference via Reinf…

200 papers

Since emerging edge applications such as Internet of Things (IoT) analytics and augmented reality have tight latency constraints, hardware AI accelerators have been recently proposed to speed up deep neural network (DNN) inference run by…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-20 Qianlin Liang , Walid A. Hanafy , Ahmed Ali-Eldin , Prashant Shenoy

With the vigorous development of artificial intelligence (AI), the intelligent applications based on deep neural network (DNN) change people's lifestyles and the production efficiency. However, the huge amount of computation and data…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-01 Weiqing Ren , Yuben Qu , Chao Dong , Yuqian Jing , Hao Sun , Qihui Wu , Song Guo

Fog and Edge computing extend cloud services to the proximity of end users, allowing many Internet of Things (IoT) use cases, particularly latency-critical applications. Smart devices, such as traffic and surveillance cameras, often do not…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-16 Mohammad Goudarzi , Maria A. Rodriguez , Majid Sarvi , Rajkumar Buyya

Partitioning and distributing deep neural networks (DNNs) over physical nodes such as edge, fog, or cloud nodes, could enhance sensor fusion, and reduce bandwidth and inference latency. However, when a DNN is distributed over physical…

Networking and Internet Architecture · Computer Science 2019-09-24 Ashkan Yousefpour , Siddartha Devic , Brian Q. Nguyen , Aboudy Kreidieh , Alan Liao , Alexandre M. Bayen , Jason P. Jue

Deep Neural Network (DNN) Inference in Edge Computing, often called Edge Intelligence, requires solutions to insure that sensitive data confidentiality and intellectual property are not revealed in the process. Privacy-preserving Edge…

Cryptography and Security · Computer Science 2023-02-20 Daphnee Chabal , Dolly Sapra , Zoltán Ádám Mann

Deep neural networks (DNNs) have been increasingly deployed on and integrated with edge devices, such as mobile phones, drones, robots and wearables. To run DNN inference directly on edge devices (a.k.a. edge inference) with a satisfactory…

Machine Learning · Computer Science 2020-09-18 Bingqian Lu , Jianyi Yang , Shaolei Ren

Stable Diffusion Models (SDMs) have shown remarkable proficiency in image synthesis. However, their broad application is impeded by their large model sizes and intensive computational requirements, which typically require expensive cloud…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Chenqian Yan , Songwei Liu , Hongjian Liu , Xurui Peng , Xiaojian Wang , Fangmin Chen , Lean Fu , Xing Mei

In collaborative intelligence applications, part of a deep neural network (DNN) is deployed on a relatively low-complexity device such as a mobile phone or edge device, and the remainder of the DNN is processed where more computing…

Machine Learning · Computer Science 2021-05-14 Robert A. Cohen , Hyomin Choi , Ivan V. Bajić

As large language models (LLMs) evolve, deploying them solely in the cloud or compressing them for edge devices has become inadequate due to concerns about latency, privacy, cost, and personalization. This survey explores a collaborative…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-23 Senyao Li , Haozhao Wang , Wenchao Xu , Rui Zhang , Song Guo , Jingling Yuan , Xian Zhong , Tianwei Zhang , Ruixuan Li

Most edge-cloud collaboration frameworks rely on the substantial computational and storage capabilities of cloud-based artificial neural networks (ANNs). However, this reliance results in significant communication overhead between edge…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-28 Di Yu , Changze Lv , Xin Du , Linshan Jiang , Wentao Tong , Zhenyu Liao , Xiaoqing Zheng , Shuiguang Deng

Today's intelligent applications can achieve high performance accuracy using machine learning (ML) techniques, such as deep neural networks (DNNs). Traditionally, in a remote DNN inference problem, an edge device transmits raw data to a…

Machine Learning · Computer Science 2021-06-03 Mounssif Krouka , Anis Elgabli , Chaouki Ben Issaid , Mehdi Bennis

Millions of sensors, cameras, meters, and other edge devices are deployed in networks to collect and analyse data. In many cases, such devices are powered only by Energy Harvesting(EH) and have limited energy available to analyse acquired…

Networking and Internet Architecture · Computer Science 2022-05-31 Jernej Hribar , Ryoichi Shinkuma , George Iosifidis , Ivana Dusparic

Along with the rapid development in the field of artificial intelligence, especially deep learning, deep neural network applications are becoming more and more popular in reality. To be able to withstand the heavy load from mainstream…

Machine Learning · Computer Science 2021-09-27 Toan Pham Van , Ngoc N. Tran , Hoang Pham Minh , Tam Nguyen Minh , Thanh Ta Minh

DNN inference can be accelerated by distributing the workload among a cluster of collaborative edge nodes. Heterogeneity among edge devices and accuracy-performance trade-offs of DNN models present a complex exploration space while catering…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-27 Zain Taufique , Antonio Miele , Pasi Liljeberg , Anil Kanduri

Deep-learning-based intelligent services have become prevalent in cyber-physical applications including smart cities and health-care. Collaborative end-edge-cloud computing for deep learning provides a range of performance and efficiency…

Machine Learning · Computer Science 2022-02-24 Sina Shahhosseini , Tianyi Hu , Dongjoo Seo , Anil Kanduri , Bryan Donyanavard , Amir M. Rahmani , Nikil Dutt

Deep learning models have introduced various intelligent applications to edge devices, such as image classification, speech recognition, and augmented reality. There is an increasing need of training such models on the devices in order to…

Machine Learning · Computer Science 2022-01-27 Kaiqi Zhao , Yitao Chen , Ming Zhao

Deep Neural Networks (DNNs) have shown significant advantages in a wide variety of domains. However, DNNs are becoming computationally intensive and energy hungry at an exponential pace, while at the same time, there is a vast demand for…

Reducing inference time and energy usage while maintaining prediction accuracy has become a significant concern for deep neural networks (DNN) inference on resource-constrained edge devices. To address this problem, we propose a novel…

Machine Learning · Computer Science 2024-03-13 Hasanul Mahmud , Peng Kang , Kevin Desai , Palden Lama , Sushil Prasad

Deep Neural Networks (DNNs) are computationally and memory intensive, which makes their hardware implementation a challenging task especially for resource constrained devices such as IoT nodes. To address this challenge, this paper…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Mohammed F. Tolba , Huruy Tekle Tesfai , Hani Saleh , Baker Mohammad , Mahmoud Al-Qutayri

With the development of the Internet of Things (IoT) and the birth of various new IoT devices, the capacity of massive IoT devices is facing challenges. Fortunately, edge computing can optimize problems such as delay and connectivity by…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-02 Shihao Shen , Yiwen Han , Xiaofei Wang , Yan Wang