English
Related papers

Related papers: Improving Device-Edge Cooperative Inference of Dee…

200 papers

The success of deep neural networks (DNNs) is heavily dependent on computational resources. While DNNs are often employed on cloud servers, there is a growing need to operate DNNs on edge devices. Edge devices are typically limited in their…

Machine Learning · Computer Science 2022-06-08 May Malka , Erez Farhan , Hai Morgenstern , Nir Shlezinger

Executing deep neural networks (DNNs) on edge artificial intelligence (AI) devices enables various autonomous mobile computing applications. However, the memory budget of edge AI devices restricts the number and complexity of DNNs allowed…

Machine Learning · Computer Science 2024-01-31 Kun Wang , Jiani Cao , Zimu Zhou , Zhenjiang Li

Ubiquitous artificial intelligence (AI) is considered one of the key services in 6G systems. AI services typically rely on deep neural network (DNN) requiring heavy computation. Hence, in order to support ubiquitous AI, it is crucial to…

Networking and Internet Architecture · Computer Science 2022-07-27 Sehun Jung , Hyang-Won Lee

Automated feature extraction capability and significant performance of Deep Neural Networks (DNN) make them suitable for Internet of Things (IoT) applications. However, deploying DNN on edge devices becomes prohibitive due to the colossal…

Machine Learning · Computer Science 2022-10-03 Rahul Mishra , Hari Prabhat Gupta

High-end mobile platforms rapidly serve as primary computing devices for a wide range of Deep Neural Network (DNN) applications. However, the constrained computation and storage resources on these devices still pose significant challenges…

Machine Learning · Computer Science 2020-04-24 Wei Niu , Pu Zhao , Zheng Zhan , Xue Lin , Yanzhi Wang , Bin Ren

Deep neural networks (DNNs) have been increasingly deployed on and integrated with edge devices, such as mobile phones, drones, robots and wearables. To run DNN inference directly on edge devices (a.k.a. edge inference) with a satisfactory…

Machine Learning · Computer Science 2020-09-18 Bingqian Lu , Jianyi Yang , Shaolei Ren

Recent advances in artificial intelligence have driven increasing intelligent applications at the network edge, such as smart home, smart factory, and smart city. To deploy computationally intensive Deep Neural Networks (DNNs) on…

Networking and Internet Architecture · Computer Science 2020-12-08 Liekang Zeng , Xu Chen , Zhi Zhou , Lei Yang , Junshan Zhang

Deep neural networks (DNNs) have demonstrated remarkable success in various fields. However, the large number of floating-point operations (FLOPs) in DNNs poses challenges for their deployment in resource-constrained applications, e.g.,…

Artificial Intelligence · Computer Science 2024-02-20 Mengnan Jiang , Jingcun Wang , Amro Eldebiky , Xunzhao Yin , Cheng Zhuo , Ing-Chao Lin , Grace Li Zhang

As a key technology of enabling Artificial Intelligence (AI) applications in 5G era, Deep Neural Networks (DNNs) have quickly attracted widespread attention. However, it is challenging to run computation-intensive DNN-based tasks on mobile…

Networking and Internet Architecture · Computer Science 2019-10-14 En Li , Liekang Zeng , Zhi Zhou , Xu Chen

Deep Neural Network (DNN) applications with edge computing presents a trade-off between responsiveness and computational resources. On one hand, edge computing can provide high responsiveness deploying computational resources close to end…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-29 Roberto G. Pacheco , Rodrigo S. Couto

Deep neural networks (DNNs) have become a widely deployed model for numerous machine learning applications. However, their fixed architecture, substantial training cost, and significant model redundancy make it difficult to efficiently…

Neural and Evolutionary Computing · Computer Science 2019-05-28 Xiaoliang Dai , Hongxu Yin , Niraj K. Jha

Deep neural networks ( DNNs ) are becoming a key enabling technology for many application domains. However, on-device inference on battery-powered, resource-constrained embedding systems is often infeasible due to prohibitively long…

Machine Learning · Computer Science 2019-11-13 Vicent Sanz Marco , Ben Taylor , Zheng Wang , Yehia Elkhatib

Edge inference has become more widespread, as its diverse applications range from retail to wearable technology. Clusters of networked resource-constrained edge devices are becoming common, yet no system exists to split a DNN across these…

Networking and Internet Architecture · Computer Science 2022-10-25 Arjun Parthasarathy , Bhaskar Krishnamachari

Device-edge co-inference opens up new possibilities for resource-constrained wireless devices (WDs) to execute deep neural network (DNN)-based applications with heavy computation workloads. In particular, the WD executes the first few…

Machine Learning · Computer Science 2021-05-31 Jia Yan , Suzhi Bi , Ying-Jun Angela Zhang

Deep Neural Network (DNN) splitting is one of the key enablers of edge Artificial Intelligence (AI), as it allows end users to pre-process data and offload part of the computational burden to nearby Edge Cloud Servers (ECSs). This opens new…

Signal Processing · Electrical Eng. & Systems 2024-01-31 Francesco Binucci , Mattia Merluzzi , Paolo Banelli , Emilio Calvanese Strinati , Paolo Di Lorenzo

During the deployment of deep neural networks (DNNs) on edge devices, many research efforts are devoted to the limited hardware resource. However, little attention is paid to the influence of dynamic power management. As edge devices…

Machine Learning · Computer Science 2022-12-13 Yifan Gong , Zheng Zhan , Pu Zhao , Yushu Wu , Chao Wu , Caiwen Ding , Weiwen Jiang , Minghai Qin , Yanzhi Wang

Distributed systems can be found in various applications, e.g., in robotics or autonomous driving, to achieve higher flexibility and robustness. Thereby, data flow centric applications such as Deep Neural Network (DNN) inference benefit…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-14 Fabian Kreß , El Mahdi El Annabi , Tim Hotfilter , Julian Hoefer , Tanja Harbaum , Juergen Becker

Computing at the edge is increasingly important since a massive amount of data is generated. This poses challenges in transporting all that data to the remote data centers and cloud, where they can be processed and analyzed. On the other…

Machine Learning · Computer Science 2020-12-09 Christian Makaya , Amalendu Iyer , Jonathan Salfity , Madhu Athreya , M Anthony Lewis

The recent breakthrough in artificial intelligence (AI), especially deep neural networks (DNNs), has affected every branch of science and technology. Particularly, edge AI has been envisioned as a major application scenario to provide…

Machine Learning · Computer Science 2024-10-30 Jiawei Shao , Jun Zhang

Recent breakthroughs in Deep Neural Networks (DNNs) have fueled a tremendously growing demand for bringing DNN-powered intelligence into mobile platforms. While the potential of deploying DNNs on resource-constrained platforms has been…

Machine Learning · Computer Science 2020-06-09 Sicong Liu , Junzhao Du , Kaiming Nan , ZimuZhou , Atlas Wang , Yingyan Lin