English
Related papers

Related papers: Cost-effective Machine Learning Inference Offload …

200 papers

The success of deep neural networks (DNNs) is heavily dependent on computational resources. While DNNs are often employed on cloud servers, there is a growing need to operate DNNs on edge devices. Edge devices are typically limited in their…

Machine Learning · Computer Science 2022-06-08 May Malka , Erez Farhan , Hai Morgenstern , Nir Shlezinger

In this paper, we propose a novel offloading learning approach to compromise energy consumption and latency in multi-tier network with mobile edge computing. In order to solve this integer programming problem, instead of using conventional…

Information Theory · Computer Science 2019-12-10 Shuhan Zhu , Wei Xu , Lisheng Fan , Kezhi Wang , George K. Karagiannidis

The huge amount of data generated by the Internet of things (IoT) devices needs the computational power and storage capacity provided by cloud, edge, and fog computing paradigms. Each of these computing paradigms has its own pros and cons.…

Networking and Internet Architecture · Computer Science 2022-02-23 Binayak Kar , Widhi Yahya , Ying-Dar Lin , Asad Ali

Edge offloading for deep neural networks (DNNs) can be adaptive to the input's complexity by using early-exit DNNs. These DNNs have side branches throughout their architecture, allowing the inference to end earlier in the edge. The branches…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Roberto G. Pacheco , Fernanda D. V. R. Oliveira , Rodrigo S. Couto

The rapid growth of end-user AI applications, such as computer vision and generative AI, has led to immense data and processing demands often exceeding user devices' capabilities. Edge AI addresses this by offloading computation to the…

Machine Learning · Computer Science 2024-11-05 Juan Marcelo Parra-Ullauri , Oscar Dilley , Hari Madhukumar , Dimitra Simeonidou

Fog computing enables use cases where data produced in end devices are stored, processed, and acted on directly at the edges of the network, yet computation can be offloaded to more powerful instances through the edge to cloud continuum.…

Networking and Internet Architecture · Computer Science 2018-10-29 Román Sosa , Csaba Kiraly , Juan D. Parra Rodriguez

In remote regions (e.g., mountain and desert), cellular networks are usually sparsely deployed or unavailable. With the appearance of new applications (e.g., industrial automation and environment monitoring) in remote regions,…

Networking and Internet Architecture · Computer Science 2021-02-04 Dali Zhu , Haitao Liu , Ting Li , Jiyan Sun , Jie Liang , Hangsheng Zhang , Liru Geng , Yinlong Liu

Mobile edge computing (MEC) emerges recently as a promising solution to relieve resource-limited mobile devices from computation-intensive tasks, which enables devices to offload workloads to nearby MEC servers and improve the quality of…

Machine Learning · Computer Science 2020-10-20 Zhao Chen , Xiaodong Wang

The increasing complexity of Intelligent Transportation Systems (ITS) has led to significant interest in computational offloading to external infrastructures such as edge servers, vehicular nodes, and UAVs. These dynamic and heterogeneous…

Machine Learning · Computer Science 2026-05-27 Ashab Uddin , Ahmed Hamdi Sakr , Ning Zhang

Edge Machine Learning (Edge ML), which shifts computational intelligence from cloud-based systems to edge devices, is attracting significant interest due to its evident benefits including reduced latency, enhanced data privacy, and…

Signal Processing · Electrical Eng. & Systems 2023-08-24 George Arvanitakis , Jingwei Zuo , Mthandazo Ndhlovu , Hakim Hacid

The success of deep neural networks (DNN) in machine perception applications such as image classification and speech recognition comes at the cost of high computation and storage complexity. Inference of uncompressed large scale DNN models…

Machine Learning · Computer Science 2020-07-06 Yihao Fang , Shervin Manzuri Shalmani , Rong Zheng

We propose distributed deep neural networks (DDNNs) over distributed computing hierarchies, consisting of the cloud, the edge (fog) and end devices. While being able to accommodate inference of a deep neural network (DNN) in the cloud, a…

Computer Vision and Pattern Recognition · Computer Science 2017-09-08 Surat Teerapittayanon , Bradley McDanel , H. T. Kung

As artificial intelligence (AI) applications continue to expand in next-generation networks, there is a growing need for deep neural network (DNN) models. Although DNN models deployed at the edge are promising for providing AI as a service…

Networking and Internet Architecture · Computer Science 2024-08-22 Alireza Maleki , Hamed Shah-Mansouri , Babak H. Khalaj

For current and future Internet of Things (IoT) networks, mobile edge-cloud computation offloading (MECCO) has been regarded as a promising means to support delay-sensitive IoT applications. However, offloading mobile tasks to the cloud is…

Signal Processing · Electrical Eng. & Systems 2021-08-23 Dinh C. Nguyen , Pubudu N. Pathirana , Ming Ding , Aruna Seneviratne

Recent advances in machine learning and hardware have produced embedded devices capable of performing real-time object detection with commendable accuracy. We consider a scenario in which embedded devices rely on an onboard object detector,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-25 Jiaming Qiu , Ruiqi Wang , Brooks Hu , Roch Guerin , Chenyang Lu

Owing to the resource-constrained feature of Internet of Things (IoT) devices, offloading tasks from IoT devices to the nearby mobile edge computing (MEC) servers can not only save the energy of IoT devices but also reduce the response time…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-01 Zeinab Akhavan , Mona Esmaeili , Babak Badnava , Mohammad Yousefi , Xiang Sun , Michael Devetsikiotis , Payman Zarkesh-Ha

Edge computing has become one of the key enablers for ultra-reliable and low-latency communications in the industrial Internet of Things in the fifth generation communication systems, and is also a promising technology in the future sixth…

Information Theory · Computer Science 2021-01-18 Xiaoyu Hao , Ruohai Zhao , Tao Yang , Yulin Hu , Bo Hu , Yuhe Qiu

Wireless network optimization has been becoming very challenging as the problem size and complexity increase tremendously, due to close couplings among network entities with heterogeneous service and resource requirements. By continuously…

Information Theory · Computer Science 2020-01-29 Shimin Gong , Yutong Xie , Jing Xu , Dusit Niyato , Ying-Chang Liang

Edge computing has emerged as a popular paradigm for supporting mobile and IoT applications with low latency or high bandwidth needs. The attractiveness of edge computing has been further enhanced due to the recent availability of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-30 Qianlin Liang , Prashant Shenoy , David Irwin

Automated feature extraction capability and significant performance of Deep Neural Networks (DNN) make them suitable for Internet of Things (IoT) applications. However, deploying DNN on edge devices becomes prohibitive due to the colossal…

Machine Learning · Computer Science 2022-10-03 Rahul Mishra , Hari Prabhat Gupta