English
Related papers

Related papers: Rethinking Inference Placement for Deep Learning a…

200 papers

The inference of Neural Networks is usually restricted by the resources (e.g., computing power, memory, bandwidth) on edge devices. In addition to improving the hardware design and deploying efficient models, it is possible to aggregate the…

Machine Learning · Computer Science 2021-11-05 Jun-Liang Lin , Sheng-De Wang

We investigate the problem of computation offloading in a mobile edge computing architecture, where multiple energy-constrained users compete to offload their computational tasks to multiple servers through a shared wireless medium. We…

Information Theory · Computer Science 2019-12-24 Navid Naderializadeh , Morteza Hashemi

We consider a resource-constrained Edge Device (ED), such as an IoT sensor or a microcontroller unit, embedded with a small-size ML model (S-ML) for a generic classification application and an Edge Server (ES) that hosts a large-size ML…

Machine Learning · Computer Science 2024-10-03 Vishnu Narayanan Moothedath , Jaya Prakash Champati , James Gross

The massive growth in the utilization of edge AI has made the applications of machine learning models ubiquitous in different domains. Despite the computation and communication efficiency of these systems, due to limited computation…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Mohammad Mahdi Kamani , Zhongwei Cheng , Lin Chen

Limited computing resources of internet-of-things (IoT) nodes incur prohibitive latency in processing input data. This triggers new research opportunities toward task offloading systems where edge servers handle intensive computations of…

Information Theory · Computer Science 2022-07-29 Sangwon Hwang , Hoon Lee , Juseong Park , Inkyu Lee

The potential held by the gargantuan volumes of data being generated across networks worldwide has been truly unlocked by machine learning techniques and more recently Deep Learning. The advantages offered by the latter have seen it rapidly…

Artificial Intelligence · Computer Science 2020-12-25 Ahnaf Hannan Lodhi , Barış Akgün , Öznur Özkasap

Many Internet-of-Things (IoT) devices rely on cloud computation resources to perform machine learning inferences. This is expensive and may raise privacy concerns for users. Consumers of these devices often have hardware such as gaming…

Cryptography and Security · Computer Science 2025-04-01 Han Zhang , Zifan Wang , Mihir Dhamankar , Matt Fredrikson , Yuvraj Agarwal

Collaborative deep learning inference between low-resource endpoint devices and edge servers has received significant research interest in the last few years. Such computation partitioning can help reducing endpoint device energy…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-28 Jani Boutellier , Bo Tan , Jari Nurmi

The recent breakthrough in artificial intelligence (AI), especially deep neural networks (DNNs), has affected every branch of science and technology. Particularly, edge AI has been envisioned as a major application scenario to provide…

Machine Learning · Computer Science 2024-10-30 Jiawei Shao , Jun Zhang

Deep Neural Network (DNN) Inference in Edge Computing, often called Edge Intelligence, requires solutions to insure that sensitive data confidentiality and intellectual property are not revealed in the process. Privacy-preserving Edge…

Cryptography and Security · Computer Science 2023-02-20 Daphnee Chabal , Dolly Sapra , Zoltán Ádám Mann

The surge in Internet of Things (IoT) devices and data generation highlights the limitations of traditional cloud computing in meeting demands for immediacy, Quality of Service, and location-aware services. Fog computing emerges as a…

Cryptography and Security · Computer Science 2024-08-06 Amir Pakmehr

Edge computing is an emerging technology which places computing at the edge of the network to provide an ultra-low latency. Computation offloading, a paradigm that migrates computing from mobile devices to remote servers, can now use the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-13 Li Lin , Peng Li , Jinbo Xiong , Mingwei Lin

The recent breakthroughs in machine learning (ML) and deep learning (DL) have catalyzed the design and development of various intelligent systems over wide application domains. While most existing machine learning models require large…

Machine Learning · Computer Science 2024-09-24 Shuai Zhu , Thiemo Voigt , JeongGil Ko , Fatemeh Rahimian

Deep Learning (DL) models have achieved superior performance in many application domains, including vision, language, medical, commercial ads, entertainment, etc. With the fast development, both DL applications and the underlying serving…

Machine Learning · Computer Science 2022-02-22 Fuxun Yu , Di Wang , Longfei Shangguan , Minjia Zhang , Xulong Tang , Chenchen Liu , Xiang Chen

Allowing less capable devices to offload computational tasks to more powerful devices or servers enables the development of new applications that may not run correctly on the device itself. Deciding where and why to run each of those…

Emerging Technologies · Computer Science 2026-01-08 Gorka Nieto , Idoia de la Iglesia , Cristina Perfecto , Unai Lopez-Novoa

Offloading high-demanding applications to the edge provides better quality of experience (QoE) for users with limited hardware devices. However, to maintain a competitive QoE, infrastructure, and service providers must adapt to users'…

Networking and Internet Architecture · Computer Science 2023-06-29 João Paulo Esper , Nadjib Achir , Kleber Vieira Cardoso , Jussara M. Almeida

Mobile edge computing (MEC) is a promising paradigm to accommodate the increasingly prosperous delay-sensitive and computation-intensive applications in 5G systems. To achieve optimum computation performance in a dynamic MEC environment,…

Information Theory · Computer Science 2021-10-08 Xian Li , Liang Huang , Hui Wang , Suzhi Bi , Ying-Jun Angela Zhang

Distributed machine learning (ML) at network edge is a promising paradigm that can preserve both network bandwidth and privacy of data providers. However, heterogeneous and limited computation and communication resources on edge servers (or…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-24 Qing Han , Shusen Yang , Xuebin Ren , Cong Zhao , Jingqi Zhang , Xinyu Yang

As machine learning models become increasingly deployed across the edge of internet of things environments, a partitioned deep learning paradigm in which models are split across multiple computational nodes introduces a new dimension of…

Machine Learning · Computer Science 2025-07-11 Giulio Rossolini , Fabio Brau , Alessandro Biondi , Battista Biggio , Giorgio Buttazzo

Emerging applications, such as robot-assisted eldercare and object recognition, generally employ deep learning neural networks (DNNs) and naturally require: i) handling streaming-in inference requests and ii) adapting to possible deployment…

Machine Learning · Computer Science 2025-05-19 Sheng Li , Geng Yuan , Yue Dai , Tianyu Wang , Yawen Wu , Alex K. Jones , Jingtong Hu , Tony , Geng , Yanzhi Wang , Bo Yuan , Yufei Ding , Xulong Tang