English
Related papers

Related papers: Edge-MultiAI: Multi-Tenancy of Latency-Sensitive D…

200 papers

The recent advance of edge computing technology enables significant sensing performance improvement of Internet of Things (IoT) networks. In particular, an edge server (ES) is responsible for gathering sensing data from distributed sensing…

Signal Processing · Electrical Eng. & Systems 2025-04-17 Huawei Hou , Suzhi Bi , Xian Li , Shuoyao Wang , Liping Qian , Zhi Quan

Generative Artificial Intelligence (GAI) is taking the world by storm with its unparalleled content creation ability. Large Language Models (LLMs) are at the forefront of this movement. However, the significant resource demands of LLMs…

Machine Learning · Computer Science 2024-05-14 Xinyuan Zhang , Jiang Liu , Zehui Xiong , Yudong Huang , Gaochang Xie , Ran Zhang

When dealing with deep neural network (DNN) applications on edge devices, continuously updating the model is important. Although updating a model with real incoming data is ideal, using all of them is not always feasible due to limits, such…

Machine Learning · Computer Science 2023-03-23 Yuya Senzaki , Christian Hamelain

The deployment of AI models on low-power, real-time edge devices requires accelerators for which energy, latency, and area are all first-order concerns. There are many approaches to enabling deep neural networks (DNNs) in this domain,…

Automated feature extraction capability and significant performance of Deep Neural Networks (DNN) make them suitable for Internet of Things (IoT) applications. However, deploying DNN on edge devices becomes prohibitive due to the colossal…

Machine Learning · Computer Science 2022-10-03 Rahul Mishra , Hari Prabhat Gupta

As edge computing expands, serving multiple deep neural network (DNN) models on a single shared GPU has become a common yet challenging scenario, where each scheduling decision affects the tail latency of all concurrent queues. Existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-08 Jiahe Cao , Xiaomeng Li , Qiang Liu , Tao Han , Ning Zhang , Weisong Shi

Recently, along with the rapid development of mobile communication technology, edge computing theory and techniques have been attracting more and more attentions from global researchers and engineers, which can significantly bridge the…

Networking and Internet Architecture · Computer Science 2019-12-23 Xiaofei Wang , Yiwen Han , Chenyang Wang , Qiyang Zhao , Xu Chen , Min Chen

Edge computing enables smart IoT-based systems via concurrent and continuous execution of latency-sensitive machine learning (ML) applications. These edge-based machine learning systems are often battery-powered (i.e., energy-limited). They…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-22 Ali Mokhtari , Md Abir Hossen , Pooyan Jamshidi , Mohsen Amini Salehi

With the breakthroughs in Deep Learning, recent years have witnessed a massive surge in Artificial Intelligence applications and services. Meanwhile, the rapid advances in Mobile Computing and Internet of Things has also given rise to…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-25 Prabath Abeysekara , Hai Dong , A. K. Qin

Edge intelligence enables resource-demanding Deep Neural Network (DNN) inference without transferring original data, addressing concerns about data privacy in consumer Internet of Things (IoT) devices. For privacy-sensitive applications,…

Cryptography and Security · Computer Science 2024-03-20 Xueshuo Xie , Haoxu Wang , Zhaolong Jian , Tao Li , Wei Wang , Zhiwei Xu , Guiling Wang

Deep-learning-based intelligent services have become prevalent in cyber-physical applications including smart cities and health-care. Deploying deep-learning-based intelligence near the end-user enhances privacy protection, responsiveness,…

Machine Learning · Computer Science 2022-02-23 Sina Shahhosseini , Dongjoo Seo , Anil Kanduri , Tianyi Hu , Sung-soo Lim , Bryan Donyanavard , Amir M. Rahmani , Nikil Dutt

In the last five years, edge computing has attracted tremendous attention from industry and academia due to its promise to reduce latency, save bandwidth, improve availability, and protect data privacy to keep data secure. At the same time,…

Artificial Intelligence · Computer Science 2019-06-06 Xingzhou Zhang , Yifan Wang , Sidi Lu , Liangkai Liu , Lanyu Xu , Weisong Shi

Resource-constrained Edge Devices (EDs), e.g., IoT sensors and microcontroller units, are expected to make intelligent decisions using Deep Learning (DL) inference at the edge of the network. Toward this end, there is a significant research…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-25 Ghina Al-Atat , Andrea Fresa , Adarsh Prasad Behera , Vishnu Narayanan Moothedath , James Gross , Jaya Prakash Champati

Executing deep neural networks (DNNs) on edge artificial intelligence (AI) devices enables various autonomous mobile computing applications. However, the memory budget of edge AI devices restricts the number and complexity of DNNs allowed…

Machine Learning · Computer Science 2024-01-31 Kun Wang , Jiani Cao , Zimu Zhou , Zhenjiang Li

The pervasiveness of "Internet-of-Things" in our daily life has led to a recent surge in fog computing, encompassing a collaboration of cloud computing and edge intelligence. To that effect, deep learning has been a major driving force…

Machine Learning · Computer Science 2020-05-25 Yinghan Long , Indranil Chakraborty , Kaushik Roy

Split Computing (SC), where a Deep Neural Network (DNN) is intelligently split with a part of it deployed on an edge device and the rest on a remote server is emerging as a promising approach. It allows the power of DNNs to be leveraged for…

Machine Learning · Computer Science 2024-07-09 Luigi Capogrosso , Enrico Fraccaroli , Samarjit Chakraborty , Franco Fummi , Marco Cristani

Edge computing is deemed a promising technique to execute latency-sensitive applications by offloading computation-intensive tasks to edge servers. Extensive research has been conducted in the field of end-device to edge server task…

Networking and Internet Architecture · Computer Science 2024-09-18 Xiang Li , Mustafa Abdallah , Yuan-Yao Lou , Mung Chiang , Kwang Taik Kim , Saurabh Bagchi

Edge computing has emerged as a prospective paradigm to meet ever-increasing computation demands in Mobile Target Tracking Wireless Sensor Networks (MTT-WSN). This paradigm can offload time-sensitive tasks to sink nodes to improve computing…

Networking and Internet Architecture · Computer Science 2021-08-05 Longyu Zhou , Supeng Leng , Qiang Liu , Haoye Chai , Jihua Zhou

Edge Computing emerges as a promising alternative of Cloud Computing, with scalable compute resources and services deployed in the path between IoT devices and Cloud. Since virtualization techniques can be applied on Edge compute nodes,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-13 Joanna Georgiou , Moysis Symeonides , George Pallis , Marios D. Dikaiakos

Edge inference has become more widespread, as its diverse applications range from retail to wearable technology. Clusters of networked resource-constrained edge devices are becoming common, yet no system exists to split a DNN across these…

Networking and Internet Architecture · Computer Science 2023-04-25 Arjun Parthasarathy , Bhaskar Krishnamachari