English
Related papers

Related papers: Edge-MultiAI: Multi-Tenancy of Latency-Sensitive D…

200 papers

Deep learning models are being deployed in many mobile intelligent applications. End-side services, such as intelligent personal assistants, autonomous cars, and smart home services often employ either simple local models on the mobile or…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-06 Amir Erfan Eshratifar , Mohammad Saeed Abrishami , Massoud Pedram

Deep Neural Networks (DNNs) have demonstrated impressive performance across a wide range of tasks. However, deploying DNNs on edge devices poses significant challenges due to stringent power and computational budgets. An effective solution…

Machine Learning · Computer Science 2023-06-13 Zheyu Yan , Yifan Qin , Xiaobo Sharon Hu , Yiyu Shi

Generative AI (GenAI) has transformed applications in natural language processing and content creation, yet centralized inference remains hindered by high latency, limited customizability, and privacy concerns. Deploying large models (LMs)…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Haiyuan Li , Hari Madhukumar , Shuangyi Yan , Yulei Wu , Dimitra Simeonidou

With the increasing extent of malware attacks in the present day along with the difficulty in detecting modern malware, it is necessary to evaluate the effectiveness and performance of Deep Neural Networks (DNNs) for malware classification.…

Cryptography and Security · Computer Science 2023-10-12 Akhil M R , Adithya Krishna V Sharma , Harivardhan Swamy , Pavan A , Ashray Shetty , Anirudh B Sathyanarayana

In response to the demand for real-time performance and control quality in industrial Internet of Things (IoT) environments, this paper proposes an optimization control system based on deep reinforcement learning and edge computing. The…

Networking and Internet Architecture · Computer Science 2024-03-14 Jingyu Xu , Weixiang Wan , Linying Pan , Wenjian Sun , Yuxiang Liu

Many real-time applications (e.g., Augmented/Virtual Reality, cognitive assistance) rely on Deep Neural Networks (DNNs) to process inference tasks. Edge computing is considered a key infrastructure to deploy such applications, as moving…

To meet next-generation IoT application demands, edge computing moves processing power and storage closer to the network edge to minimise latency and bandwidth utilisation. Edge computing is becoming popular as a result of these benefits,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-13 Aadharsh Roshan Nandhakumar , Ayush Baranwal , Priyanshukumar Choudhary , Muhammed Golec , Sukhpal Singh Gill

Edge artificial intelligence (AI) will be a central part of 6G, with powerful edge servers supporting devices in performing machine learning (ML) inference. However, it is challenging to deliver the latency and accuracy guarantees required…

Information Theory · Computer Science 2025-06-16 Anders E. Kalør , Tomoaki Ohtsuki

On-device large language models (LLMs), referring to running LLMs on edge devices, have raised considerable interest since they are more cost-effective, latency-efficient, and privacy-preserving compared with the cloud paradigm.…

Networking and Internet Architecture · Computer Science 2025-03-21 Guanqiao Qu , Qiyuan Chen , Wei Wei , Zheng Lin , Xianhao Chen , Kaibin Huang

We investigate the problem of computation offloading in a mobile edge computing architecture, where multiple energy-constrained users compete to offload their computational tasks to multiple servers through a shared wireless medium. We…

Information Theory · Computer Science 2019-12-24 Navid Naderializadeh , Morteza Hashemi

By leveraging the concept of mobile edge computing (MEC), massive amount of data generated by a large number of Internet of Things (IoT) devices could be offloaded to MEC server at the edge of wireless network for further computational…

Signal Processing · Electrical Eng. & Systems 2019-06-20 Lei Lei , Huijuan Xu , Xiong Xiong , Kan Zheng , Wei Xiang , Xianbin Wang

Deploying deep neural networks (DNNs) on resource-constrained mobile devices presents significant challenges, particularly in achieving real-time performance while simultaneously coping with limited computational resources and battery life.…

Networking and Internet Architecture · Computer Science 2025-09-24 Zekai Sun , Xiuxian Guan , Zheng Lin , Zihan Fang , Xiangming Cai , Zhe Chen , Fangming Liu , Heming Cui , Jie Xiong , Wei Ni , Chau Yuen

With the prevalence of intelligent mobile applications, edge learning is emerging as a promising technology for powering fast intelligence acquisition for edge devices from distributed data generated at the network edge. One critical task…

Networking and Internet Architecture · Computer Science 2019-10-08 Dongzhu Liu , Guangxu Zhu , Jun Zhang , Kaibin Huang

Driven by the wide adoption of deep neural networks (DNNs) across different application domains, multi-tenancy execution, where multiple DNNs are deployed simultaneously on the same hardware, has been proposed to satisfy the latency…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-11 Seah Kim , Hasan Genc , Vadim Vadimovich Nikiforov , Krste Asanović , Borivoje Nikolić , Yakun Sophia Shao

Big Artificial Intelligence (AI) models have emerged as a crucial element in various intelligent applications at the edge, such as voice assistants in smart homes and autonomous robotics in smart factories. Training big AI models, e.g., for…

Machine Learning · Computer Science 2024-04-30 Liekang Zeng , Shengyuan Ye , Xu Chen , Yang Yang

IoT applications increasingly rely on on-device AI accelerators to ensure high performance, especially in low-connectivity and safety-critical scenarios. However, the limited on-chip memory of these accelerators forces inference runtimes to…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-13 Nathan Ng , Walid A. Hanafy , Prashanthi Kadambi , Balachandra Sunil , Ayush Gupta , David Irwin , Yogesh Simmhan , Prashant Shenoy

The growing demand for intelligent applications beyond the network edge, coupled with the need for sustainable operation, are driving the seamless integration of deep learning (DL) algorithms into energy-limited, and even energy-harvesting…

Machine Learning · Computer Science 2024-11-08 Marcello Bullo , Seifallah Jardak , Pietro Carnelli , Deniz Gündüz

Weightless Neural Networks (WNNs) are a class of machine learning model which use table lookups to perform inference. This is in contrast with Deep Neural Networks (DNNs), which use multiply-accumulate operations. State-of-the-art WNN…

Deploying Deep Learning (DL) on embedded end devices is a scorching trend in pervasive computing. Since most Microcontrollers on embedded devices have limited computing power, it is necessary to add a DL accelerator. Embedded Field…

Hardware Architecture · Computer Science 2024-09-17 Chao Qian , Tianheng Ling , Gregor Schiele

It is usually infeasible to fit and train an entire large deep neural network (DNN) model using a single edge device due to the limited resources. To facilitate intelligent applications across edge devices, researchers have proposed…

Machine Learning · Computer Science 2023-11-13 Yuhao Chen , Yuxuan Yan , Qianqian Yang , Yuanchao Shu , Shibo He , Zhiguo Shi , Jiming Chen