English
Related papers

Related papers: Bayes-Split-Edge: Bayesian Optimization for Constr…

200 papers

Even the AI has been widely used and significantly changed our life, deploying the large AI models on resource limited edge devices directly is not appropriate. Thus, the model split inference is proposed to improve the performance of edge…

Machine Learning · Computer Science 2024-09-26 Xin Yuan , Ning Li , Quan Chen , Wenchao Xu , Zhaoxin Zhang , Song Guo

With the development of artificial intelligence (AI) techniques and the increasing popularity of camera-equipped devices, many edge video analytics applications are emerging, calling for the deployment of computation-intensive AI models at…

Signal Processing · Electrical Eng. & Systems 2024-04-02 Jiawei Shao , Xinjie Zhang , Jun Zhang

By leveraging the data sample diversity, the early-exit network recently emerges as a prominent neural network architecture to accelerate the deep learning inference process. However, intermediate classifiers of the early exits introduce…

Machine Learning · Computer Science 2022-06-22 Rongkang Dong , Yuyi Mao , Jun Zhang

Edge intelligence has emerged as a promising strategy to deliver low-latency and ubiquitous services for mobile devices. Recent advances in fine-tuning mechanisms of foundation models have enabled edge intelligence by integrating low-rank…

Signal Processing · Electrical Eng. & Systems 2025-09-25 Jingyi Wang , Zhongyuan Zhao , Qingtian Wang , Zexu Li , Yue Wang , Tony Q. S. Quek

This paper studies a new multi-device edge artificial-intelligent (AI) system, which jointly exploits the AI model split inference and integrated sensing and communication (ISAC) to enable low-latency intelligent services at the network…

Information Theory · Computer Science 2022-07-05 Dingzhu Wen , Peixi Liu , Guangxu Zhu , Yuanming Shi , Jie Xu , Yonina C. Eldar , Shuguang Cui

Currently, the world experiences an unprecedentedly increasing generation of application data, from sensor measurements to video streams, thanks to the extreme connectivity capability provided by 5G networks. Going beyond 5G technology,…

Signal Processing · Electrical Eng. & Systems 2022-04-21 Mattia Merluzzi , Miltiadis C. Filippou , Leonardo Gomes Baltar , Emilio Calvanese Strinati

Graphics processing units (GPUs) can improve deep neural network inference throughput via batch processing, where multiple tasks are concurrently processed. We focus on novel scenarios that the energy-constrained mobile devices offload…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-14 Wenqi Shi , Sheng Zhou , Zhisheng Niu , Miao Jiang , Lu Geng

As the number of edge devices with computing resources (e.g., embedded GPUs, mobile phones, and laptops) increases, recent studies demonstrate that it can be beneficial to collaboratively run convolutional neural network (CNN) inference on…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-09 Xueyu Hou , Yongjie Guan , Tao Han , Ning Zhang

Machine learning at the edge offers great benefits such as increased privacy and security, low latency, and more autonomy. However, a major challenge is that many devices, in particular edge devices, have very limited memory, weak…

Machine Learning · Computer Science 2019-09-05 Yang Li , Thomas Strohmer

Artificial intelligence (AI) has become a pivotal force in reshaping next generation mobile networks. Edge computing holds promise in enabling AI as a service (AIaaS) for prompt decision-making by offloading deep neural network (DNN)…

Networking and Internet Architecture · Computer Science 2025-01-28 Vahid Pourakbar , Hamed Shah-Mansouri

Computer vision on low-power edge devices enables applications including search-and-rescue and security. State-of-the-art computer vision algorithms, such as Deep Neural Networks (DNNs), are too large for inference on low-power edge…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Abhinav Goel , Caleb Tung , Xiao Hu , George K. Thiruvathukal , James C. Davis , Yung-Hsiang Lu

In many industry scale applications, large and resource consuming machine learning models reside in powerful cloud servers. At the same time, large amounts of input data are collected at the edge of cloud. The inference results are also…

Machine Learning · Computer Science 2021-08-31 Amin Banitalebi-Dehkordi , Naveen Vedula , Jian Pei , Fei Xia , Lanjun Wang , Yong Zhang

This invited paper presents some novel ideas on how to enhance the performance of consensus algorithms in distributed wireless sensor networks, when communication costs are considered. Of particular interest are consensus algorithms that…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-09-04 Steffen Limmer , Slawomir Stanczak , Mario Goldenbaum , Renato L. G. Cavalcante

The cloud-based solutions are becoming inefficient due to considerably large time delays, high power consumption, security and privacy concerns caused by billions of connected wireless devices and typically zillions bytes of data they…

Systems and Control · Electrical Eng. & Systems 2022-08-02 Xiaolan Liu , Jiadong Yu , Yuanwei Liu , Yue Gao , Toktam Mahmoodi , Sangarapillai Lambotharan , Danny H. K. Tsang

Splitting the inference model between device, edge server, and cloud can improve the performance of EI greatly. Additionally, the non-orthogonal multiple access (NOMA), which is the key supporting technologies of B5G/6G, can achieve massive…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-27 Xin Yuan , Ning Li , Tuo Zhang , Muqing Li , Yuwen Chen , Jose Fernan Martinez Ortega , Song Guo

Edge-caching has received much attention as an efficient technique to reduce delivery latency and network congestion during peak-traffic times by bringing data closer to end users. Existing works usually design caching algorithms separately…

Information Theory · Computer Science 2018-02-08 Thang X. Vu , Symeon Chatzinotas , Bjorn Ottersten

Approximate Bayesian deep learning methods hold significant promise for addressing several issues that occur when deploying deep learning components in intelligent systems, including mitigating the occurrence of over-confident errors and…

Machine Learning · Computer Science 2021-12-06 Meet P. Vadera , Benjamin M. Marlin

Distributed DNN inference is becoming increasingly important as the demand for intelligent services at the network edge grows. By leveraging the power of distributed computing, edge devices can perform complicated and resource-hungry…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-25 Xian Peng , Xin Wu , Lianming Xu , Li Wang , Aiguo Fei

As a key technology of enabling Artificial Intelligence (AI) applications in 5G era, Deep Neural Networks (DNNs) have quickly attracted widespread attention. However, it is challenging to run computation-intensive DNN-based tasks on mobile…

Networking and Internet Architecture · Computer Science 2019-10-14 En Li , Liekang Zeng , Zhi Zhou , Xu Chen

Large language models (LLMs) have emerged as a powerful foundation for intelligent reasoning and decision-making, demonstrating substantial impact across a wide range of domains and applications. However, their massive parameter scales and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-29 Mingyu Sun , Xiao Zhang , Shen Qu , Yan Li , Mengbai Xiao , Yuan Yuan , Dongxiao Yu