English
Related papers

Related papers: Selective Task offloading for Maximum Inference Ac…

200 papers

Transfer optimization enables data-efficient optimization of a target task by leveraging experiential priors from related source tasks. This is especially useful in multiobjective optimization settings where a set of trade-off solutions is…

Neural and Evolutionary Computing · Computer Science 2024-07-11 Jiao Liu , Abhishek Gupta , Yew-Soon Ong

With the increasing popularity of Internet of Things (IoT) devices, there is a growing need for energy-efficient Machine Learning (ML) models that can run on constrained edge nodes. Decision tree ensembles, such as Random Forests (RFs) and…

Modern edge AI applications increasingly rely on microservice architectures that integrate both AI services and conventional microservices into complex request chains with stringent latency requirements. Effectively orchestrating these…

Networking and Internet Architecture · Computer Science 2026-03-10 Chen Yang , Jin Zheng , Yang Zhuolin , Lai Pan , Zhang Xiao , Hu Menglan , Yin Haiyan

Large Language Models (LLMs) face challenges for on-device inference due to high memory demands. Traditional methods to reduce memory usage often compromise performance and lack adaptability. We propose FlexInfer, an optimized offloading…

Operating Systems · Computer Science 2025-03-07 Hongchao Du , Shangyu Wu , Arina Kharlamova , Nan Guan , Chun Jason Xue

We present a multi-objective evolutionary optimization algorithm that uses Gaussian process (GP) regression-based models to select trial solutions in a multi-generation iterative procedure. In each generation, a surrogate model is…

Neural and Evolutionary Computing · Computer Science 2020-05-22 Xiaobiao Huang , Minghao Song , Zhe Zhang

Edge computing has been an efficient way to provide prompt and near-data computing services for resource-and-delay sensitive IoT applications via computation offloading. Effective computation offloading strategies need to comprehensively…

Networking and Internet Architecture · Computer Science 2021-09-24 Sheng Yue , Ju Ren , Nan Qiao , Yongmin Zhang , Hongbo Jiang , Yaoxue Zhang , Yuanyuan Yang

The rapid expansion of AI inference services in the cloud necessitates a robust scalability solution to manage dynamic workloads and maintain high performance. This study proposes a comprehensive scalability optimization framework for cloud…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-23 Yihong Jin , Ze Yang

Task offloading is a promising technology to exploit the benefits of fog computing. An effective task offloading strategy is needed to utilize the computational resources efficiently. In this paper, we endeavor to seek an online task…

Networking and Internet Architecture · Computer Science 2018-04-25 Zhaowei Zhu , Ting Liu , Shengda Jin , Xiliang Luo

Multi-access Edge Computing (MEC) is an enabling technology to leverage new network applications, such as virtual/augmented reality, by providing faster task processing at the network edge. This is done by deploying servers closer to the…

Networking and Internet Architecture · Computer Science 2023-11-28 Gabriel F. C. de Queiroz , José F. de Rezende , Valmir C. Barbosa

By exploiting the superiority of non-orthogonal multiple access (NOMA), NOMA-aided mobile edge computing (MEC) can provide scalable and low-latency computing services for the Internet of Things. However, given the prevalent stochasticity of…

Information Theory · Computer Science 2021-07-01 Meihui Hua , Hui Tian , Xinchen Lyu , Wanli Ni , Gaofeng Nie

Resource-constrained edge deployments demand AI solutions that balance high performance with stringent compute, memory, and energy limitations. In this survey, we present a comprehensive overview of the primary strategies for accelerating…

Machine Learning · Computer Science 2025-01-30 Jacob Sander , Achraf Cohen , Venkat R. Dasari , Brent Venable , Brian Jalaian

The burgeoning and ubiquitous deployment of the Internet of Things (IoT) landscape struggles with ultra-low latency demands for computation-intensive tasks in massive connectivity scenarios. In this paper, we propose an innovative uplink…

Networking and Internet Architecture · Computer Science 2026-02-10 Yuang Chen , Fengqian Guo , Chang Wu , Mingyu Peng , Hancheng Lu , Chang Wen Chen

Despite rapid advancements in sensor networks, conventional battery-powered sensor networks suffer from limited operational lifespans and frequent maintenance requirements that severely constrain their deployment in remote and inaccessible…

Networking and Internet Architecture · Computer Science 2025-10-27 Bowei Tong , Hui Kang , Jiahui Li , Geng Sun , Jiacheng Wang , Yaoqi Yang , Bo Xu , Dusit Niyato

Inference-time alignment provides an efficient alternative for aligning LLMs with humans. However, these approaches still face challenges, such as limited scalability due to policy-specific value functions and latency during the inference…

Computation and Language · Computer Science 2025-05-27 Ruizhe Chen , Wenhao Chai , Zhifei Yang , Xiaotian Zhang , Joey Tianyi Zhou , Tony Quek , Soujanya Poria , Zuozhu Liu

With the development of Internet-of-Things (IoT), we witness the explosive growth in the number of devices with sensing, computing, and communication capabilities, along with a large amount of raw data generated at the network edge. Mobile…

Information Theory · Computer Science 2021-11-23 Zezu Liang , Hanbiao Chen , Yuan Liu , Fangjiong Chen

Large language models (LLMs) offer significant potential for intelligent mobile services but are computationally intensive for resource-constrained devices. Mobile edge computing (MEC) allows such devices to offload inference tasks to edge…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Yumin Kim , Hyeonsu Lyu , Minjae Lee , Hyun Jong Yang

We study a multi-objective scheduling problem on two dedicated processors. The aim is to minimize simultaneously the makespan, the total tardiness and the total completion time. This NP-hard problem requires the use of well-adapted methods.…

Data Structures and Algorithms · Computer Science 2021-01-05 Adel Kacem , Abdelaziz Dammak

Although multi-access edge computing (MEC) has allowed for computation offloading at the network edge, weak wireless signals in the radio access network caused by obstacles and high network load are still preventing efficient edge…

Signal Processing · Electrical Eng. & Systems 2023-12-15 Elie El Haber , Mohamed Elhattab , Chadi Assi , Sanaa Sharafeddine , Kim Khoa Nguyen

Modern generative AI models, such as diffusion and flow matching models, can sample from rich data distributions. However, many applications, especially in science and engineering, require more than drawing samples from the model…

In warehouses, order picking is known to be the most labor-intensive and costly task in which the employees account for a large part of the warehouse performance. Hence, many approaches exist, that optimize the order picking process based…

Neural and Evolutionary Computing · Computer Science 2021-12-23 Veronika Lesch , Patrick B. M. Müller , Moritz Krämer , Samuel Kounev , Christian Krupitzer