English
Related papers

Related papers: Modular Foundation Model Inference at the Edge: Ne…

200 papers

Smart IoT-based systems often desire continuous execution of multiple latency-sensitive Deep Learning (DL) applications. The edge servers serve as the cornerstone of such IoT-based systems, however, their resource limitations hamper the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-15 SM Zobaed , Ali Mokhtari , Jaya Prakash Champati , Mathieu Kourouma , Mohsen Amini Salehi

Microservice-based architectures enable different aspects of web applications to be created and updated independently, even after deployment. Associated technologies such as service mesh provide application-level fault resilience through…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-02 Fanfei Meng , Lalita Jagadeesan , Marina Thottan

In the last few years, the proliferation of edge and cloud computing infrastructures as well as the increasing number of mobile devices has facilitated the emergence of many novel applications. However, that increase of complexities also…

Software Engineering · Computer Science 2022-03-15 Hai Dinh-Tuan , Felix Beierle

The foundation-model ecosystem remains highly centralized because training requires immense compute resources and is therefore largely limited to large cloud operators. Edge-assisted foundation model training that harnesses spare compute on…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-14 Leyang Xue , Meghana Madhyastha , Myungjin Lee , Amos Storkey , Randal Burns , Mahesh K. Marina

With the advent of ubiquitous deployment of smart devices and the Internet of Things, data sources for machine learning inference have increasingly moved to the edge of the network. Existing machine learning inference platforms typically…

Machine Learning · Computer Science 2022-08-05 Yongji Wu , Matthew Lentz , Danyang Zhuo , Yao Lu

As wireless services and applications become more sophisticated and require faster and higher-capacity networks, there is a need for an efficient management of the execution of increasingly complex tasks based on the requirements of each…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-22 Jungyeon Baek , Georges Kaddoum

Benefiting from expanding cloud infrastructure, deep neural networks (DNNs) today have increasingly high performance when trained in the cloud. Researchers spend months of effort competing for an extra few percentage points of model…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-19 Hang Qiu , Ioanna Vavelidou , Jian Li , Evgenya Pergament , Pete Warden , Sandeep Chinchali , Zain Asgar , Sachin Katti

Transformer-based models have unlocked a plethora of powerful intelligent applications at the edge, such as voice assistant in smart home. Traditional deployment approaches offload the inference workloads to the remote cloud server, which…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-28 Shengyuan Ye , Jiangsu Du , Liekang Zeng , Wenzhong Ou , Xiaowen Chu , Yutong Lu , Xu Chen

Automated incident management is critical for microservice reliability. While recent unified frameworks leverage multimodal data for joint optimization, they unrealistically assume perfect data completeness. In practice, network…

Machine Learning · Computer Science 2026-03-30 Wenzhuo Qian , Hailiang Zhao , Ziqi Wang , Zhipeng Gao , Jiayi Chen , Zhiwei Ling , Shuiguang Deng

In fog-aided cellular systems, content delivery latency can be minimized by jointly optimizing edge caching and transmission strategies. In order to account for the cache capacity limitations at the Edge Nodes (ENs), transmission generally…

Information Theory · Computer Science 2018-03-22 Jingjing Zhang , Osvaldo Simeone

The heterogeneous and distributed nature of the Internet of Things (IoT) is driving the need for extremely fast and fine-grained service provisioning in 5/5+G architectures and beyond. To meet these needs, it is critical to enable efficient…

Networking and Internet Architecture · Computer Science 2018-03-05 Mays AL-Naday , Martin J. Reed , Janne Riihijärvi , Dirk Trossen , Nikolaos Thomos , Mohammed Q. S. Al-Khalidi

Deploying large language models (LLMs) in mobile and edge computing environments is constrained by limited on-device resources, scarce wireless bandwidth, and frequent model evolution. Although edge-cloud collaborative inference with…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-05 Yuchen Li , Rui Kong , Zhonghao Lyu , Qiyang Li , Xinran Chen , Hengyi Cai , Lingyong Yan , Shuaiqiang Wang , Jiashu Zhao , Guangxu Zhu , Linghe Kong , Guihai Chen , Haoyi Xiong , Dawei Yin

Modern Internet services are increasingly leveraging on cloud computing for flexible, elastic and on-demand provision. Typically, Quality of Service (QoS) of cloud-based services can be tuned using different underlying cloud configurations…

Software Engineering · Computer Science 2016-08-16 Tao Chen

Deep Neural Networks are allowing mobile devices to incorporate a wide range of features into user applications. However, the computational complexity of these models makes it difficult to run them effectively on resource-constrained mobile…

Performance · Computer Science 2020-04-02 Samuel S. Ogden , Tian Guo

Mobile edge computing is beneficial to reduce service response time and core network traffic by pushing cloud functionalities to network edge. Equipped with storage and computation capacities, edge nodes can cache services of…

Networking and Internet Architecture · Computer Science 2020-02-05 Xiao Ma , Ao Zhou , Shan Zhang , Shangguang Wang

Multi-access Edge Computing (MEC) is booming as a promising paradigm to push the computation and communication resources from cloud to the network edge to provide services and to perform computations. With container technologies, mobile…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-20 Hailiang Zhao , Shuiguang Deng , Zijie Liu , Jianwei Yin , Schahram Dustdar

Nowadays a wide range of applications is constrained by low-latency requirements that cloud infrastructures cannot meet. Multi-access Edge Computing (MEC) has been proposed as the reference architecture for executing applications closer to…

Software Engineering · Computer Science 2022-05-10 Luciano Baresi , Davide Yi Xian Hu , Giovanni Quattrocchi , Luca Terracciano

Federated learning (FL) enables edge devices to collaboratively train a machine learning model without sharing their raw data. Due to its privacy-protecting benefits, FL has been deployed in many real-world applications. However, deploying…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-16 Zhidong Gao , Zhenxiao Zhang , Yu Zhang , Tongnian Wang , Yanmin Gong , Yuanxiong Guo

We present a framework for performance optimization in serverless edge-cloud platforms using dynamic task placement. We focus on applications for smart edge devices, for example, smart cameras or speakers, that need to perform processing…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-21 Anirban Das , Shigeru Imai , Mike P. Wittie , Stacy Patterson

Maintaining economic efficiency and operational reliability in microgrid energy management systems under cyberattack conditions remains challenging. Most approaches assume non-anomalous measurements, make predictions with unquantified…

Machine Learning · Computer Science 2025-11-25 Oluleke Babayomi , Dong-Seong Kim