English
Related papers

Related papers: Practical Efficient Microservice Autoscaling with …

200 papers

Cloud-native architecture is becoming increasingly crucial for today's cloud computing environments due to the need for speed and flexibility in developing applications. It utilizes microservice technology to break down traditional…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-30 Minxian Xu , Lei Yang , Yang Wang , Chengxi Gao , Linfeng Wen , Guoyao Xu , Liping Zhang , Kejiang Ye , Chengzhong Xu

As the cloud infrastructure grows, it becomes more challenging to manage resources in such a massive, diverse, and distributed setting, despite the fact that cloud computing provides computational capabilities on-demand. Due to resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-20 Sukhpal Singh Gill

Service Level Objectives (SLOs) aim to set threshold for service time in cloud services to ensure acceptable quality of service (QoS) and user satisfaction. Currently, many studies consider SLOs as a system resource to be allocated,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-24 Kan Hu , Linfeng Wen , Minxian Xu , Kejiang Ye

Cloud applications are increasingly shifting from large monolithic services, to complex graphs of loosely-coupled microservices. Despite their advantages, microservices also introduce cascading QoS violations in cloud applications, which…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-14 Yu Gan , Mingyu Liang , Sundar Dev , David Lo , Christina Delimitrou

Microservice architecture has transformed traditional monolithic applications into lightweight components. Scaling these lightweight microservices is more efficient than scaling servers. However, scaling microservices still faces the…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-06 Linfeng Wen , Minxian Xu , Sukhpal Singh Gill , Muhammad Hafizhuddin Hilman , Satish Narayana Srirama , Kejiang Ye , Chengzhong Xu

Autoscaling is a technology that automatically scales resources for applications without human intervention to ensure runtime Quality of Service (QoS) while reducing costs. However, user-facing cloud applications serve dynamic workloads…

Software Engineering · Computer Science 2026-03-03 Chunyang Meng , Haogang Tong , Tianyang Wu , Maolin Pan , Yang Yu , Yi Jiang

In previous work a novel Edge Lightweight Searchable Attribute-based encryption (ELSA) method was proposed to support Industry 4.0 and specifically Industrial Internet of Things applications. In this paper, we aim to improve ELSA by…

Machine Learning · Computer Science 2022-09-23 Jawhara Aljabri , Anna Lito Michala , Jeremy Singer , Ioannis Vourganas

In cloud computing resource management plays a significant role in data centres and it is directly dependent on the application workload. Various services such as Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-26 Smruti Rekha Swain , Ashutosh Kumar Singh , Chung Nan Lee

Machine learning (ML) is increasingly applied to optimize system performance in tasks such as resource management and network simulation. Unlike traditional ML tasks (e.g., image classification), networked systems often operate in…

Machine Learning · Computer Science 2026-05-15 Daiyang Yu , Xinyu Chen , Yihan Zhang , Yan Liang , Yaqi Qiao , Fan Lai

The proliferation of large language models (LLMs) has driven the adoption of Mixture-of-Experts (MoE) architectures as a promising solution to scale model capacity while controlling computational costs. However, deploying MoE models in…

Networking and Internet Architecture · Computer Science 2025-08-14 Muqing Li , Ning Li , Xin Yuan , Wenchao Xu , Quan Chen , Song Guo , Haijun Zhang

Modern cloud-native applications built on microservice architectures present unprecedented challenges for system monitoring and alerting. Site Reliability Engineers (SREs) face the daunting challenge of defining effective monitoring…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-29 Akanksha Singal , Divya Pathak , Kaustabha Ray , Felix George , Mudit Verma , Pratibha Moogi

Cloud applications are increasingly shifting from large monolithic services to complex graphs of loosely-coupled microservices. Despite the advantages of modularity and elasticity microservices offer, they also complicate cluster management…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-05 Yu Gan , Mingyu Liang , Sundar Dev , David Lo , Christina Delimitrou

AI-enabled systems are subjected to various types of runtime uncertainties, ranging from dynamic workloads, resource requirements, model drift, etc. These uncertainties have a big impact on the overall Quality of Service (QoS). This is…

Software Engineering · Computer Science 2026-02-04 Hemang Jain , Divyansh Pandey , Karthik Vaidhyanathan

FaaS introduces a lightweight, function-based cloud execution model that finds its relevance in a range of applications like IoT-edge data processing and anomaly detection. While cloud service providers offer a near-infinite function…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-13 Siddharth Agarwal , Maria A. Rodriguez , Rajkumar Buyya

Many cloud applications are migrated from the monolithic model to a microservices framework in which hundreds of loosely-coupled microservices run concurrently, with significant benefits in terms of scalability, rapid development,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-18 Quintin Fettes , Avinash Karanth , Razvan Bunescu , Brandon Beckwith , Sreenivas Subramoney

Modern AESA technology enables RF systems to not only perform various radar, communication and electronic warfare tasks on a single aperture, but even to execute multiple tasks concurrently. These capabilities increase system complexity and…

Signal Processing · Electrical Eng. & Systems 2025-03-06 Sebastian Durst , Kilian Barth , Tobias Müller , Pascal Marquardt

Autoscaling is a critical component for efficient resource utilization with satisfactory quality of service (QoS) in cloud computing. This paper investigates proactive autoscaling for widely-used scaling-per-query applications where scaling…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-20 Huajie Qian , Qingsong Wen , Liang Sun , Jing Gu , Qiulin Niu , Zhimin Tang

Foundation models (FMs) unlock unprecedented multimodal and multitask intelligence, yet their cloud-centric deployment precludes real-time responsiveness and compromises user privacy. Meanwhile, monolithic execution at the edge remains…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-28 Juan Zhu , Zixin Wang , Shenghui Song , Jun Zhang , Khaled Ben Letaief

Mobile edge computing (MEC) is an emerging paradigm that mobile devices can offload the computation-intensive or latency-critical tasks to the nearby MEC servers, so as to save energy and extend battery life. Unlike the cloud server, MEC…

Information Theory · Computer Science 2018-03-21 Kang Cheng , Yinglei Teng , Weiqi Sun , An Liu , Xianbin Wang

Mixture-of-Experts (MoE) models challenge serving infrastructures with dynamic, sparse expert utilization, causing instability on conventional systems designed for dense architectures. We propose EaaS, a novel serving system to enable…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-23 Ziming Liu , Boyu Tian , Guoteng Wang , Zhen Jiang , Peng Sun , Zhenhua Han , Tian Tang , Xiaohe Hu , Yanmin Jia , Yan Zhang , He Liu , Mingjun Zhang , Yiqi Zhang , Qiaoling Chen , Shenggan Cheng , Mingyu Gao , Yang You , Siyuan Feng