English
Related papers

Related papers: Hierarchical Prediction-based Management for LMaaS…

200 papers

Large language models (LLMs) are increasingly deployed under the Model-as-a-Service (MaaS) paradigm. To meet stringent quality-of-service (QoS) requirements, existing LLM serving systems disaggregate the prefill and decode phases of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-20 Ao Xu , Han Zhao , Weihao Cui , Quan Chen , Yukang Chen , Shulai Zhang , Shuang Chen , Jiemin Jiang , Zhibin Yu , Minyi Guo

LLM inference serving typically scales out with a two-tier architecture: a cluster router distributes requests to multiple inference engines, each of which then in turn performs its own internal scheduling. However, this commonly used…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-02 Yue Zhang , Yuansheng Chen , Xuan Mo , Alex Xi , Jialun Li , WeiGang Wu

The rapid rise of Large Language Models (LLMs) has revolutionized various artificial intelligence (AI) applications, from natural language processing to code generation. However, the computational demands of these models, particularly in…

Existing large language model (LLM) serving systems typically employ Prefill-Decode disaggregated architecture to prevent computational interference between the prefill and decode phases. However, in real-world LLM serving scenarios,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-07 Yu Wu , Tongxuan Liu , Yuting Zeng , Siyu Wu , Jun Xiong , Xianzhe Dong , Hailong Yang , Ke Zhang , Jing Li

Computing servers have played a key role in developing and processing emerging compute-intensive applications in recent years. Consolidating multiple virtual machines (VMs) inside one server to run various applications introduces severe…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-29 Darong Huang , Luis Costero , Ali Pahlevan , Marina Zapater , David Atienza

Traffic flow forecasting aims to predict future traffic flows based on the historical traffic conditions and the road network. It is an important problem in intelligent transportation systems, with a plethora of methods been proposed.…

Machine Learning · Computer Science 2025-08-04 Yusheng Zhao , Xiao Luo , Haomin Wen , Zhiping Xiao , Wei Ju , Ming Zhang

The high computational and memory requirements of generative large language models (LLMs) make it challenging to serve them cheaply. This paper aims to reduce the monetary cost for serving LLMs by leveraging preemptible GPU instances on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-28 Xupeng Miao , Chunan Shi , Jiangfei Duan , Xiaoli Xi , Dahua Lin , Bin Cui , Zhihao Jia

Recent studies have shown that carefully designed workflows coordinating large language models(LLMs) significantly enhance task-solving capabilities compared to using a single model. While an increasing number of works focus on autonomous…

Artificial Intelligence · Computer Science 2025-09-19 Yi Lin , Lujin Zhao , Yijie Shi

With the widespread adoption of 5G and Internet of Things (IoT) technologies, the low latency provided by edge computing has great importance for real-time processing. However, managing numerous simultaneous service requests poses a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-17 Wang Yatong , Pei Yuchen , Zhao Yuqi

Despite existing work in machine learning inference serving, ease-of-use and cost efficiency remain challenges at large scales. Developers must manually search through thousands of model-variants -- versions of already-trained models that…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-07 Francisco Romero , Qian Li , Neeraja J. Yadwadkar , Christos Kozyrakis

As the demand for more personalized recommendation grows and a dramatic boom in commercial scenarios arises, the study on multi-scenario recommendation (MSR) has attracted much attention, which uses the data from all scenarios to…

Information Retrieval · Computer Science 2025-08-26 Yuhao Wang , Yichao Wang , Zichuan Fu , Xiangyang Li , Xiangyu Zhao , Huifeng Guo , Ruiming Tang

An effective auto-scaling framework is essential for microservices to ensure performance stability and resource efficiency under dynamic workloads. As revealed by many prior studies, the key to efficient auto-scaling lies in accurately…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-25 Qin Hua , Dingyu Yang , Shiyou Qian , Jian Cao , Guangtao Xue , Minglu Li

Large Language Models (LLMs) play a critical role in emerging agentic applications, where the timely completion of each entire inference is critical. Meanwhile, agentic LLM inferences are increasingly served on heterogeneous GPUs in…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-19 Boxiao Du , Boning Huangfu , Yizhou Luo , Chen Chen , Zijun Li , Minchen Yu , Xiaoyi Fan , Minyi Guo

While traditional optimization and scheduling schemes are designed to meet fixed, predefined system requirements, future systems are moving toward user-driven approaches and personalized services, aiming to achieve high…

Computation and Language · Computer Science 2024-11-15 Thomas Mongaillard , Samson Lasaulce , Othman Hicheur , Chao Zhang , Lina Bariah , Vineeth S. Varma , Hang Zou , Qiyang Zhao , Merouane Debbah

Large language models (LLMs) are increasingly deployed as AI agents that operate in short reasoning-action loops, interleaving model computation with external calls. Unlike traditional chat applications, these agentic workloads require…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-12 Yuning Zhang , Yan Yan , Nan Yang , Dong Yuan

Large Language Models (LLMs) demonstrate substantial potential across a diverse array of domains via request serving. However, as trends continue to push for expanding context sizes, the autoregressive nature of LLMs results in highly…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-08 Bin Lin , Chen Zhang , Tao Peng , Hanyu Zhao , Wencong Xiao , Minmin Sun , Anmin Liu , Zhipeng Zhang , Lanbo Li , Xiafei Qiu , Shen Li , Zhigang Ji , Tao Xie , Yong Li , Wei Lin

Applications are moving away from monolithic designs to microservice and serverless architectures, where fleets of lightweight and independently deployable components run on public clouds. Autoscaling serves as the primary control mechanism…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-06 Haoyu Bai , Muhammed Tawfiqul Islam , Minxian Xu , Rajkumar Buyya

The growing complexity of power systems has made accurate load forecasting more important than ever. An increasing number of advanced load forecasting methods have been developed. However, the static design of current methods offers no…

Machine Learning · Computer Science 2025-05-23 Yu Zuo , Dalin Qin , Yi Wang

Large language models (LLMs) iteratively generate text token by token, with memory usage increasing with the length of generated token sequences. Since the request generation length is generally unpredictable, it is difficult to estimate…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-11 Ke Cheng , Wen Hu , Zhi Wang , Hongen Peng , Jianguo Li , Sheng Zhang

The widespread adoption of Large Language Models (LLMs) has enabled diverse applications with very different latency requirements. Existing LLM serving frameworks rely on siloed infrastructure with coarse-grained workload segregation --…

Machine Learning · Computer Science 2025-03-31 Kanishk Goel , Jayashree Mohan , Nipun Kwatra , Ravi Shreyas Anupindi , Ramachandran Ramjee