English
Related papers

Related papers: Optimal Scheduling Algorithms for LLM Inference: T…

200 papers

In Large Language Model (LLM) inference, the output length of an LLM request is typically regarded as not known a priori. Consequently, most LLM serving systems employ a simple First-come-first-serve (FCFS) scheduling strategy, leading to…

Machine Learning · Computer Science 2024-08-29 Yichao Fu , Siqi Zhu , Runlong Su , Aurick Qiao , Ion Stoica , Hao Zhang

Large Language Model (LLM) inference in production must meet stringent service-level objectives for both time-to-first-token (TTFT) and time-between-token (TBT) while maximizing throughput under fixed compute, memory, and interconnect…

Machine Learning · Computer Science 2026-04-17 Gunjun Lee , Jiwon Kim , Jaiyoung Park , Younjoo Lee , Jung Ho Ahn

Augmented Large Language Models (LLMs) enhance the capabilities of standalone LLMs by integrating external data sources through API calls. In interactive LLM applications, efficient scheduling is crucial for maintaining low request…

Machine Learning · Computer Science 2024-10-29 Rana Shahout , Cong Liang , Shiji Xin , Qianru Lao , Yong Cui , Minlan Yu , Michael Mitzenmacher

Speculative decoding accelerates Large Language Model (LLM) inference by employing a small speculative model (SSM) to generate multiple candidate tokens and verify them using the LLM in parallel. This technique has been widely integrated…

Computation and Language · Computer Science 2025-05-26 Ruixiao Li , Fahao Chen , Peng Li

Code Large Language Models (CodeLLMs) are increasingly integrated into modern software development workflows, yet efficiently serving them in resource-constrained, self-hosted environments remains a significant challenge. Existing LLM…

Software Engineering · Computer Science 2025-06-26 Shi Chang , Boyuan Chen , Kishanthan Thangarajah , Hanan Lutfiyya , Ahmed E. Hassan

Efficient scheduling is crucial for interactive Large Language Model (LLM) applications, where low request completion time directly impacts user engagement. Size-based scheduling algorithms like Shortest Remaining Process Time (SRPT) aim to…

Machine Learning · Computer Science 2024-10-03 Rana Shahout , Eran Malach , Chunwei Liu , Weifan Jiang , Minlan Yu , Michael Mitzenmacher

Context retrieval systems for LLM inference face a critical challenge: high retrieval latency creates a fundamental tension between waiting for complete context (poor time-to-first-token) and proceeding without it (reduced quality).…

Databases · Computer Science 2026-05-19 Rajveer Bachkaniwala , Chengqi Luo , Richard So , Divya Mahajan , Kexin Rong

Large Language Models (LLMs) are rapidly becoming critical infrastructure for enterprise applications, driving unprecedented demand for GPU-based inference services. A key operational challenge arises from the two-phase nature of LLM…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-04 Ruihan Lin , Zezhen Ding , Zean Han , Jiheng Zhang

In production environments, large language model (LLM) serving is required to meet stringent service-level objectives (SLOs) amid highly variable request patterns. In practice, request lengths follow a long-tail distribution, which gives…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-26 Qipeng Wang

To schedule LLM inference, the \textit{shortest job first} (SJF) principle is favorable by prioritizing requests with short output lengths to avoid head-of-line (HOL) blocking. Existing methods usually predict a single output length for…

Machine Learning · Computer Science 2026-05-26 Haoyu Zheng , Yongqiang Zhang , Fangcheng Fu , Xiaokai Zhou , Hao Luo , Hongchao Zhu , Yuanyuan Zhu , Hao Wang , Xiao Yan , Jiawei Jiang

Transformer-based large language model (LLM) inference serving is now the backbone of many cloud services. LLM inference consists of a prefill phase and a decode phase. However, existing LLM deployment practices often overlook the distinct…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-23 Cunchen Hu , Heyang Huang , Liangliang Xu , Xusheng Chen , Jiang Xu , Shuang Chen , Hao Feng , Chenxi Wang , Sa Wang , Yungang Bao , Ninghui Sun , Yizhou Shan

Inference-time scaling has emerged as a powerful way to improve large language model (LLM) performance by generating multiple candidate responses and selecting among them. However, existing work on dynamic allocation for test-time compute…

Machine Learning · Computer Science 2025-09-15 Jenny Y. Huang , Mehul Damani , Yousef El-Kurdi , Ramon Astudillo , Wei Sun

Meeting stringent Time-To-First-Token (TTFT) requirements is crucial for LLM applications. To improve efficiency, modern LLM serving systems adopt disaggregated architectures with diverse parallelisms, introducing complex multi-stage…

Networking and Internet Architecture · Computer Science 2026-03-19 Yijun Sun , Xudong Liao , Songrun Xie , Hao Chen , Han Tian , Wenxue Li , Yiming Zhang , Kai Chen

The integration of Large Language Models (LLMs) into applications ranging from interactive chatbots to multi-agent systems has introduced a wide spectrum of service-level objectives (SLOs) for responsiveness. These include latency-sensitive…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-23 Wei Zhang , Zhiyu Wu , Yi Mu , Rui Ning , Banruo Liu , Nikhil Sarda , Myungjin Lee , Fan Lai

The rapid growth of large language model (LLM) services imposes increasing demands on distributed GPU inference infrastructure. Most existing scheduling systems follow a reactive paradigm, relying solely on the current system state to make…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-17 Chengze Du , Zhiwei Yu , Heng Xu , Haojie Wang , Bo liu , Jialong Li

Large language models (LLMs) iteratively generate text token by token, with memory usage increasing with the length of generated token sequences. Since the request generation length is generally unpredictable, it is difficult to estimate…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-11 Ke Cheng , Wen Hu , Zhi Wang , Hongen Peng , Jianguo Li , Sheng Zhang

The integration of AI-assisted coding tools within development environments drastically reduces development time, and allows developers to focus more on creative and critical aspects of software engineering through the use of Code Large…

Software Engineering · Computer Science 2025-03-26 Kishanthan Thangarajah , Arthur Leung , Boyuan Chen , Ahmed E. Hassan

Large Language Models (LLMs) are becoming the backbone of modern cloud services, yet their inference costs are dominated by GPU energy. Unlike traditional GPU workloads, LLM inference has two stages with different characteristics: the…

Performance · Computer Science 2025-08-25 Qunyou Liu , Darong Huang , Marina Zapater , David Atienza

Large language models (LLMs) are increasingly deployed under the Model-as-a-Service (MaaS) paradigm. To meet stringent quality-of-service (QoS) requirements, existing LLM serving systems disaggregate the prefill and decode phases of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-20 Ao Xu , Han Zhao , Weihao Cui , Quan Chen , Yukang Chen , Shulai Zhang , Shuang Chen , Jiemin Jiang , Zhibin Yu , Minyi Guo

In the realm of Large Language Model (LLM) inference, the inherent structure of transformer models coupled with the multi-GPU tensor parallelism strategy leads to a sequential execution of computation and communication. This results in…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-18 Bin Xiao , Lei Su