English
Related papers

Related papers: Topology-aware Preemptive Scheduling for Co-locate…

200 papers

Recent years have witnessed a rapid growth of distributed machine learning (ML) frameworks, which exploit the massive parallelism of computing clusters to expedite ML training. However, the proliferation of distributed ML frameworks also…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-16 Menglu Yu , Jia Liu , Chuan Wu , Bo Ji , Elizabeth S. Bentley

The growing demand for large language models (LLMs) requires serving systems to handle many concurrent requests with diverse service level objectives (SLOs). This exacerbates head-of-line (HoL) blocking during the compute-intensive prefill…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-19 Chia-chi Hsieh , Zan Zong , Xinyang Chen , Jianjiang Li , Jidong Zhai , Lijie Wen

Large language models have been widely deployed in various applications, encompassing both interactive online tasks and batched offline tasks. Given the burstiness and latency sensitivity of online tasks, over-provisioning resources is…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-08 Zhibin Wang , Shipeng Li , Xue Li , Yuhang Zhou , Zhonghui Zhang , Zibo Wang , Rong Gu , Chen Tian , Kun Yang , Sheng Zhong

We study offline scheduling for large language model (LLM) serving under a fixed KV-cache memory budget, where requests have heterogeneous prompt (prefill) and response (decode) lengths. Prompt tokens determine initial KV usage, and each…

Optimization and Control · Mathematics 2026-02-11 Meixuan Wang , Yinyu Ye , Zijie Zhou

Coflow scheduling models communication requests in parallel computing frameworks where multiple data flows between shared resources need to be completed before computation can continue. In this paper, we introduce Path-based Coflow…

Data Structures and Algorithms · Computer Science 2020-02-18 Alexander Eckl , Luisa Peter , Maximilian Schiffer , Susanne Albers

We consider the following shared-resource scheduling problem: Given a set of jobs $J$, for each $j\in J$ we must schedule a job-specific processing volume of $v_j>0$. A total resource of $1$ is available at any time. Jobs have a resource…

Data Structures and Algorithms · Computer Science 2023-10-11 Christoph Damerius , Peter Kling , Florian Schneider

Large Language Models (LLMs) are rapidly becoming critical infrastructure for enterprise applications, driving unprecedented demand for GPU-based inference services. A key operational challenge arises from the two-phase nature of LLM…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-04 Ruihan Lin , Zezhen Ding , Zean Han , Jiheng Zhang

Load balancing is vital for the efficient and long-term operation of cloud data centers. With virtualization, post (reactive) migration of virtual machines after allocation is the traditional way for load balancing and consolidation.…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-20 Wenhong Tian , Minxian Xu , Guangyao Zhou , Kui Wu , Chengzhong Xu , Rajkumar Buyya

Edge computing has become a very popular service that enables mobile devices to run complex tasks with the help of network-based computing resources. However, edge clouds are often resource-constrained, which makes resource allocation a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-02 Caroline Rublein , Fidan Mehmeti , Mark Mahon , Thomas F. La Porta

The scaling of transformer-based Large Language Models (LLMs) has significantly expanded their context lengths, enabling applications where inputs exceed 100K tokens. Our analysis of a recent Azure LLM inference trace reveals a highly…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-10 Zeyu Zhang , Haiying Shen

Cloud-edge serverless applications or serverless deployments spanning multiple regions introduce the need to govern the scheduling of functions to satisfy their functional constraints or avoid performance degradation. For instance,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-07 Giuseppe De Palma , Saverio Giallorenzo , Jacopo Mauro , Matteo Trentin , Gianluigi Zavattaro

Data load balancing is a challenging task in the P2P systems. Distributed hash table (DHT) abstraction, heterogeneous nodes, and non uniform distribution of objects are the reasons to cause load imbalance in structured P2P overlay networks.…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-16 Seyed Iman Mirrezaei , Javad Shahparian

Deploying million-token Large Language Models (LLMs) is challenging because production workloads are highly heterogeneous, mixing short queries and long documents. This heterogeneity, combined with the quadratic complexity of attention,…

Real-time LLM interactions demand streamed token generations, where text tokens are progressively generated and delivered to users while balancing two objectives: responsiveness (i.e., low time-to-first-token) and steady generation…

Machine Learning · Computer Science 2025-10-06 Junyi Chen , Chuheng Du , Renyuan Liu , Shuochao Yao , Dingtian Yan , Jiang Liao , Shengzhong Liu , Fan Wu , Guihai Chen

Use of multi-path network topologies has become a prominent technique to assert timeliness in terms of age of information (AoI) and to improve resilience to link disruptions in communication systems. However, establishing multiple dedicated…

Information Theory · Computer Science 2025-04-11 Sahan Liyanaarachchi , Sennur Ulukus , Nail Akar

When output token counts can be predicted at submission time (Gan et al., 2026), client-side scheduling against a black-box LLM API becomes semi-clairvoyant: decisions condition on coarse token priors even though the provider's internals…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-09 Renzhong Yuan , Yijun Zeng , Xiaosong Gao , Linxi Yu , Haochun Liao , Han Wang

Clinician scheduling remains a persistent challenge due to limited clinical resources and fluctuating demands. This complexity is especially acute in large academic anesthesiology departments as physicians balance responsibilities across…

Optimization and Control · Mathematics 2025-10-03 Anjali Jha , Wanqing Chen , Maxim Eckmann , Ian Stockwell , Jianwu Wang , Kai Sun

We investigate the problem of designing delay-aware joint flow control, routing, and scheduling algorithms in general multi-hop networks for maximizing network utilization. Since the end-to-end delay performance has a complex dependence on…

Optimization and Control · Mathematics 2015-03-17 Haozhi Xiong , Ruogu Li , Atilla Eryilmaz , Eylem Ekici

Latency-critical services have been widely deployed in cloud environments. For cost-efficiency, multiple services are usually co-located on a server. Thus, run-time resource scheduling becomes the pivot for QoS control in these complicated…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-07 Lei Liu

Allocating resources to distributed machine learning jobs in multi-tenant torus-topology clusters must meet each job's specific placement and communication requirements, which are typically described using shapes. There is an inherent…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-07 Shawn Shuoshuo Chen , Daiyaan Arfeen , Minlan Yu , Peter Steenkiste , Srinivasan Seshan