English
Related papers

Related papers: Hyper-Scalable JSQ with Sparse Feedback

200 papers

We present an analysis of large-scale load balancing systems, where the processing time distribution of tasks depends on both the task and server types. Our study focuses on the asymptotic regime, where the number of servers and task types…

Probability · Mathematics 2023-06-19 Zhisheng Zhao , Debankur Mukherjee

We consider a large-scale service system where incoming tasks have to be instantaneously dispatched to one out of many parallel server pools. The user-perceived performance degrades with the number of concurrent tasks and the dispatcher…

Efficiently exploiting servers in data centers requires performance analysis methods that account not only for the stochastic nature of demand but also for server heterogeneity. Although several recent works proved optimality results for…

Networking and Internet Architecture · Computer Science 2021-09-03 Mark van der Boor , Céline Comte

Randomized load balancing networks arise in a variety of applications, and allow for efficient sharing of resources, while being relatively easy to implement. We consider a network of parallel queues in which incoming jobs with independent…

Probability · Mathematics 2017-10-13 Reza Aghajani , Kavita Ramanan

We consider a load balancing system comprised of a fixed number of single server queues, operating under the well-known Join-the-Shortest Queue policy, and where jobs/customers are impatient and abandon if they do not receive service after…

Probability · Mathematics 2023-04-05 Prakirt Raj Jhunjhunwala , Martin Zubeldia , Siva Theja Maguluri

In an overloaded FaaS cluster, individual worker nodes strain under lengthening queues of requests. Although the cluster might be eventually horizontally-scaled, adding a new node takes dozens of seconds. As serving applications are tuned…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-01 Paweł Żuk , Bartłomiej Przybylski , Krzysztof Rzadca

Recent workload measurements in Google data centers provide an opportunity to challenge existing models and, more broadly, to enhance the understanding of dispatching policies in computing clusters. Through extensive data-driven…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-27 Mert Yildiz , Alexey Rolich , Andrea Baiocchi

The Join-the-Shortest Queue (JSQ) policy is a classical benchmark for the performance of many-server queueing systems due to its strong optimality properties. While the exact analysis of the JSQ policy is an open question to date, even…

Probability · Mathematics 2025-05-27 Zhisheng Zhao , Sayan Banerjee , Debankur Mukherjee

In queueing systems, effective scheduling algorithms are essential for optimizing performance. Optimal scheduling for the M/G/k queue has been explored in the heavy traffic limit, but much remains unknown in the intermediate load regime. In…

Performance · Computer Science 2025-12-09 Ziyuan Wang , Izzy Grosof

This paper presents Block, a distributed scheduling framework designed to optimize load balancing and auto-provisioning across instances in large language model serving frameworks by leveraging contextual information from incoming requests.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-14 Wei Da , Evangelia Kalyvianaki

Load Balancing is a fundamental technology for scaling cloud infrastructure. It enables systems to distribute incoming traffic across backend servers using predefined algorithms such as round robin, weighted round robin, least connections,…

Networking and Internet Architecture · Computer Science 2025-05-14 Raju Singh

Traffic load-balancing in datacenters alleviates hot spots and improves network utilization. In this paper, a stable in-network load-balancing algorithm is developed in the setting of software-defined networking. A control plane configures…

Networking and Internet Architecture · Computer Science 2016-12-07 Sucha Supittayapornpong , Michael J. Neely

This paper studies a class of load balancing algorithms for many-server ($N$ servers) systems assuming finite buffer with size $b-1$ (i.e. a server can have at most one job in service and $b-1$ jobs in queue). We focus on steady-state…

Probability · Mathematics 2018-04-10 Xin Liu , Lei Ying

We consider load balancing in a network of caching servers delivering contents to end users. Randomized load balancing via the so-called power of two choices is a well-known approach in parallel and distributed systems. In this framework,…

Information Theory · Computer Science 2017-07-03 Mahdi Jafari Siavoshani , Ali Pourmiri , Seyed Pooya Shariatpanahi

The rapid expansion of AI inference services in the cloud necessitates a robust scalability solution to manage dynamic workloads and maintain high performance. This study proposes a comprehensive scalability optimization framework for cloud…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-23 Yihong Jin , Ze Yang

Our interest lies in load balancing jobs in large scale systems consisting of multiple dispatchers and FCFS servers. In the absence of any information on job sizes, dispatchers typically use queue length information reported by the servers…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-16 Tim Hellemans , Benny Van Houdt

Consider a system with $K$ parallel queues in which the server for each queue processes jobs at rate $n$ and the total arrival rate to the system is $nK-\upsilon \sqrt{n}$ where $\upsilon \in (0, \infty)$ and $n$ is large. We study…

Probability · Mathematics 2024-02-16 Sayan Banerjee , Amarjit Budhiraja , Benjamin Estevez

Current-day data centers and high-volume cloud services employ a broad set of heterogeneous servers. In such settings, client requests typically arrive at multiple entry points, and dispatching them to servers is an urgent distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-27 Guy Goren , Shay Vargaftik , Yoram Moses

Current serverless platforms struggle to optimize resource utilization due to their dynamic and fine-grained nature. Conventional techniques like overcommitment and autoscaling fall short, often sacrificing utilization for practicability or…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-04 Qingyuan Liu , Yanning Yang , Dong Du , Yubin Xia , Ping Zhang , Jia Feng , James Larus , Haibo Chen

We consider a load balancing system consisting of $n$ single-server queues working in parallel, with heterogeneous service rates. Jobs arrive to a central dispatcher, which has to dispatch them to one of the queues immediately upon arrival.…

Performance · Computer Science 2025-10-17 Yishun Luo , Martin Zubeldia