English
Related papers

Related papers: Universality of Load Balancing Schemes on Diffusio…

200 papers

We consider a load balancing system comprised of a fixed number of single server queues, operating under the well-known Join-the-Shortest Queue policy, and where jobs/customers are impatient and abandon if they do not receive service after…

Probability · Mathematics 2023-04-05 Prakirt Raj Jhunjhunwala , Martin Zubeldia , Siva Theja Maguluri

The Join-the-Shortest-Queue (JSQ) load balancing scheme is known to minimise the average response time of jobs in homogeneous systems with identical servers. However, for {\em heterogeneous} systems with servers having different processing…

Probability · Mathematics 2024-10-22 Sanidhay Bhambay , Burak Büke , Arpan Mukhopadhyay

We study $n$ parallel queues in an extreme heavy-traffic regime: each server works at rate $n$, while jobs arrive to a dispatcher at rate $n^2-(a-b)\sqrt{n}$, with fixed $a>b>0$. Arrivals are routed by a marginal join-the-shortest-queue…

Probability · Mathematics 2026-05-19 Sayan Banerjee , Amarjit Budhiraja , Eva Loeser

Consider a system of $N$ parallel single-server queues with unit-exponential service time distribution and a single dispatcher where tasks arrive as a Poisson process of rate $\lambda(N)$. When a task arrives, the dispatcher assigns it to…

Probability · Mathematics 2020-02-27 Sayan Banerjee , Debankur Mukherjee

We study load balancing for a queueing system where parallel stations are distant from customers. In the presence of traveling delays, the join-the-shortest-queue (JSQ) policy induces queue length oscillations and prolongs the mean waiting…

Probability · Mathematics 2025-05-09 Shuangchi He , Yunfang Yang , Yao Yu

We consider the load balancing system under Poisson arrivals, exponential services, and homogeneous servers. Upon arrival, a job is to be routed to one of the servers, where it is queued until service. We consider the Power-of-$d$ choices…

Probability · Mathematics 2025-03-26 Sushil Mahavir Varma , Francisco Castro , Siva Theja Maguluri

In this paper we propose a highly accurate approximate performance analysis of a heterogeneous server system with a processor sharing service discipline and a general job-size distribution under a generalized join the shortest queue (GJSQ)…

Probability · Mathematics 2017-03-20 Jori Selen , Ivo J. B. F. Adan , Stella Kapodistria

Consider a system of identical server pools where tasks with exponentially distributed service times arrive as a time-inhomogenenous Poisson process. An admission threshold is used in an inner control loop to assign incoming tasks to server…

Probability · Mathematics 2024-04-08 Diego Goldsztajn , Sem C. Borst , Johan S. H. van Leeuwaarden

A parallel server system with $n$ identical servers is considered. The service time distribution has a finite mean $1/\mu$, but otherwise is arbitrary. Arriving customers are be routed to one of the servers immediately upon arrival.…

Probability · Mathematics 2017-02-15 Sergey Foss , Alexander Stolyar

This paper studies a diffusion model that arises as the limit of a queueing system scheduling problem in the asymptotic heavy traffic regime of Halfin and Whitt. The queueing system consists of several customer classes and many servers…

Probability · Mathematics 2007-05-23 Rami Atar

Join-the-shortest queue (JSQ) and its variants have often been used in solving load balancing problems. The aim of such policies is to minimize the average system occupation, e.g., the customer's system time. In this work we extend the…

Networking and Internet Architecture · Computer Science 2025-02-11 Andrea Fox , Francesco De Pellegrini , Eitan Altman , Arnob Ghosh , Ness Shroff

We consider a system of N queues with decentralized load balancing such as power-of-D strategies(where D may depend on N) and generic scheduling disciplines. To measure the dependence of the queues, we use the clan of ancestors, a technique…

Probability · Mathematics 2018-09-17 Maria Clara Fittipaldi , Matthieu Jonckheere , Sergio I. Lopez

Distributed load balancing is the act of allocating jobs among a set of servers as evenly as possible. There are mainly two versions of the load balancing problem that have been studied in the literature: static and dynamic. The static…

Performance · Computer Science 2020-11-04 Nitish K. Panigrahy , Thirupathaiah Vasantam , Prithwish Basu , Don Towsley

Queues that feature multiple entities arriving simultaneously are among the oldest models in queueing theory, and are often referred to as "batch" (or, in some cases, "bulk") arrival queueing systems. In this work we study the affect of…

Probability · Mathematics 2019-02-05 Andrew Daw , Jamol Pender

We study a double-ended queue which consists of two classes of customers. Whenever there is a pair of customers from both classes, they are matched and leave the system immediately. The matching follows first-come-first-serve principle. If…

Probability · Mathematics 2016-07-18 Xin Liu

Nowadays, the efficiency and even the feasibility of traditional load-balancing policies are challenged by the rapid growth of cloud infrastructure and the increasing levels of server heterogeneity. In such heterogeneous systems with many…

Networking and Internet Architecture · Computer Science 2020-03-10 Shay Vargaftik , Isaac Keslassy , Ariel Orda

The Join-the-Shortest-Queue (JSQ) policy is among the most widely used load balancing algorithms and has been extensively studied. However, an exact characterization of the system behavior remains challenging. Most prior research has…

Probability · Mathematics 2026-02-12 Yuanzhe Ma , Siva Theja Maguluri

Randomized load balancing networks arise in a variety of applications, and allow for efficient sharing of resources, while being relatively easy to implement. We consider a network of parallel queues in which incoming jobs with independent…

Probability · Mathematics 2017-10-13 Reza Aghajani , Kavita Ramanan

We introduce a general framework for the mean-field analysis of large-scale load-balancing networks with general service distributions. Specifically, we consider a parallel server network that consists of N queues and operates under the…

Probability · Mathematics 2015-12-23 Reza Aghajani , Xingjie Li , Kavita Ramanan

In geographically-distributed systems, communication latencies are non-negligible. The perceived processing time of a request is thus composed of the time needed to route the request to the server and the true processing time. Once a…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-02-11 Piotr Skowron , Krzysztof Rzadca