English
Related papers

Related papers: Join-the-Shortest Queue Diffusion Limit in Halfin-…

200 papers

Motivated by call center practice, we propose a tractable model for $\mbox{GI}/\mbox{GI}/n+\mbox{GI}$ queues in the efficiency-driven (ED) regime. We use a one-dimensional diffusion process to approximate the virtual waiting time process…

Probability · Mathematics 2015-09-17 Shuangchi He

We study load balancing for a queueing system where parallel stations are distant from customers. In the presence of traveling delays, the join-the-shortest-queue (JSQ) policy induces queue length oscillations and prolongs the mean waiting…

Probability · Mathematics 2025-05-09 Shuangchi He , Yunfang Yang , Yao Yu

We consider the FCFS $GI/GI/n$ queue in the Halfin-Whitt heavy traffic regime, and prove bounds for the steady-state probability of delay (s.s.p.d.) for generally distributed processing times. We prove that there exist $\epsilon_1,…

Probability · Mathematics 2016-09-02 David A. Goldberg

This paper studies many-server limits for multi-server queues that have a phase-type service time distribution and allow for customer abandonment. The first set of limit theorems is for critically loaded $G/Ph/n+GI$ queues, where the…

Probability · Mathematics 2010-11-10 J. G. Dai , Shuangchi He , Tolga Tezcan

Join-the-shortest queue (JSQ) and its variants have often been used in solving load balancing problems. The aim of such policies is to minimize the average system occupation, e.g., the customer's system time. In this work we extend the…

Networking and Internet Architecture · Computer Science 2025-02-11 Andrea Fox , Francesco De Pellegrini , Eitan Altman , Arnob Ghosh , Ness Shroff

In parallel-server systems with a single stream of arrivals (a.k.a. load balancing), Join-the-Shortest-Queue (JSQ) is a popular routing algorithm. There is extensive literature studying this system in various asymptotic regimes, but all…

Probability · Mathematics 2026-03-03 Daniela Hurtado-Lange , Izzy Grosof

We present an overview of scalable load balancing algorithms which provide favorable delay performance in large-scale systems, and yet only require minimal implementation overhead. Aimed at a broad audience, the paper starts with an…

Performance · Computer Science 2017-12-25 Mark van der Boor , Sem C. Borst , Johan S. H. van Leeuwaarden , Debankur Mukherjee

We consider the serve-the-longest-queue discipline for a multiclass queue with buffers of equal size, operating under (i) the conventional and (ii) the Halfin-Whitt heavy traffic regimes, and show that while the queue length process'…

Probability · Mathematics 2016-01-07 Rami Atar , Subhamay Saha

We study a double-ended queue where buyers and sellers arrive to conduct trades. When there is a pair of buyer and seller in the system, they immediately transact a trade and leave. Thus there cannot be non-zero number of buyers and sellers…

Probability · Mathematics 2014-01-22 Xin Liu , Qi Gong , Vidyadhar G. Kulkarni

We consider Markovian multiclass multi-pool networks with heterogeneous server pools, each consisting of many statistically identical parallel servers, where the bipartite graph of customer classes and server pools forms a tree. Customers…

Probability · Mathematics 2019-03-20 Ari Arapostathis , Guodong Pang

The paper studies approximations and control of a processor sharing (PS) server where the service rate depends on the number of jobs occupying the server. The control of such a system is implemented by imposing a limit on the number of jobs…

Systems and Control · Computer Science 2014-09-02 Varun Gupta , Jiheng Zhang

A many-server queueing system is considered in which customers arrive according to a renewal process and have service and patience times that are drawn from two independent sequences of independent, identically distributed random variables.…

Probability · Mathematics 2012-04-30 Weining Kang , Kavita Ramanan

We prove a heavy traffic scaling limit for a shortest remaining processing time queue. We are interested in the case where the processing time distribution has a tail that decays rapidly, i.e., has light tails. In particular, we revisit the…

Probability · Mathematics 2023-11-07 Chunxu Ji , Amber L. Puha

We introduce a "system-wide safety staffing" (SWSS) parameter for multiclass multi-pool networks of any tree topology, Markovian or non-Markovian, in the Halfin-Whitt regime. This parameter can be regarded as the optimal reallocation of the…

Probability · Mathematics 2021-06-17 Hassan Hmedi , Ari Arapostathis , Guodong Pang

We study a double-ended queue which consists of two classes of customers. Whenever there is a pair of customers from both classes, they are matched and leave the system immediately. The matching follows first-come-first-serve principle. If…

Probability · Mathematics 2016-07-18 Xin Liu

We study the $G/\mathit{GI}/\infty$ queue in heavy-traffic using tempered distribution-valued processes which track the age and residual service time of each customer in the system. In both cases, we use the continuous mapping theorem…

Probability · Mathematics 2015-04-22 Josh Reed , Rishi Talreja

This paper studies the diffusion limit for a network of infinite-server queues operating under Markov modulation (meaning that the system's parameters depend on an autonomously evolving background process). In previous papers on (primarily…

Probability · Mathematics 2017-12-13 H. M. Jansen , M. Mandjes , K. De Turck , S. Wittevrongel

We consider processing networks where multiple dispatchers are connected to single-server queues by a bipartite compatibility graph, modeling constraints that are common in data centers and cloud networks due to geographic reasons or data…

Probability · Mathematics 2026-05-01 Diego Goldsztajn , Andres Ferragut

We consider the model of a token-based joint auto-scaling and load balancing strategy, proposed in a recent paper by Mukherjee, Dhara, Borst, and van Leeuwaarden (SIGMETRICS '17, arXiv:1703.08373), which offers an efficient scalable…

Probability · Mathematics 2020-02-27 Debankur Mukherjee , Alexander Stolyar

Given a random variable $N$ with values in ${\mathbb{N}}$, and $N$ i.i.d. positive random variables $\{\mu_k\}$, we consider a queue with renewal arrivals and $N$ exponential servers, where server $k$ serves at rate $\mu_k$, under two work…

Probability · Mathematics 2008-08-22 Rami Atar