English
Related papers

Related papers: Randomized Routing to Remote Queues

200 papers

Load balancing algorithms play a vital role in enhancing performance in data centers and cloud networks. Due to the massive size of these systems, scalability challenges, and especially the communication overhead associated with load…

Probability · Mathematics 2019-03-07 Mark van der Boor , Sem Borst , Johan van Leeuwaarden

We consider a system of $N$ identical server pools and a single dispatcher where tasks arrive as a Poisson process of rate $\lambda(N)$. Arriving tasks cannot be queued, and must immediately be assigned to one of the server pools to start…

Join the shortest queue (JSQ) refers to networks whose incoming jobs are assigned to the shortest queue from among a randomly chosen subset of the queues in the system. After completion of service at the queue, a job leaves the network. We…

Probability · Mathematics 2010-10-11 Maury Bramson

We consider a load balancing system comprised of a fixed number of single server queues, operating under the well-known Join-the-Shortest Queue policy, and where jobs/customers are impatient and abandon if they do not receive service after…

Probability · Mathematics 2023-04-05 Prakirt Raj Jhunjhunwala , Martin Zubeldia , Siva Theja Maguluri

Dispatching policies such as the join shortest queue (JSQ), join smallest work (JSW) and their power of two variants are used in load balancing systems where the instantaneous queue length or workload information at all queues or a subset…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-18 Rooji Jinan , Ajay Badita , Tejas Bodas , Parimal Parag

This work introduces the join the shortest queue policy in the retrial setting. We consider a Markovian single server retrial system with two infinite capacity orbits. An arriving job finding the server busy, it is forwarded to the least…

Probability · Mathematics 2020-10-30 Ioannis Dimitriou

Join-the-Shortest-Queue (JSQ) is the scheduling policy of choice for many network providers, cloud servers and traffic management systems, where individual queues are served under processor sharing (PS) queueing discipline. A numerical…

Performance · Computer Science 2024-05-21 Julianna Bor , Peter G Harrison

The Join-the-Shortest Queue (JSQ) policy is a classical benchmark for the performance of many-server queueing systems due to its strong optimality properties. While the exact analysis of the JSQ policy is an open question to date, even…

Probability · Mathematics 2025-05-27 Zhisheng Zhao , Sayan Banerjee , Debankur Mukherjee

We study a dispatching and pricing problem in two-sided spatial queues with fixed supply, motivated by ride-hailing and robotaxi platforms. Idle drivers queue on one side, waiting to pick up riders, while riders queue on the other, waiting…

Optimization and Control · Mathematics 2026-03-17 Ang Xu , Chiwei Yan

We consider a load balancing system consisting of $n$ single-server queues working in parallel, with heterogeneous service rates. Jobs arrive to a central dispatcher, which has to dispatch them to one of the queues immediately upon arrival.…

Performance · Computer Science 2025-10-17 Yishun Luo , Martin Zubeldia

In this paper, we analyze the performance of random load resampling and migration strategies in parallel server systems. Clients initially attach to an arbitrary server, but may switch server independently at random instants of time in an…

Networking and Internet Architecture · Computer Science 2010-04-12 A. Ganesh , S. Lilienthal , D. Manjunath , A. Proutiere , F. Simatos

Load balancing algorithms play a crucial role in delivering robust application performance in data centers and cloud networks. Recently, strong interest has emerged in Join-the-Idle-Queue (JIQ) algorithms, which rely on tokens issued by…

Probability · Mathematics 2017-06-06 Mark van der Boor , Sem Borst , Johan van Leeuwaarden

In this article, we study the classical shortest queue problem under the influence of malicious attacks, which is relevant to a variety of engineering system including transportation, manufacturing, and communications. We consider a…

Systems and Control · Electrical Eng. & Systems 2019-10-02 Yu Tang , Yining Wen , Li Jin

We consider a queueing system consisting of two non-identical exponential servers, where each server has its own dedicated queue and serves the customers in that queue FCFS. Customers arrive according to a Poisson process and join the queue…

Probability · Mathematics 2017-03-20 Jori Selen , Ivo J. B. F. Adan , Stella Kapodistria , Johan S. H. van Leeuwaarden

Single-server queues with customer abandonment arise in call centers and many service systems, but steady-state performance measures remain analytically intractable beyond Markovian assumptions. This paper develops Robust Queueing (RQ)…

Probability · Mathematics 2026-03-03 Wei You

We present an analysis of large-scale load balancing systems, where the processing time distribution of tasks depends on both the task and server types. Our study focuses on the asymptotic regime, where the number of servers and task types…

Probability · Mathematics 2023-06-19 Zhisheng Zhao , Debankur Mukherjee

We consider load balancing in a network of caching servers delivering contents to end users. Randomized load balancing via the so-called power of two choices is a well-known approach in parallel and distributed systems that reduces network…

Data Structures and Algorithms · Computer Science 2016-10-25 Ali Pourmiri , Mahdi Jafari Siavoshani , Seyed Pooya Shariatpanahi

We consider a queueing system composed of a dispatcher that routes deterministically jobs to a set of non-observable queues working in parallel. In this setting, the fundamental problem is which policy should the dispatcher implement to…

Performance · Computer Science 2025-02-23 Jonatha Anselmi , Bruno Gaujal , Tommaso Nesti

Recent years have seen a great increase in the capacity and parallel processing power of data centers and cloud services. To fully utilize the said distributed systems, optimal load balancing for parallel queuing architectures must be…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-10 Anam Tahir , Kai Cui , Heinz Koeppl

Quantum repeater networks distribute entanglement over lossy links while many users share a limited pool of entangled pairs. Most existing routing schemes either always use a single best path or rely on global optimizations that are hard to…

Quantum Physics · Physics 2026-03-31 Ankit Mishra , Kang Hao Cheong