English
Related papers

Related papers: Distributed Join-the-Idle-Queue for Low Latency Cl…

200 papers

Load balancing algorithms play a crucial role in delivering robust application performance in data centers and cloud networks. Recently, strong interest has emerged in Join-the-Idle-Queue (JIQ) algorithms, which rely on tokens issued by…

Probability · Mathematics 2017-06-06 Mark van der Boor , Sem Borst , Johan van Leeuwaarden

In the context of load balancing, Lu et al. introduced the distributed Join-Idle-Queue algorithm, where a group of dispatchers distribute jobs to a cluster of parallel servers. Each dispatcher maintains a queue of idle servers; when a job…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-07 Michael Mitzenmacher

We analyse Join-the-Shortest-Queue in a contemporary scaling regime known as the Non-Degenerate Slowdown regime. Join-the-Shortest-Queue (JSQ) is a classical load balancing policy for queueing systems with multiple parallel servers.…

Probability · Mathematics 2018-02-13 Varun Gupta , Neil Walton

Load balancing algorithms play a vital role in enhancing performance in data centers and cloud networks. Due to the massive size of these systems, scalability challenges, and especially the communication overhead associated with load…

Probability · Mathematics 2019-03-07 Mark van der Boor , Sem Borst , Johan van Leeuwaarden

We consider a system of $N$ parallel queues with identical exponential service rates and a single dispatcher where tasks arrive as a Poisson process. When a task arrives, the dispatcher always assigns it to an idle server, if there is any,…

Probability · Mathematics 2016-12-14 D. Mukherjee , S. C. Borst , J. S. H. van Leeuwaarden , P. A. Whiting

Today's data centers face extreme challenges in providing low latency. However, fair sharing, a principle commonly adopted in current congestion control protocols, is far from optimal for satisfying latency requirements. We propose…

Networking and Internet Architecture · Computer Science 2012-06-13 Chi-Yao Hong , Matthew Caesar , P. Brighten Godfrey

The basic load balancing scenario involves a single dispatcher where tasks arrive that must immediately be forwarded to one of $N$ single-server queues. We discuss recent advances on scalable load balancing schemes which provide favorable…

Recent workload measurements in Google data centers provide an opportunity to challenge existing models and, more broadly, to enhance the understanding of dispatching policies in computing clusters. Through extensive data-driven…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-27 Mert Yildiz , Alexey Rolich , Andrea Baiocchi

Distributed quantum computing (DQC) is being actively investigated as a means of scaling the number of qubits across multiple connected quantum devices. This includes quantum circuit compilation and execution management on multiple quantum…

Quantum Physics · Physics 2026-03-23 Gongyu Ni , Davide Ferrari , Lester Ho , Michele Amoretti

We establish a unified analytical framework for load balancing systems, which allows us to construct a general class $\Pi$ of policies that are both throughput optimal and heavy-traffic delay optimal. This general class $\Pi$ includes as…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-13 Xingyu Zhou , Fei Wu , Jian Tan , Yin Sun , Ness Shroff

A parallel server system with $n$ identical servers is considered. The service time distribution has a finite mean $1/\mu$, but otherwise is arbitrary. Arriving customers are be routed to one of the servers immediately upon arrival.…

Probability · Mathematics 2017-02-15 Sergey Foss , Alexander Stolyar

The Join-the-Shortest-Queue (JSQ) load-balancing scheme is known to minimise the average delay of jobs in homogeneous systems consisting of identical servers. However, it performs poorly in heterogeneous systems where servers have different…

Probability · Mathematics 2022-10-04 Sanidhay Bhambay , Arpan Mukhopadhyay

In this paper we propose a highly accurate approximate performance analysis of a heterogeneous server system with a processor sharing service discipline and a general job-size distribution under a generalized join the shortest queue (GJSQ)…

Probability · Mathematics 2017-03-20 Jori Selen , Ivo J. B. F. Adan , Stella Kapodistria

Join-the-Shortest-Queue (JSQ) is the scheduling policy of choice for many network providers, cloud servers and traffic management systems, where individual queues are served under processor sharing (PS) queueing discipline. A numerical…

Performance · Computer Science 2024-05-21 Julianna Bor , Peter G Harrison

Hierarchical edge-cloud computing-aided Internet of Things (IoT) networks offer low-latency and cost-efficient services to a growing number of data-intensive IoT devices. However, optimizing service placement, which involves determining the…

Distributed quantum computing (DQC) enables scalable quantum computations by distributing large quantum circuits on multiple quantum processing units (QPUs) in the quantum cloud. In DQC, after partitioning quantum circuits, they must be…

Quantum Physics · Physics 2025-12-09 Nour Dehaini , Christia Chahoud , Mahdi Chehimi

Join-the-shortest queue (JSQ) and its variants have often been used in solving load balancing problems. The aim of such policies is to minimize the average system occupation, e.g., the customer's system time. In this work we extend the…

Networking and Internet Architecture · Computer Science 2025-02-11 Andrea Fox , Francesco De Pellegrini , Eitan Altman , Arnob Ghosh , Ness Shroff

In an edge-cloud multi-tier network, datacenters provide services to mobile users, with each service having specific latency constraints and computational requirements. Deploying such a variety of services while matching their requirements…

Networking and Internet Architecture · Computer Science 2025-02-03 Itamar Cohen , Paolo Giaccone , Carla Fabiana Chiasserini

To improve the utility of learning applications and render machine learning solutions feasible for complex applications, a substantial amount of heavy computations is needed. Thus, it is essential to delegate the computations among several…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-29 Homa Esfahanizadeh , Alejandro Cohen , Muriel Medard

Use-case-specific network slicing in decentralized multi-tenancy cloud environments is a promising approach to bridge the gap between the demand and supply of resources in next-generation communication networks. Our findings associate…

Networking and Internet Architecture · Computer Science 2024-05-20 Anthony Kiggundu , Bin Han , Dennis Krummacker , Hans D. Schotten
‹ Prev 1 2 3 10 Next ›