English
Related papers

Related papers: Rank Based Routing in Large Server Systems under E…

200 papers

We consider a class of multi-agent distributed synchronization systems, which are modeled as $n$ particles moving on the real line. This class generalizes the model of a multi-server queueing system, considered in [15], employing so-called…

Probability · Mathematics 2026-02-13 Alexander Stolyar

We consider a horizontal traffic queue (HTQ) on a periodic road segment, where vehicles arrive according to a spatio-temporal Poisson process, and depart after traveling a distance that is sampled independently and identically from a…

Dynamical Systems · Mathematics 2016-05-25 Mohammad Motie , Ketan Savla

We establish a diffusion approximation for a class of multi-agent controlled queueing systems, demonstrating their convergence to a system of interacting reflected Ornstein--Uhlenbeck (OU) processes. The limiting process captures essential…

Probability · Mathematics 2026-01-12 Thoa Thieu , Roderick Melnik

The Join-the-Shortest Queue (JSQ) policy is a classical benchmark for the performance of many-server queueing systems due to its strong optimality properties. While the exact analysis of the JSQ policy is an open question to date, even…

Probability · Mathematics 2025-05-27 Zhisheng Zhao , Sayan Banerjee , Debankur Mukherjee

We consider the problem of designing a packet-level congestion control and scheduling policy for datacenter networks. Current datacenter networks primarily inherit the principles that went into the design of Internet, where congestion…

Networking and Internet Architecture · Computer Science 2017-10-10 Devavrat Shah , Qiaomin Xie

A service system with multiple types of customers, arriving as Poisson processes, is considered. The system has infinite number of servers, ranked by $1,2,3, \ldots$; a server rank is its ``location." Each customer has an independent…

Probability · Mathematics 2025-02-21 Alexander Stolyar

The basic load balancing scenario involves a single dispatcher where tasks arrive that must immediately be forwarded to one of $N$ single-server queues. We discuss recent advances on scalable load balancing schemes which provide favorable…

We present an overview of scalable load balancing algorithms which provide favorable delay performance in large-scale systems, and yet only require minimal implementation overhead. Aimed at a broad audience, the paper starts with an…

Performance · Computer Science 2017-12-25 Mark van der Boor , Sem C. Borst , Johan S. H. van Leeuwaarden , Debankur Mukherjee

This paper focuses on an infinite-server queue modulated by an independently evolving finite-state Markovian background process, with transition rate matrix $Q\equiv(q_{ij})_{i,j=1}^d$. Both arrival rates and service rates are depending on…

Probability · Mathematics 2015-06-17 Joke Blom , Koen De Turck , Michel Mandjes

In the context of load balancing, Lu et al. introduced the distributed Join-Idle-Queue algorithm, where a group of dispatchers distribute jobs to a cluster of parallel servers. Each dispatcher maintains a queue of idle servers; when a job…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-07 Michael Mitzenmacher

We consider a heterogeneous queueing system consisting of one large pool of $O(r)$ identical servers, where $r\to\infty$ is the scaling parameter. The arriving customers belong to one of several classes which determines the service times in…

Probability · Mathematics 2011-05-04 David Gamarnik , Alexander Stolyar

This paper considers a GI/GI/1 processor sharing queue in which jobs have soft deadlines. At each point in time, the collection of residual service times and deadlines is modeled using a random counting measure on the right half-plane. The…

Probability · Mathematics 2009-09-29 H. Christian Gromoll , Łukasz Kruk

We study the steady-state performance of parallel-server systems under an immediate routing architecture with two sources of heterogeneity: servers and job classes, subject to compatibility constraints. We focus on the…

Probability · Mathematics 2025-09-25 Yaosheng Xu

We consider the problem of minimizing the delay of jobs moving through a directed graph of service nodes. In this problem, each node may have several links and is constrained to serve one link at a time. As jobs move through the network,…

Networking and Internet Architecture · Computer Science 2019-03-08 Hsu-Chieh Hu , Stephen F. Smith

Motivated by emerging big streaming data processing paradigms (e.g., Twitter Storm, Streaming MapReduce), we investigate the problem of scheduling graphs over a large cluster of servers. Each graph is a job, where nodes represent compute…

Networking and Internet Architecture · Computer Science 2015-02-23 Javad Ghaderi , Sanjay Shakkottai , R Srikant

We study a double-ended queue where buyers and sellers arrive to conduct trades. When there is a pair of buyer and seller in the system, they immediately transact a trade and leave. Thus there cannot be non-zero number of buyers and sellers…

Probability · Mathematics 2014-01-22 Xin Liu , Qi Gong , Vidyadhar G. Kulkarni

The Join-the-Shortest-Queue (JSQ) load-balancing scheme is known to minimise the average delay of jobs in homogeneous systems consisting of identical servers. However, it performs poorly in heterogeneous systems where servers have different…

Probability · Mathematics 2022-10-04 Sanidhay Bhambay , Arpan Mukhopadhyay

We consider a multi-server queue in the Halfin-Whitt regime: as the number of servers $n$ grows without a bound, the utilization approaches 1 from below at the rate $\Theta(1/\sqrt{n})$. Assuming that the service time distribution is…

Probability · Mathematics 2008-03-19 David Gamarnik , Petar Momcilovic

We study a queueing network with a single shared server, that serves the queues in a cyclic order according to the gated service discipline. External customers arrive at the queues according to independent Poisson processes. After…

Probability · Mathematics 2014-09-11 Marko Boon , Rob van der Mei , Erik Winands

We consider the problem of scheduling a queueing system in which many statistically identical servers cater to several classes of impatient customers. Service times and impatience clocks are exponential while arrival processes are renewal.…

Probability · Mathematics 2007-05-23 Rami Atar , Avi Mandelbaum , Martin I. Reiman