English
Related papers

Related papers: A Note on Load Balancing in Many-Server Heavy-Traf…

200 papers

The model is motivated by the problem of load distribution in large-scale cloud-based data processing systems. We consider a heterogeneous service system, consisting of multiple large server pools. The pools are different in that their…

Probability · Mathematics 2015-06-11 Alexander Stolyar

We obtain asymptotic bounds for the tail distribution of steady-state waiting time in a two server queue where each server processes incoming jobs at a rate equal to the rate of their arrivals (that is, the half-loaded regime). The job…

Probability · Mathematics 2016-04-05 Jose Blanchet , Karthyek Murthy

We consider a large-scale flexible service system with two large server pools and two types of customers. Servers in pool 1 can only serve type 1 customers, while server in pool 2 are flexible -- they can serve both types 1 and 2. (This is…

Probability · Mathematics 2014-12-24 Alexander L. Stolyar

In large storage systems, files are often coded across several servers to improve reliability and retrieval speed. We study load balancing under the Batch Sampling routing scheme for a network of $n$ servers storing a set of files using the…

Probability · Mathematics 2017-07-10 Amarjit Budhiraja , Eric Friedlander

Heterogeneity is becoming increasingly ubiquitous in modern large-scale computer systems. Developing good load balancing policies for systems whose resources have varying speeds is crucial in achieving low response times. Indeed, how best…

Performance · Computer Science 2020-06-26 Kristen Gardner , Jazeem Abdul Jaleel , Alexander Wickeham , Sherwin Doroudi

We consider two-stage tandem queueing systems with one dedicated server in each station and a flexible server that can serve both stations. We assume exponential service times, linear holding costs accrued by jobs present in the system, and…

Systems and Control · Computer Science 2019-04-12 Ioannis Papachristos , Dimitrios G. Pandelis

Load balancing algorithms play critical roles in systems where the workload has to be distributed across multiple resources, such as cores in multiprocessor system, computers in distributed computing, and network links. In this paper, we…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-20 Shafinaz Islam

We consider a queueing system with $n$ parallel queues operating according to the so-called "supermarket model" in which arriving customers join the shortest of $d$ randomly selected queues. Assuming rate $n\lambda_{n}$ Poisson arrivals and…

Probability · Mathematics 2017-01-19 Patrick Eschenfeldt , David Gamarnik

We consider load balancing in service systems with affinity relations between jobs and servers. Specifically, an arriving job can be allocated to a fast, primary server from a particular selection associated with this job or to a secondary…

Probability · Mathematics 2018-12-31 Ellen Cardinaels , Sem C. Borst , Johan S. H. van Leeuwaarden

We consider the so-called GI/GI/N queueing network in which a stream of jobs with independent and identically distributed service times arrive according to a renewal process to a common queue served by $N$ identical servers in a…

Probability · Mathematics 2017-12-06 Reza Aghajani , Kavita Ramanan

Diffusion approximations are widely used in the analysis of service systems, providing tractable insights into complex models. While heavy-traffic limit theorems justify these approximations asymptotically, they do not quantify the error…

Probability · Mathematics 2025-03-18 Anton Braverman , Ziv Scully

We examine a queue-based random-access algorithm where activation and deactivation rates are adapted as functions of queue lengths. We establish its heavy traffic behavior on a complete interference graph, which turns out to be highly…

Probability · Mathematics 2021-06-08 Eyal Castiel , Sem Borst , Laurent Miclo , Florian Simatos , Philip Whiting

We investigate the long-run behavior of single-server queues with Hawkes arrivals and general service distributions and related optimization problems. In detail, utilizing novel coupling techniques, we establish finite moment bounds for the…

Probability · Mathematics 2023-11-14 Xinyun Chen , Guiyu Hong

A classical sampling strategy for load balancing policies is power-of-two, where any server pair is sampled with equal probability. This does not cover practical settings with assignment constraints which force non-uniform sampling. While…

Probability · Mathematics 2022-07-18 Ellen Cardinaels , Sem Borst , Johan S. H. van Leeuwaarden

A multiclass queueing system is considered, with heterogeneous service stations, each consisting of many servers with identical capabilities. An optimal control problem is formulated, where the control corresponds to scheduling and routing,…

Probability · Mathematics 2007-05-23 Rami Atar

In large storage systems, files are often coded across several servers to improve reliability and retrieval speed. We consider a system of $n$ servers storing files using a Maximum Distance Separable code (cf. \cite{li2016mean}).…

Probability · Mathematics 2018-01-10 Eric Friedlander

Multi-server queueing systems are widely used models for job scheduling in machine learning, wireless networks, crowdsourcing, and healthcare systems. This paper considers a multi-server system with multiple servers and multiple types of…

Machine Learning · Computer Science 2023-06-05 Zixian Yang , R. Srikant , Lei Ying

In Internet environment, traffic flow to a link is typically modeled by superposition of ON/OFF based sources. During each ON-period for a particular source, packets arrive according to a Poisson process and packet sizes (hence service…

Probability · Mathematics 2015-08-28 Wanyang Dai

We establish a heavy-traffic limit theorem on convergence in distribution for the number of customers in a many-server queue when the number of servers tends to infinity. No critical loading condition is assumed. Generally, the limit…

Probability · Mathematics 2010-01-14 Anatolii A. Puhalskii , Josh E. Reed

We study a sequence of single server queues with customer abandonment (GI/GI/1+GI) under heavy traffic. The patience time distributions vary with the sequence, which allows for a wider scope of applications. It is known ([20, 18]) that the…

Probability · Mathematics 2021-02-10 Chihoon Lee , Amy R. Ward , Heng-Qing Ye