English
Related papers

Related papers: Learning and balancing unknown loads in large-scal…

200 papers

We consider a system of N queues with decentralized load balancing such as power-of-D strategies(where D may depend on N) and generic scheduling disciplines. To measure the dependence of the queues, we use the clan of ancestors, a technique…

Probability · Mathematics 2018-09-17 Maria Clara Fittipaldi , Matthieu Jonckheere , Sergio I. Lopez

This paper studies the sensitivity (or insensitivity) of a class of load balancing algorithms that achieve asymptotic zero-waiting in the sub-Halfin-Whitt regime, named LB-zero. Most existing results on zero-waiting load balancing…

Probability · Mathematics 2022-02-17 Xin Liu , Kang Gong , Lei Ying

A large-scale service system with multiple customer classes and multiple server pools is considered, with the mean service time depending both on the customer class and server pool. The allowed activities (routing choices) form a tree (in…

Probability · Mathematics 2014-03-28 Alexander Stolyar

We prove a many-server heavy-traffic fluid limit for an overloaded Markovian queueing system having two customer classes and two service pools, known in the call-center literature as the X model. The system uses the…

Probability · Mathematics 2013-01-24 Ohad Perry , Ward Whitt

We study the problem of strategic choice of arrival time to a single-server queue with opening and closing times when there is uncertainty regarding service speed. A Poisson population of customers choose their arrival time with the goal of…

Probability · Mathematics 2021-01-01 Liron Ravner , Yutaka Sakuma

We study a general problem of allocating limited resources to heterogeneous customers over time under model uncertainty. Each type of customer can be serviced using different actions, each of which stochastically consumes some combination…

Artificial Intelligence · Computer Science 2021-08-31 Wang Chi Cheung , Will Ma , David Simchi-Levi , Xinshang Wang

In multi-server distributed queueing systems, the access of stochastically arriving jobs to resources is often regulated by a dispatcher, also known as load balancer. A fundamental problem consists in designing a load balancing algorithm…

Probability · Mathematics 2025-02-23 Jonatha Anselmi , Francois Dufour

Two independent Poisson streams of jobs flow into a single-server service system having a limited common buffer that can hold at most one job. If a type-i job (i=1,2) finds the server busy, it is blocked and routed to a separate type-i…

Discrete Mathematics · Computer Science 2012-06-26 Konstantin Avrachenkov , Philippe Nain , Uri Yechiali

The paper proposes a solution an actual scientific problem related to load balancing and efficient utilization of resources of the distributed system. The proposed method is based on calculation of load CPU, memory, and bandwidth by flows…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-04-11 Kirichenko Lyudmyla , Radivilova Tamara

Load balancing is a common approach in web server farms or inventory routing problems. An important issue in such systems is to determine the server to which an incoming request should be routed to optimize a given performance criteria. In…

Performance · Computer Science 2018-10-19 Urtzi Ayesta , Manu K Gupta , Ina Maria Verloop

Arrival processes to service systems often display fluctuations that are larger than anticipated under the Poisson assumption, a phenomenon that is referred to as overdispersion. Motivated by this, we analyze a class of discrete stochastic…

Our interest lies in load balancing jobs in large scale systems consisting of multiple dispatchers and FCFS servers. In the absence of any information on job sizes, dispatchers typically use queue length information reported by the servers…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-16 Tim Hellemans , Benny Van Houdt

We consider a large-scale parallel-server system, where each server independently adjusts its processing speed in a decentralized manner. The objective is to minimize the overall cost, which comprises the average cost of maintaining the…

Optimization and Control · Mathematics 2023-06-06 Daan Rutten , Martin Zubeldia , Debankur Mukherjee

This paper introduces a new asymptotic regime for simplifying stochastic models having non-stationary effects, such as those that arise in the presence of time-of-day effects. This regime describes an operating environment within which the…

Probability · Mathematics 2018-07-19 Zeyu Zheng , Harsha Honnappa , Peter W. Glynn

Current approaches for collision avoidance and space traffic management face many challenges, mainly due to the continuous increase in the number of objects in orbit and the lack of scalable and automated solutions. To avoid catastrophic…

Machine Learning · Computer Science 2023-11-17 Marta Guimarães , Cláudia Soares , Chiara Manfletti

In an earlier paper, a randomized load balancing model was studied in a heavy traffic asymptotic regime where the load balancing stream is thin compared to the total arrival stream. It was shown that the limit is given by a system of…

Probability · Mathematics 2024-09-24 Rami Atar , Tomoyuki Ichiba

We study d-way balanced allocation, which assigns each incoming job to the lightest loaded among d randomly chosen servers. While prior work has extensively studied the performance of the basic scheme, there has been less published work on…

Performance · Computer Science 2026-01-19 Amer Diwan , Prabhakar Raghavan , Eli Upfal

In this study, we consider multi-class multi-server asymmetric queueing systems consisting of $N$ queues on one side and $K$ servers on the other side, where jobs randomly arrive in queues at each time. The service rate of each job-server…

Machine Learning · Statistics 2025-05-07 Jung-hun Kim , Min-hwan Oh

This paper provides a mathematical framework for estimation of the service time distribution and the expected service time of an infinite-server queueing system with a nonhomogeneous Poisson arrival process, in the case of partial…

Statistics Theory · Mathematics 2018-05-29 A. Goldenshluger , D. T. Koops

We study a simple rate control scheme for a multiclass queuing network for which customers are partitioned into distinct flows that are queued separately at each station. The control scheme discards customers that arrive to the network…

Probability · Mathematics 2013-07-16 John Musacchio , Jean Walrand