English
Related papers

Related papers: A Simple Steady-State Analysis of Load Balancing A…

200 papers

We consider general large-scale service systems with multiple customer classes and multiple server (agent) pools, mean service times depend both on the customer class and server pool. It is assumed that the allowed activities (routing…

Probability · Mathematics 2015-03-17 Alexander L. Stolyar , Elena Yudovina

We study a two-type server queueing system where flexible Type-I servers, upon their initial interaction with jobs, decide in real time whether to process them independently or in collaboration with dedicated Type-II servers. Independent…

Optimization and Control · Mathematics 2026-01-21 Shuwen Lu , Mark E. Lewis , Jamol Pender

Load Balancing is a fundamental technology for scaling cloud infrastructure. It enables systems to distribute incoming traffic across backend servers using predefined algorithms such as round robin, weighted round robin, least connections,…

Networking and Internet Architecture · Computer Science 2025-05-14 Raju Singh

We analyze the so-called Shortest Queue First (SQF) queueing discipline whereby a unique server addresses queues in parallel by serving at any time that queue with the smallest workload. Considering a stationary system composed of two…

Performance · Computer Science 2013-05-16 Fabrice Guillemin , Alain Simonian

We investigate the transient and stationary queue-length distributions of a class of service systems with correlated service times. The classical $M^X/G/1$ queue with semi-Markov service times is the most prominent example in this class and…

Probability · Mathematics 2018-01-19 Abhishek , Marko Boon , Onno Boxma , Rudesindo Núñez-Queija

We consider a system of N queues with decentralized load balancing such as power-of-D strategies(where D may depend on N) and generic scheduling disciplines. To measure the dependence of the queues, we use the clan of ancestors, a technique…

Probability · Mathematics 2018-09-17 Maria Clara Fittipaldi , Matthieu Jonckheere , Sergio I. Lopez

In the balanced allocations framework, there are $m$ jobs (balls) to be allocated to $n$ servers (bins). The goal is to minimize the gap, the difference between the maximum and the average load. Peres, Talwar and Wieder (RSA 2015) used the…

Probability · Mathematics 2025-01-15 Dimitrios Los , Thomas Sauerwald

The model is a "generalized switch", serving multiple traffic flows in discrete time. The switch uses MaxWeight algorithm to make a service decision (scheduling choice) at each time step, which determines the probability distribution of the…

Probability · Mathematics 2015-02-13 Rahul Singh , Alexander Stolyar

Cloud computing is emerging as an important platform for business, personal and mobile computing applications. In this paper, we study a stochastic model of cloud computing, where jobs arrive according to a stochastic process and request…

Performance · Computer Science 2012-06-07 Siva Theja Maguluri , R Srikant , Lei Ying

We propose a model uncertainty approach to heavy traffic asymptotics that allows for a high level of uncertainty. That is, the uncertainty classes of underlying distributions accommodate disturbances that are of order 1 at the usual…

Probability · Mathematics 2022-04-13 Rami Atar , Eyal Castiel , Yonatan Shadmi

We consider the serve-the-longest-queue discipline for a multiclass queue with buffers of equal size, operating under (i) the conventional and (ii) the Halfin-Whitt heavy traffic regimes, and show that while the queue length process'…

Probability · Mathematics 2016-01-07 Rami Atar , Subhamay Saha

In this paper, we study the $G/\mathit{GI}/N$ queue in the Halfin--Whitt regime. Our first result is to obtain a deterministic fluid limit for the properly centered and scaled number of customers in the system which may be used to provide a…

Probability · Mathematics 2009-12-16 Josh Reed

This paper investigates a partially observable queueing system with $N$ nodes in which each node has a dedicated arrival stream. There is an extra arrival stream to balance the load of the system by routing its customers to the shortest…

Probability · Mathematics 2021-01-01 Qihui Bu , Liwei Liu , Jiashan Tang , Yiqiang Q. Zhao

Network load balancers are central components in data centers, that distributes workloads across multiple servers and thereby contribute to offering scalable services. However, when load balancers operate in dynamic environments with…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-02 Zhiyuan Yao , Zihan Ding , Thomas Heide Clausen

We consider a simple computation offloading model where jobs can either be fully processed in the cloud or be partially processed at a local server before being sent to the cloud to complete processing. Our goal is to design a policy for…

Systems and Control · Electrical Eng. & Systems 2025-09-24 Darin Jeff , Eytan Modiano

The paper studies approximations and control of a processor sharing (PS) server where the service rate depends on the number of jobs occupying the server. The control of such a system is implemented by imposing a limit on the number of jobs…

Systems and Control · Computer Science 2014-09-02 Varun Gupta , Jiheng Zhang

We consider the problem of scheduling a queueing system in which many statistically identical servers cater to several classes of impatient customers. Service times and impatience clocks are exponential while arrival processes are renewal.…

Probability · Mathematics 2007-05-23 Rami Atar , Avi Mandelbaum , Martin I. Reiman

Multiserver-job systems, where jobs require concurrent service at many servers, occur widely in practice. Much is known in the dropping setting, where jobs are immediately discarded if they require more servers than are currently available.…

Performance · Computer Science 2020-10-05 Isaac Grosof , Mor Harchol-Balter , Alan Scheller-Wolf

The Least Loaded (LL) routing algorithm has been in recent decades the routing method of choice in circuit switched networks and therefore it provides a benchmark against which new methods can be compared. This paper improves the…

Networking and Internet Architecture · Computer Science 2018-04-24 Gangxiang Shen , Longfei Li , Ya Zhang , Wei Chen , Sanjay K. Bose , Moshe Zukerman

A fundamental challenge in large-scale networked systems viz., data centers and cloud networks is to distribute tasks to a pool of servers, using minimal instantaneous state information, while providing excellent delay performance. In this…

Probability · Mathematics 2018-09-07 Debankur Mukherjee