English
Related papers

Related papers: Universality of Load Balancing Schemes on Diffusio…

200 papers

We study a two-type server queueing system where flexible Type-I servers, upon their initial interaction with jobs, decide in real time whether to process them independently or in collaboration with dedicated Type-II servers. Independent…

Optimization and Control · Mathematics 2026-01-21 Shuwen Lu , Mark E. Lewis , Jamol Pender

We develop a fluid-flow model for routing problems, where fluid consists of different size particles and the task is to route the incoming fluid to $n$ parallel servers using the size information in order to minimize the mean latency. The…

Performance · Computer Science 2025-09-29 Runhan Xie , Esa Hyytiä , Rhonda Righter

We present a heavy traffic analysis for a single server queue with renewal arrivals and generally distributed i.i.d. service times, in which the server employs the Shortest Remaining Processing Time (SRPT) policy. Under typical heavy…

Probability · Mathematics 2012-10-04 H. Christian Gromoll , Łukasz Kruk , Amber L. Puha

We study a sequence of single server queues with customer abandonment (GI/GI/1+GI) under heavy traffic. The patience time distributions vary with the sequence, which allows for a wider scope of applications. It is known ([20, 18]) that the…

Probability · Mathematics 2021-02-10 Chihoon Lee , Amy R. Ward , Heng-Qing Ye

This work studies queues in a Euclidean space. Consider $N$ servers that are distributed uniformly in $[0,1]^d$. Customers arrive at the servers according to independent stationary processes. Upon arrival, they probabilistically decide…

Probability · Mathematics 2024-09-05 B. R. Vinay Kumar , Lasse Leskelä

The queue system,with Poisson arrivals,constant service time and infinite servers, busy period distribution is intensively studied because, due to its probability density function quite easy interpretation, it may serve as a clue to…

Probability · Mathematics 2021-09-23 Manuel Alberto M. Ferreira

Load balancing is a common approach in web server farms or inventory routing problems. An important issue in such systems is to determine the server to which an incoming request should be routed to optimize a given performance criteria. In…

Performance · Computer Science 2018-10-19 Urtzi Ayesta , Manu K Gupta , Ina Maria Verloop

We study the infinite horizon optimal control problem for N-network queueing systems, which consist of two customer classes and two server pools, under average (ergodic) criteria in the Halfin-Whitt regime. We consider three control…

Optimization and Control · Mathematics 2019-03-20 Ari Arapostathis , Guodong Pang

We consider load balancing in a network of caching servers delivering contents to end users. Randomized load balancing via the so-called power of two choices is a well-known approach in parallel and distributed systems that reduces network…

Data Structures and Algorithms · Computer Science 2016-10-25 Ali Pourmiri , Mahdi Jafari Siavoshani , Seyed Pooya Shariatpanahi

A large-scale service system with multiple customer classes and multiple server pools is considered, with the mean service time depending both on the customer class and server pool. The allowed activities (routing choices) form a tree (in…

Probability · Mathematics 2014-03-28 Alexander Stolyar

We characterize heavy-traffic process and steady-state limits for systems staffed according to the square-root safety rule, when the service requirements of the customers are perfectly correlated with their individual patience for waiting…

Probability · Mathematics 2020-09-01 Lun Yu , Ohad Perry

We consider a simple computation offloading model where jobs can either be fully processed in the cloud or be partially processed at a local server before being sent to the cloud to complete processing. Our goal is to design a policy for…

Systems and Control · Electrical Eng. & Systems 2025-09-24 Darin Jeff , Eytan Modiano

We consider a system of $N$ servers inter-connected by some underlying graph topology $G_N$. Tasks arrive at the various servers as independent Poisson processes of rate $\lambda$. Each incoming task is irrevocably assigned to whichever…

Probability · Mathematics 2019-04-09 Debankur Mukherjee , Sem C. Borst , Johan S. H. van Leeuwaarden

This paper studies the effect of an overdispersed arrival process on the performance of an infinite-server system. In our setup, a random environment is modeled by drawing an arrival rate $\Lambda$ from a given distribution every $\Delta$…

Probability · Mathematics 2016-02-02 Mariska Heemskerk , Johan van Leeuwaarden , Michel Mandjes

In this paper, we study a large system of $N$ servers each with capacity to process at most $C$ simultaneous jobs and an incoming job is routed to a server if it has the lowest occupancy amongst $d$ (out of N) randomly selected servers. A…

Probability · Mathematics 2021-01-19 Thirupathaiah Vasantam , Ravi R. Mazumdar

Modern computing workloads are often composed of parallelizable jobs. A parallelizable job can be completed more quickly when run on additional servers. However, each job can only use a limited number of servers, known as its…

Performance · Computer Science 2025-12-30 Benjamin Berg , Benjamin Moseley , Weina Wang , Mor Harchol-Balter

We consider a service system with an infinite number of exponential servers sharing a finite service capacity. The servers are ordered according to their speed, and arriving customers join the fastest idle server. A capacity allocation is…

Probability · Mathematics 2018-08-23 Refael Hassin , Liron Ravner

We consider load balancing in a network of caching servers delivering contents to end users. Randomized load balancing via the so-called power of two choices is a well-known approach in parallel and distributed systems. In this framework,…

Information Theory · Computer Science 2017-07-03 Mahdi Jafari Siavoshani , Ali Pourmiri , Seyed Pooya Shariatpanahi

Consider a network of $n$ single-server queues where tasks arrive independently at each server at rate $\lambda_n$. The servers are connected by a graph that is resampled at rate $\mu_n$ in a way that is symmetric with respect to the…

Probability · Mathematics 2025-10-14 Diego Goldsztajn , Sem C. Borst , Johan S. H. van Leeuwaarden

Arrival processes to service systems often display fluctuations that are larger than anticipated under the Poisson assumption, a phenomenon that is referred to as overdispersion. Motivated by this, we analyze a class of discrete stochastic…