English
Related papers

Related papers: Asymptotics of Insensitive Load Balancing and Bloc…

200 papers

A fundamental challenge in large-scale cloud networks and data centers is to achieve highly efficient server utilization and limit energy consumption, while providing excellent user-perceived performance in the presence of uncertain and…

Probability · Mathematics 2017-06-23 Debankur Mukherjee , Souvik Dhara , Sem Borst , Johan S. H. van Leeuwaarden

In a balancing network each processor has an initial collection of unit-size jobs (tokens) and in each round, pairs of processors connected by balancers split their load as evenly as possible. An excess token (if any) is placed according to…

Data Structures and Algorithms · Computer Science 2010-06-09 Tobias Friedrich , Thomas Sauerwald , Dan Vilenchik

In this thesis, we propose and analyze a multi-server model that captures a performance trade-off between centralized and distributed processing. In our model, a fraction $p$ of an available resource is deployed in a centralized manner…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-03-23 Kuang Xu

A large-scale service system with multiple customer classes and multiple server pools is considered, with the mean service time depending both on the customer class and server pool. The allowed activities (routing choices) form a tree (in…

Probability · Mathematics 2014-03-28 Alexander Stolyar

In this study, we consider multi-class multi-server asymmetric queueing systems consisting of $N$ queues on one side and $K$ servers on the other side, where jobs randomly arrive in queues at each time. The service rate of each job-server…

Machine Learning · Statistics 2025-05-07 Jung-hun Kim , Min-hwan Oh

The paper is devoted to the approximate consensus problem for networks of nonlinear agents with switching topology, noisy and delayed measurements. In contrast to the existing stochastic approximation-based control algorithms (protocols), a…

Systems and Control · Computer Science 2013-06-17 Natalia Amelina , Alexander Fradkov , Yuming Jiang , Dimitrios J. Vergados

In this paper, we study a large system of $N$ servers each with capacity to process at most $C$ simultaneous jobs and an incoming job is routed to a server if it has the lowest occupancy amongst $d$ (out of N) randomly selected servers. A…

Probability · Mathematics 2021-01-19 Thirupathaiah Vasantam , Ravi R. Mazumdar

A service system with multiple types of customers, arriving according to Poisson processes, is considered. The system is heterogeneous in that the servers also can be of multiple types. Each customer has an independent exponentially…

Probability · Mathematics 2016-05-20 Alexander Stolyar

We analyze randomized dynamic load balancing schemes for multi-server processor sharing systems when the number of servers in the system is large and the servers have heterogeneous service rates. In particular, we focus on the classical…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-02-11 Arpan Mukhopadhyay , Ravi R. Mazumdar

We study the fault-tolerant variant of the online bin packing problem. Similar to the classic bin packing problem, an online sequence of items of various sizes should be packed into a minimum number of bins of uniform capacity. For…

Data Structures and Algorithms · Computer Science 2021-07-08 Shahin Kamali , Pooya Nikbakht

This paper presents asymptotic properties of the Erlang-C formula in a spectrum of many-server limiting regimes. Specifically, we address an important gap in the literature regarding its limiting value in critically loaded regimes by…

Probability · Mathematics 2024-05-14 Ragavendran Gopalakrishnan , Yueyang Zhong

We study a single server queue operating under the shortest remaining processing time (SRPT) scheduling policy; that is, the server preemptively serves the job with the shortest remaining processing time first. In this work we are…

Probability · Mathematics 2023-11-07 Sayan Banerjee , Amarjit Budhiraja , Amber L. Puha

The basic load balancing scenario involves a single dispatcher where tasks arrive that must immediately be forwarded to one of $N$ single-server queues. We discuss recent advances on scalable load balancing schemes which provide favorable…

We consider the processor sharing $M/M/1$-PS queue which also models balking. A customer that arrives and sees $n$ others in the system "balks" (i.e., decides not to enter) with probability $1-b_n$. If $b_n$ is inversely proportional to…

Probability · Mathematics 2011-04-26 Qiang Zhen , Johan S. H. van Leeuwaarden , Charles Knessl

The Join-the-Shortest-Queue (JSQ) load balancing scheme is known to minimise the average response time of jobs in homogeneous systems with identical servers. However, for {\em heterogeneous} systems with servers having different processing…

Probability · Mathematics 2024-10-22 Sanidhay Bhambay , Burak Büke , Arpan Mukhopadhyay

The equilibrium properties of allocation algorithms for networks with a large number of nodes with finite capacity are investigated. Every node is receiving a flow of requests and when a request arrives at a saturated node, i.e. a node…

Probability · Mathematics 2026-01-14 Davit Martirosyan , Philippe Robert

Mean field models are a popular tool used to analyse load balancing policies. In some cases the waiting time distribution of the mean field limit has an explicit form. In other cases it can be computed as the solution of a set of…

Probability · Mathematics 2021-01-29 Tim Hellemans , Benny Van Houdt

Randomized load balancing networks arise in a variety of applications, and allow for efficient sharing of resources, while being relatively easy to implement. We consider a network of parallel queues in which incoming jobs with independent…

Probability · Mathematics 2017-10-13 Reza Aghajani , Kavita Ramanan

We consider a system of $N$ servers inter-connected by some underlying graph topology $G_N$. Tasks arrive at the various servers as independent Poisson processes of rate $\lambda$. Each incoming task is irrevocably assigned to whichever…

Probability · Mathematics 2019-04-09 Debankur Mukherjee , Sem C. Borst , Johan S. H. van Leeuwaarden

A broad class of parallel server systems is considered, for which we prove the steady-state asymptotic independence of server workloads, as the number of servers goes to infinity, while the system load remains sub-critical. Arriving jobs…

Probability · Mathematics 2020-12-21 Seva Shneer , Alexander Stolyar