English
Related papers

Related papers: Pull-based load distribution in large-scale hetero…

200 papers

We consider a distributed server system consisting of a large number of servers, each with limited capacity on multiple resources (CPU, memory, disk, etc.). Jobs with different rewards arrive over time and require certain amounts of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-29 Konstantinos Psychas , Javad Ghaderi

We consider the job assignment problem in a multi-server system consisting of $N$ parallel processor sharing servers, categorized into $M$ ($\ll N$) different types according to their processing capacity or speed. Jobs of random sizes…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-02-23 Arpan Mukhopadhyay , A. Karthik , Ravi R. Mazumdar

In this thesis, we study the queueing systems with heterogeneous servers and service rate uncertainty under the Halfin-Whitt heavy traffic regime. First, we analyse many server queues with abandonments when service rates are i.i.d. random…

Probability · Mathematics 2018-12-04 Wenyi Qin

The infinite-server queueing models with homogeneous and non-homogeneous arrivals of customers and catastrophes are considered. The probability generating functions of joint distributions of numbers of busy servers and served customers, as…

Optimization and Control · Mathematics 2018-07-24 Khanik Kerobyan

We consider a service system where agents (or, servers) are invited on-demand. Customers arrive as a Poisson process and join a customer queue. Customer service times are i.i.d. exponential. Agents' behavior is random in two respects.…

Probability · Mathematics 2016-09-09 Lam Nguyen , Alexander Stolyar

We study a fundamental model of resource allocation in which a finite number of resources must be assigned in an online manner to a heterogeneous stream of customers. The customers arrive randomly over time according to known stochastic…

Optimization and Control · Mathematics 2018-05-16 Clifford Stein , Van-Anh Truong , Xinshang Wang

We consider a service system model primarily motivated by the problem of efficient assignment of virtual machines to physical host machines in a network cloud, so that the number of occupied hosts is minimized. There are multiple input…

Optimization and Control · Mathematics 2012-06-05 Alexander Stolyar

We study a system, where a random flow of customers is served by servers (called agents) invited on-demand. Each invited agent arrives into the system after a random time; after each service completion, an agent returns to the system or…

Probability · Mathematics 2017-11-28 Lam M. Nguyen , Alexander Stolyar

A common assumption when modeling queuing systems is that arrivals behave like a Poisson process with constant parameter. In practice, however, call arrivals are often observed to be significantly overdispersed. This motivates that in this…

Probability · Mathematics 2017-03-07 Mariska Heemskerk , Julia Kuhn , Michel Mandjes

We consider large-scale service systems with multiple customer classes and multiple server pools; interarrival and service times are exponentially distributed, and mean service times depend both on the customer class and server pool. It is…

Probability · Mathematics 2014-08-05 Alexander Stolyar , Elena Yudovina

Ride-pooling has become an important service option offered by ride-hailing platforms as it serves multiple trip requests in a single ride. By leveraging customer data, connected vehicles, and efficient assignment algorithms, ride-pooling…

Systems and Control · Electrical Eng. & Systems 2021-07-26 Alexander Sundt , Qi Luo , John Vincent , Mehrdad Shahabi , Yafeng Yin

We consider the processor sharing $M/M/1$-PS queue which also models balking. A customer that arrives and sees $n$ others in the system "balks" (i.e., decides not to enter) with probability $1-b_n$. If $b_n$ is inversely proportional to…

Probability · Mathematics 2011-04-26 Qiang Zhen , Johan S. H. van Leeuwaarden , Charles Knessl

We consider load balancing in service systems with affinity relations between jobs and servers. Specifically, an arriving job can be allocated to a fast, primary server from a particular selection associated with this job or to a secondary…

Probability · Mathematics 2018-12-31 Ellen Cardinaels , Sem C. Borst , Johan S. H. van Leeuwaarden

This paper analyzes a service system modeled as a single-server queue, in which the service provider aims to dynamically maximize the expected revenue per unit of time. This is achieved by constructing a stochastic gradient descent…

Optimization and Control · Mathematics 2026-03-05 Shreehari Anand Bodas , Harsha Honnappa , Michel Mandjes , Liron Ravner

We consider an M/M/Infinity service system in which an arriving customer is served by the first idle server in an infinite sequence S_1, S_2, ... of servers. We determine the first two terms in the asymptotic expansions of the moments of L…

Probability · Mathematics 2011-07-11 Patrick Eschenfeldt , Ben Gross , Nicholas Pippenger

In this paper, we analyse a single server polling model with two queues. Customers arrive at the two queues according to two independent Poisson processes. There is a single server that serves both queues with generally distributed service…

Probability · Mathematics 2017-07-14 Mayank Saxena , Onno Boxma , Stella Kapodistria , Rudesindo Núñez Queija

Service systems often face task-server assignment-constraints due to skill-based routing or geographical conditions. Redundancy scheduling responds to this limited flexibility by replicating tasks to specific servers in agreement with these…

Probability · Mathematics 2022-08-17 Ellen Cardinaels , Sem Borst , Johan S. H. van Leeuwaarden

We consider a class of open stochastic processing networks, with feedback routing and overlapping server capabilities, in heavy traffic. The networks we consider satisfy the so-called complete resource pooling condition and therefore have…

Probability · Mathematics 2007-05-23 Baris Ata , Sunil Kumar

Current-day data centers and high-volume cloud services employ a broad set of heterogeneous servers. In such settings, client requests typically arrive at multiple entry points, and dispatching them to servers is an urgent distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-27 Guy Goren , Shay Vargaftik , Yoram Moses

We consider load balancing in large-scale heterogeneous server systems in the presence of data locality that imposes constraints on which tasks can be assigned to which servers. The constraints are naturally captured by a bipartite graph…

Probability · Mathematics 2022-12-01 Zhisheng Zhao , Debankur Mukherjee , Ruoyu Wu