English
Related papers

Related papers: Multiserver-job Response Time under Multilevel Sca…

200 papers

The paper studies a multiserver retrial queueing system with $m$ servers. Arrival process is a point process with strictly stationary and ergodic increments. A customer arriving to the system occupies one of the free servers. If upon…

Probability · Mathematics 2021-07-01 Vyacheslav M. Abramov

Most data generated by modern applications is stored in the cloud, and there is an exponential growth in the volume of jobs to access these data and perform computations using them. The volume of data access or computing jobs can be…

Performance · Computer Science 2022-08-16 Tuhinangshu Choudhury , Weina Wang , Gauri Joshi

We consider load balancing in large-scale heterogeneous server systems in the presence of data locality that imposes constraints on which tasks can be assigned to which servers. The constraints are naturally captured by a bipartite graph…

Probability · Mathematics 2022-12-01 Zhisheng Zhao , Debankur Mukherjee , Ruoyu Wu

Modern data centers serve workloads which are capable of exploiting parallelism. When a job parallelizes across multiple servers it will complete more quickly, but jobs receive diminishing returns from being allocated additional servers.…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-20 Benjamin Berg , Rein Vesilo , Mor Harchol-Balter

Service systems often face task-server assignment-constraints due to skill-based routing or geographical conditions. Redundancy scheduling responds to this limited flexibility by replicating tasks to specific servers in agreement with these…

Probability · Mathematics 2022-08-17 Ellen Cardinaels , Sem Borst , Johan S. H. van Leeuwaarden

In this paper we study the Markov-modulated M/M/$\infty$ queue, with a focus on the correlation structure of the number of jobs in the system. The main results describe the system's asymptotic behavior under a particular scaling of the…

Probability · Mathematics 2016-01-13 Joke Blom , Koen de Turck , Michel Mandjes

The Join-the-Shortest Queue (JSQ) policy is a classical benchmark for the performance of many-server queueing systems due to its strong optimality properties. While the exact analysis of the JSQ policy is an open question to date, even…

Probability · Mathematics 2025-05-27 Zhisheng Zhao , Sayan Banerjee , Debankur Mukherjee

Consider a service system where incoming tasks are instantaneously dispatched to one out of many heterogeneous server pools. Associated with each server pool is a concave utility function which depends on the class of the server pool and…

Probability · Mathematics 2024-02-13 Diego Goldsztajn , Sem C. Borst , Johan S. H. van Leeuwaarden

We consider the problem of minimizing queue-length costs in a system with heterogenous parallel servers, operating in a many-server heavy-traffic regime with nondegenerate slowdown. This regime is distinct from the well-studied heavy…

Probability · Mathematics 2014-03-24 Rami Atar , Itai Gurvich

Multi-server jobs are imperative in modern cloud computing systems. A noteworthy feature of multi-server jobs is that, they usually request multiple computing devices simultaneously for their execution. How to schedule multi-server jobs…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-18 Hailiang Zhao , Shuiguang Deng , Feiyi Chen , Jianwei Yin , Schahram Dustdar , Albert Y. Zomaya

In many-server systems it is crucial to staff the right number of servers so that targeted service levels are met. These staffing problems typically lead to constraint satisfaction problems that are hard to solve. During the last decade, a…

Probability · Mathematics 2014-01-30 A. J. E. M. Janssen , Johan S. H. van Leeuwaarden

We consider a system with N unit-service-rate queues in tandem, with exogenous arrivals of rate lambda at queue 1, under a back-pressure (MaxWeight) algorithm: service at queue n is blocked unless its queue length is greater than that of…

Probability · Mathematics 2010-02-23 Alexander Stolyar

The load-balancing system, built on the basis of a subsystem load balancer and subsystem control and monitoring that closely interact with each other was propose in work. This system is presented as a queuing system with priority service…

Networking and Internet Architecture · Computer Science 2019-05-10 Igor Ivanisenko , Tamara Radivilova

This paper presents a multiagent approach as a paradigm for scheduling parallel jobs in a parallel system. Scheduling parallel jobs is performed as a means to balance the load of a system in order to improve the performance of a parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-29 Jaderick P. Pabico

We study the design of dynamic scheduling controls in closed queueing networks with a fixed number of jobs. Each time a server becomes available, the controller has (limited) flexibility in choosing the buffer from which to serve a job. If…

Probability · Mathematics 2022-10-18 Siddhartha Banerjee , Yash Kanoria , Pengyu Qian

In queueing systems, effective scheduling algorithms are essential for optimizing performance. Optimal scheduling for the M/G/k queue has been explored in the heavy traffic limit, but much remains unknown in the intermediate load regime. In…

Performance · Computer Science 2025-12-09 Ziyuan Wang , Izzy Grosof

The maximum possible throughput (or the rate of job completion) of a multi-server system is typically the sum of the service rates of individual servers. Recent work shows that launching multiple replicas of a job and canceling them as soon…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-29 Gauri Joshi , Dhruva Kaushal

This paper introduces and analyzes the notion of throughput suboptimality for many-server queueing systems in heavy traffic. The queueing model under consideration has multiple customer classes, indexed by a finite set $\mathcal{I}$, and…

Probability · Mathematics 2009-06-15 Rami Atar , Gennady Shaikhet

In this paper, we introduce a model of dynamical queue, in which the service time depends on the server utilization history. The proposed queueing model is motivated by widely accepted empirical laws describing human performance as a…

Optimization and Control · Mathematics 2015-03-13 Ketan Savla , Emilio Frazzoli

Can the popular shortest remaining processing time (SRPT) algorithm achieve a constant competitive ratio on multiple servers when server speeds are adjustable (speed scaling) with respect to the flow time plus energy consumption metric?…

Performance · Computer Science 2020-05-06 Rahul Vaze , Jayakrishnan Nair