English
Related papers

Related papers: Multiserver-job Response Time under Multilevel Sca…

200 papers

We consider a system with several job types and two parallel server pools. Within the pools the servers are homogeneous, but across pools possibly not in the sense that the service speed of a job may depend on its type as well as the server…

Performance · Computer Science 2020-05-28 Youri Raaijmakers , Sem Borst , Onno Boxma

We consider the problem of scheduling a queueing system in which many statistically identical servers cater to several classes of impatient customers. Service times and impatience clocks are exponential while arrival processes are renewal.…

Probability · Mathematics 2007-05-23 Rami Atar , Avi Mandelbaum , Martin I. Reiman

Mean field models are a popular tool used to analyse load balancing policies. In some cases the waiting time distribution of the mean field limit has an explicit form. In other cases it can be computed as the solution of a set of…

Probability · Mathematics 2021-01-29 Tim Hellemans , Benny Van Houdt

Motivated by the growing interest in today's massive parallel computing capabilities we analyze a queueing network with many servers in parallel to which jobs arrive a according to a Poisson process. Each job, upon arrival, is split into…

Probability · Mathematics 2015-07-20 Mariana Olvera-Cravioto , Octavio Ruiz-Lacedelli

In this work, we consider a computational model of a distributed system formed by a set of servers in which jobs, that are continuously arriving, have to be executed. Every job is formed by a set of dependent tasks (i.~e., each task may…

Networking and Internet Architecture · Computer Science 2019-10-07 Vicent Cholvi , Juan Echagüe , Antonio Fernández Anta , Christopher Thraves Caro

We consider the problem of scheduling on a single processor a given set of n jobs. Each job j has a workload w_j and a release time r_j. The processor can vary its speed and hibernate to reduce energy consumption. In a schedule minimizing…

Data Structures and Algorithms · Computer Science 2012-10-23 Evripidis Bampis , Christoph Dürr , Fadi Kacem , Ioannis Milis

We consider a large-scale parallel-server system, where each server independently adjusts its processing speed in a decentralized manner. The objective is to minimize the overall cost, which comprises the average cost of maintaining the…

Optimization and Control · Mathematics 2023-06-06 Daan Rutten , Martin Zubeldia , Debankur Mukherjee

We consider a heterogeneous queueing system consisting of one large pool of $O(r)$ identical servers, where $r\to\infty$ is the scaling parameter. The arriving customers belong to one of several classes which determines the service times in…

Probability · Mathematics 2011-05-04 David Gamarnik , Alexander Stolyar

Queues with setup time are extensively studied because they have application in performance evaluation of power-saving data centers. In a data center, there are a huge number of servers which consume a large amount of energy. In the current…

Performance · Computer Science 2015-12-15 Tuan Phung-Duc

In this paper one presents method for the computation of convergence bounds for four classes of multiserver queueing systems, described by inhomogeneous Markov chains. Specifically one considers inhomogeneous $M/M/S$ queueing system with…

We study distributed load balancing in bipartite queueing systems where frontends route jobs to heterogeneous backends with workload-dependent service rates. The system's connectivity -- governed by compatibility constraints such as data…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-25 Wenxin Zhang , Santiago R. Balseiro , Robert Kleinberg , Vahab Mirrokni , Balasubramanian Sivan , Bartek Wydrowski

Motivated by distributed schedulers that combine the power-of-d-choices with late binding and systems that use replication with cancellation-on-start, we study the performance of the LL(d) policy which assigns a job to a server that…

Performance · Computer Science 2018-02-16 Tim Hellemans , Benny Van Houdt

Cloud computing environments often have to deal with random-arrival computational workloads that vary in resource requirements and demand high Quality of Service (QoS) obligations. It is typical that a Service-Level-Agreement (SLA) is…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-21 Husam Suleiman , Otman Basir

We aim to maximize the energy efficiency, gauged as average energy cost per job, in a large-scale server farm with various storage or/and computing components modeled as parallel abstracted servers. Each server operates in multiple power…

Optimization and Control · Mathematics 2023-10-23 Jing Fu , Xinyu Wang , Zengfu Wang , Moshe Zukerman

We consider a large-scale service system where incoming tasks have to be instantaneously dispatched to one out of many parallel server pools. The user-perceived performance degrades with the number of concurrent tasks and the dispatcher…

We consider load balancing in service systems with affinity relations between jobs and servers. Specifically, an arriving job can be allocated to a fast, primary server from a particular selection associated with this job or to a secondary…

Probability · Mathematics 2018-12-31 Ellen Cardinaels , Sem C. Borst , Johan S. H. van Leeuwaarden

Consider a system of identical server pools where tasks with exponentially distributed service times arrive as a time-inhomogenenous Poisson process. An admission threshold is used in an inner control loop to assign incoming tasks to server…

Probability · Mathematics 2024-04-08 Diego Goldsztajn , Sem C. Borst , Johan S. H. van Leeuwaarden

In many different settings, requests for service can arrive in near or true simultaneity with one another. This creates batches of arrivals to the underlying queueing system. In this paper, we study the staffing problem for the batch…

Performance · Computer Science 2023-05-31 Andrew Daw , Robert C. Hampshire , Jamol Pender

Load balancing algorithms play a vital role in enhancing performance in data centers and cloud networks. Due to the massive size of these systems, scalability challenges, and especially the communication overhead associated with load…

Probability · Mathematics 2019-03-07 Mark van der Boor , Sem Borst , Johan van Leeuwaarden

Modern data centers are tasked with processing heterogeneous workloads consisting of various classes of jobs. These classes differ in their arrival rates, size distributions, and job parallelizability. With respect to paralellizability,…

Performance · Computer Science 2020-05-21 Benjamin Berg , Mor Harchol-Balter , Benjamin Moseley , Weina Wang , Justin Whitehouse