English

On the Performance of Large Loss Systems with Adaptive Multiserver Jobs

Probability 2023-09-04 v1 Performance

Abstract

In this paper, we study systems where each job or request can be split into a flexible number of sub-jobs up to a maximum limit. The number of sub-jobs a job is split into depends on the number of available servers found upon its arrival. All sub-jobs of a job are then processed in parallel at different servers leading to a linear speed-up of the job. We refer to such jobs as {\em adaptive multi-server jobs}. We study the problem of optimal assignment of such jobs when each server can process at most one sub-job at any given instant and there is no waiting room in the system. We assume that, upon arrival, a job can only access a randomly sampled subset of k(n)k(n) servers from a total of nn servers, and the number of sub-jobs is determined based on the number of idle servers within the sampled subset. We analyze the steady-state performance of the system when system load varies according to λ(n)=1βnα\lambda(n) =1 - \beta n^{-\alpha} for α[0,1)\alpha \in [0,1), and β0\beta \geq 0. Our interest is to find how large the subset k(n)k(n) should be in order to have zero blocking and maximum speed-up in the limit as nn \to \infty. We first characterize the system's performance when the jobs have access to the full system, i.e., k(n)=nk(n)=n. In this setting, we show that the blocking probability approaches to zero at the rate O(1/n)O(1/\sqrt{n}) and the mean response time of accepted jobs approaches to its minimum achievable value at rate O(1/n)O(1/n). We then consider the case where the jobs only have access to subset of servers, i.e., k(n)<nk(n) < n. We show that as long as k(n)=ω(nα)k(n)=\omega(n^\alpha), the same asymptotic performance can be achieved as in the case with full system access. In particular, for k(n)=Θ(nαlogn)k(n)=\Theta(n^\alpha \log n), we show that both the blocking probability and the mean response time approach to their desired limits at rate O(n(1α)/2)O(n^{-(1-\alpha)/2}).

Keywords

Cite

@article{arxiv.2309.00060,
  title  = {On the Performance of Large Loss Systems with Adaptive Multiserver Jobs},
  author = {Samira Ghanbarian and Arpan Mukhopadhyay and Fabrice M. Guillemin and Ravi R. Mazumdar},
  journal= {arXiv preprint arXiv:2309.00060},
  year   = {2023}
}