English
Related papers

Related papers: Large-scale parallel server system with multi-comp…

200 papers

We study the Multiserver-Job Queuing Model (MJQM) with general independent arrivals and service times under FCFS scheduling, using stochastic recurrence equations (SREs) and ergodic theory. We prove the monotonicity and separability…

Performance · Computer Science 2026-01-29 Francois Baccelli , Diletta Olliaro , Marco Ajmone Marsan , Andrea Marin

We present the explicit construction of a stable queue with several servers and impatient customers, under stationary ergodic assumptions. Using a stochastic comparison of the (multivariate) workload sequence with two monotonic stochastic…

Probability · Mathematics 2017-11-20 Pascal Moyal

We identify general conditions under which regenerative processes with dependent cycles and cycle lengths are asymptotically independent. The result is applied to various models. In particular, independent L\'evy processes with dependent…

Probability · Mathematics 2017-11-22 Royi Jacobovic , Offer Kella

We consider the model of a token-based joint auto-scaling and load balancing strategy, proposed in a recent paper by Mukherjee, Dhara, Borst, and van Leeuwaarden (SIGMETRICS '17, arXiv:1703.08373), which offers an efficient scalable…

Probability · Mathematics 2020-02-27 Debankur Mukherjee , Alexander Stolyar

The model is a service system, consisting of several large server pools. A server processing speed and buffer size (which may be finite or infinite) depend on the pool. The input flow of customers is split equally among a fixed number of…

Probability · Mathematics 2016-08-05 Alexander Stolyar

In this study, we consider multi-class multi-server asymmetric queueing systems consisting of $N$ queues on one side and $K$ servers on the other side, where jobs randomly arrive in queues at each time. The service rate of each job-server…

Machine Learning · Statistics 2025-05-07 Jung-hun Kim , Min-hwan Oh

Zero queueing delay is highly desirable in large-scale computing systems. Existing work has shown that it can be asymptotically achieved by using the celebrated Power-of-$d$-choices (pod) policy with a probe overhead $d =…

Performance · Computer Science 2020-11-03 Wentao Weng , Weina Wang

Recent development of peer-to-peer (P2P) services (e.g. streaming, file sharing, and storage) systems introduces a new type of queue systems that receive little attention before, where both job and server arrive and depart randomly. Current…

Performance · Computer Science 2016-05-11 Taoyu Li , Minghua Chen , Tony Lee , Xing Li

In this thesis, we propose and analyze a multi-server model that captures a performance trade-off between centralized and distributed processing. In our model, a fraction $p$ of an available resource is deployed in a centralized manner…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-03-23 Kuang Xu

The infinite-server queueing models with homogeneous and non-homogeneous arrivals of customers and catastrophes are considered. The probability generating functions of joint distributions of numbers of busy servers and served customers, as…

Optimization and Control · Mathematics 2018-07-24 Khanik Kerobyan

We study a two-type server queueing system where flexible Type-I servers, upon their initial interaction with jobs, decide in real time whether to process them independently or in collaboration with dedicated Type-II servers. Independent…

Optimization and Control · Mathematics 2026-01-21 Shuwen Lu , Mark E. Lewis , Jamol Pender

In practice, standard scheduling of parallel computing jobs almost always leaves significant portions of the available hardware unused, even with many jobs still waiting in the queue. The simple reason is that the resource requests of these…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-04 Florian Spenke , Karsten Balzer , Sascha Frick , Bernd Hartke , Johannes M. Dieterich

Randomized load balancing networks arise in a variety of applications, and allow for efficient sharing of resources, while being relatively easy to implement. We consider a network of parallel queues in which incoming jobs with independent…

Probability · Mathematics 2017-10-13 Reza Aghajani , Kavita Ramanan

We study infinite-horizon asymptotic average optimality for parallel server network with multiple classes of jobs and multiple server pools in the Halfin-Whitt regime. Three control formulations are considered: 1) minimizing the queueing…

Optimization and Control · Mathematics 2019-03-20 Ari Arapostathis , Guodong Pang

Multi-server queueing systems are widely used models for job scheduling in machine learning, wireless networks, crowdsourcing, and healthcare systems. This paper considers a multi-server system with multiple servers and multiple types of…

Machine Learning · Computer Science 2023-06-05 Zixian Yang , R. Srikant , Lei Ying

In this paper, we study systems where each job or request can be split into a flexible number of sub-jobs up to a maximum limit. The number of sub-jobs a job is split into depends on the number of available servers found upon its arrival.…

Probability · Mathematics 2023-09-04 Samira Ghanbarian , Arpan Mukhopadhyay , Fabrice M. Guillemin , Ravi R. Mazumdar

We analyze randomized dynamic load balancing schemes for multi-server processor sharing systems when the number of servers in the system is large and the servers have heterogeneous service rates. In particular, we focus on the classical…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-02-11 Arpan Mukhopadhyay , Ravi R. Mazumdar

After a short report of results on infinite servers queues systems, focusing on its busy period, using networks of queues with infinite servers nodes a model is constructed to study a two echelons repair system. These repair systems may be…

Probability · Mathematics 2021-10-06 Manuel Alberto M. Ferreira

In this paper we study the uniform stability properties of two classes of parallel server networks with multiple classes of jobs and multiple server pools of a tree topology. These include a class of networks with a single non-leaf server…

Optimization and Control · Mathematics 2022-03-22 Hassan Hmedi , Ari Arapostathis , Guodong Pang

The Join-the-Shortest-Queue routing policy is studied in an asymptotic regime where the number of processors $n$ scales with the arrival rate. A large deviation principle (LDP) for the occupancy process is established, as $n\to \infty$, in…

Probability · Mathematics 2025-08-12 Amarjit Budhiraja , Eric Friedlander , Ruoyu Wu