English
Related papers

Related papers: Staffing Large Service Systems Under Arrival-rate …

200 papers

In this work, we are interested in studying multi-agent routing settings, where adversarial agents are part of the assignment and decision loop, degrading the performance of the fleet by incurring bounded delays while servicing…

Multiagent Systems · Computer Science 2025-04-02 Roee M. Francos , Daniel Garces , Stephanie Gil

Arrival processes to service systems often display fluctuations that are larger than anticipated under the Poisson assumption, a phenomenon that is referred to as overdispersion. Motivated by this, we analyze a class of discrete stochastic…

We consider Markovian many-server systems with admission control operating in a QED regime, where the relative utilization approaches unity while the number of servers grows large, providing natural Economies-of-Scale. In order to determine…

Probability · Mathematics 2014-11-12 Jaron Sanders , S. C. Borst , A. J. E. M. Janssen , J. S. H. van Leeuwaarden

We consider a queue to which only a finite pool of $n$ customers can arrive, at times depending on their service requirement. A customer with stochastic service requirement $S$ arrives to the queue after an exponentially distributed time…

Probability · Mathematics 2017-04-12 Gianmarco Bet , Remco van der Hofstad , Johan S. H. van Leeuwaarden

In this paper, we present a condition to obtain instability for a class of queueing networks where the arrival rates in each server are constant and the departure rate in each server is a decreasing function of the queue lengths of other…

Probability · Mathematics 2023-08-01 Pierre Popineau , Seva Shneer

Consider a storage area where arriving items are stored temporarily in bounded capacity stacks until their departure. We look into the problem of deciding where to put an arriving item with the objective of minimizing the maximum number of…

Data Structures and Algorithms · Computer Science 2020-06-11 Martin Olsen , Allan Gross

Multi-server queueing systems are widely used models for job scheduling in machine learning, wireless networks, crowdsourcing, and healthcare systems. This paper considers a multi-server system with multiple servers and multiple types of…

Machine Learning · Computer Science 2023-06-05 Zixian Yang , R. Srikant , Lei Ying

A fundamental challenge in large-scale cloud networks and data centers is to achieve highly efficient server utilization and limit energy consumption, while providing excellent user-perceived performance in the presence of uncertain and…

Probability · Mathematics 2017-06-23 Debankur Mukherjee , Souvik Dhara , Sem Borst , Johan S. H. van Leeuwaarden

In this paper we study a two-queue polling model with zero switch-over times and $k$-limited service (serve at most $k_i$ customers during one visit period to queue $i$, $i=1,2$) in each queue. The arrival processes at the two queues are…

Probability · Mathematics 2019-02-20 Marko Boon , Erik Winands

In this paper, we consider a $G_t/G_t/\infty$ infinite server queueing model in a random environment. More specifically, the arrival rate in our server is modeled as a highly fluctuating stochastic process, which arguably takes into account…

Probability · Mathematics 2020-04-13 Harsha Honnappa , Yiran Liu , Samy Tindel , Aaron Yip

We study the problem of metrical service systems with multiple servers (MSSMS), which generalizes two well-known problems -- the $k$-server problem, and metrical service systems. The MSSMS problem is to service requests, each of which is an…

Data Structures and Algorithms · Computer Science 2014-05-22 Ashish Chiplunkar , Sundar Vishwanathan

Understanding how delayed information impacts queueing systems is an important area of research. However, much of the current literature neglects one important feature of many queueing systems, namely non-stationary arrivals. Non-stationary…

Dynamical Systems · Mathematics 2017-01-20 Jamol Pender , Richard H. Rand , Elizabeth Wesson

The paper studies a multiserver retrial queueing system with $m$ servers. Arrival process is a point process with strictly stationary and ergodic increments. A customer arriving to the system occupies one of the free servers. If upon…

Probability · Mathematics 2021-07-01 Vyacheslav M. Abramov

We consider a multi-stage stochastic lot-sizing problem with service level constraints and supplier-driven product substitution. A firm has multiple products and it has the option to meet demand from substitutable products at a cost.…

Optimization and Control · Mathematics 2023-01-03 Narges Sereshti , Merve Bodur , James R. Luedtke

We consider a service system where agents (or, servers) are invited on-demand. Customers arrive as a Poisson process and join a customer queue. Customer service times are i.i.d. exponential. Agents' behavior is random in two respects.…

Probability · Mathematics 2016-09-09 Lam Nguyen , Alexander Stolyar

We consider a two-queue polling model with switch-over times and $k$-limited service (serve at most $k_i$ customers during one visit period to queue $i$) in each queue. The major benefit of the $k$-limited service discipline is that it -…

Probability · Mathematics 2016-03-07 Marko Boon , Erik Winands

We study the problem of learning, from observational data, fair and interpretable policies that effectively match heterogeneous individuals to scarce resources of different types. We model this problem as a multi-class multi-server queuing…

Machine Learning · Computer Science 2022-06-07 Aida Rahmattalabi , Phebe Vayanos , Kathryn Dullerud , Eric Rice

This work considers a many-server queueing system in which impatient customers with i.i.d., generally distributed service times and i.i.d., generally distributed patience times enter service in the order of arrival and abandon the queue if…

Probability · Mathematics 2010-11-15 Weining Kang , Kavita Ramanan

Large language model (LLM) serving is becoming an increasingly critical workload for cloud providers. Existing LLM serving systems focus on interactive requests, such as chatbots and coding assistants, with tight latency SLO requirements.…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-26 Archit Patke , Dhemath Reddy , Saurabh Jha , Haoran Qiu , Christian Pinto , Chandra Narayanaswami , Zbigniew Kalbarczyk , Ravishankar Iyer

We address the problem of giving robust performance bounds based on the study of the asymptotic behavior of the insensitive load balancing schemes when the number of servers and the load scales jointly. These schemes have the desirable…

Performance · Computer Science 2016-05-11 Matthieu Jonckheere , Balakrishna Prabhu