English
Related papers

Related papers: Fluid Models of Many-server Queues with Abandonmen…

200 papers

Large language models now serve millions of users daily, with providers incurring costs exceeding $700,000 per day. Each request requires token-by-token inference, making GPU scheduling central to latency, capacity, and cost. The difficulty…

Machine Learning · Computer Science 2026-05-18 Ruicheng Ao , Gan Luo , David Simchi-Levi , Xinshang Wang

We consider a discrete-time system comprising a first-come-first-served queue, a non-preemptive server, and a stationary non-work-conserving scheduler. New tasks enter the queue according to a Bernoulli process with a pre-specified arrival…

Applications · Statistics 2020-08-05 Michael Lin , Nuno C. Martins , Richard J. La

We consider a stochastic fluid queue served by a constant rate server and driven by a process which is the local time of a certain Markov process. Such a stochastic system can be used as a model in a priority service system, especially when…

Probability · Mathematics 2007-09-11 Takis Konstantopoulos , Andreas Kyprianou , Marina Sirvio , Paavo Salminen

We consider a queueing network in which there are constraints on which queues may be served simultaneously; such networks may be used to model input-queued switches and wireless networks. The scheduling policy for such a network specifies…

Probability · Mathematics 2012-03-07 Devavrat Shah , Damon Wischik

In this paper, we consider a L\'evy-driven fluid queueing system where the server may subject to breakdowns and repairs. In addition, the server will leave for a vacation each time when he finds an empty system. We cast the queueing process…

Probability · Mathematics 2015-06-16 Jinbiao Wu , Zaiming Liu , Yi Peng

Currently, there is no general theory for deriving diffusion approximations of queueing systems with high- or infinite-dimensional state descriptors. In this paper, we explore one path for deriving diffusion limit equations of queueing…

Probability · Mathematics 2026-05-28 Eva H Loeser

We study a queueing network with a single shared server, that serves the queues in a cyclic order according to the gated service discipline. External customers arrive at the queues according to independent Poisson processes. After…

Probability · Mathematics 2014-09-11 Marko Boon , Rob van der Mei , Erik Winands

The advent of digital twins (DT) for the control and management of communication networks requires accurate and fast methods to estimate key performance indicators (KPI) needed for autonomous decision-making. Among several alternatives,…

Networking and Internet Architecture · Computer Science 2024-05-29 Franco Coltraro , Marc Ruiz , Luis Velasco

We use an Ornstein--Uhlenbeck (OU) process to approximate the queue length process in a $GI/GI/n+M$ queue. This one-dimensional diffusion model is able to produce accurate performance estimates in two overloaded regimes: In the first…

Probability · Mathematics 2013-12-17 Shuangchi He

We study the problem of equitably and efficiently allocating an arriving resource to multiple queues with customer abandonment. The problem is motivated by the cadaveric liver allocation system of the United States, which includes a large…

Optimization and Control · Mathematics 2023-09-19 Shukai Li , Sanjay Mehrotra

We consider the problem of scheduling a queueing system in which many statistically identical servers cater to several classes of impatient customers. Service times and impatience clocks are exponential while arrival processes are renewal.…

Probability · Mathematics 2007-05-23 Rami Atar , Avi Mandelbaum , Martin I. Reiman

In the present paper, we study the evolution of an overloaded cyclic polling model that starts empty. Exploiting a connection with multitype branching processes, we derive fluid asymptotics for the joint queue length process. Under passage…

Probability · Mathematics 2014-10-24 Maria Frolkova , Sergey Foss , Bert Zwart

We derive a modular fluid-flow network congestion control model based on a law of fundamental nature in networks: the conservation of information. Network elements such as queues, users, and transmission channels and network performance…

Networking and Internet Architecture · Computer Science 2016-11-18 C. Briat , E. A. Yavuz , H. Hjalmarsson , K. H. Johansson , U. T. Jönsson , G. Karlsson , H. Sandberg

The paper studies a multiserver retrial queueing system with $m$ servers. Arrival process is a point process with strictly stationary and ergodic increments. A customer arriving to the system occupies one of the free servers. If upon…

Probability · Mathematics 2021-07-01 Vyacheslav M. Abramov

This is an expository review paper illustrating the ``martingale method'' for proving many-server heavy-traffic stochastic-process limits for queueing models, supporting diffusion-process approximations. Careful treatment is given to an…

Probability · Mathematics 2007-12-28 Guodong Pang , Rishi Talreja , Ward Whitt

The large-time behavior of a nonlinearly coupled pair of measure-valued transport equations with discontinuous boundary conditions, parameterized by a positive real-valued parameter $\lambda$, is considered. These equations describe the…

Probability · Mathematics 2021-07-13 Rami Atar , Weining Kang , Haya Kaspi , Kavita Ramanan

We analyze an M/M/1 queue with a service discipline in which customers, upon arriving when the server is busy, search a sequence of stations for a vacant station at which to wait, and in which the server, upon becoming free when one or more…

Probability · Mathematics 2011-08-29 Patrick Eschenfeldt , Ben Gross , Nicholas Pippenger

We study networks of interacting queues governed by utility-maximising service-rate allocations in both discrete and continuous time. For {\em finite} networks we establish stability and some steady-state moment bounds under natural…

Probability · Mathematics 2019-08-21 Seva Shneer , Alexander Stolyar

A fundamental challenge in large-scale cloud networks and data centers is to achieve highly efficient server utilization and limit energy consumption, while providing excellent user-perceived performance in the presence of uncertain and…

Probability · Mathematics 2017-06-23 Debankur Mukherjee , Souvik Dhara , Sem Borst , Johan S. H. van Leeuwaarden

Motivated by the ongoing COVID-19 pandemic, this paper investigates customers' infection risk by evaluating the overlapping time of a virtual customer with others in queueing systems. Most of the current methodologies focus on…

Probability · Mathematics 2022-11-09 Young Myoung Ko , Jin Xu