English
Related papers

Related papers: Logarithmic Heavy Traffic Error Bounds in Generali…

200 papers

The deployment of machine learning in high-stakes services relies on ``human-in-the-loop'' architectures to mitigate algorithmic uncertainty. However, existing static policies fail to address a fundamental tension: algorithms suffer from…

Optimization and Control · Mathematics 2026-02-02 Ziyao Wang , Svetlozar T Rachev

Over 40% of computational power in Large Language Model (LLM) serving systems can be systematically wasted - not from hardware limits, but from load imbalance in barrier-synchronized parallel processing. When progress is gated by the…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-03 Zixi Chen , Tianci Bu , Chendong Song , Xin Lu , Yinyu Ye , Zijie Zhou

We investigate the functional limits of generalized Jackson networks in a multi-scale heavy traffic regime where stations approach full utilization at distinct, separated rates. Our main result shows that the appropriately scaled queue…

Probability · Mathematics 2025-08-26 Zhen-Qing Chen , J. G. Dai , Jin Guang

A fundamental challenge in large-scale cloud networks and data centers is to achieve highly efficient server utilization and limit energy consumption, while providing excellent user-perceived performance in the presence of uncertain and…

Probability · Mathematics 2017-06-23 Debankur Mukherjee , Souvik Dhara , Sem Borst , Johan S. H. van Leeuwaarden

We examine a queue-based random-access algorithm where activation and deactivation rates are adapted as functions of queue lengths. We establish its heavy traffic behavior on a complete interference graph, which turns out to be highly…

Probability · Mathematics 2021-06-08 Eyal Castiel , Sem Borst , Laurent Miclo , Florian Simatos , Philip Whiting

We study a single server FIFO queue that offers general service. Each of n customers enter the queue at random time epochs that are inde- pendent and identically distributed. We call this the random scattering traffic model, and the…

Probability · Mathematics 2017-08-21 Peter W. Glynn , Harsha Honnappa

In this paper, we study stability and latency of routing in wireless networks where it is assumed that no collision will occur. Our approach is inspired by the adversarial queuing theory, which is amended in order to model wireless…

Networking and Internet Architecture · Computer Science 2010-06-08 Vicent Cholvi , Dariusz R. Kowalski

Heavy traffic analysis for load balancing policies has relied heavily on the condition of state-space collapse onto a single-dimensional line in previous works. In this paper, via Lyapunov-drift analysis, we rigorously prove that even under…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-11 Xingyu Zhou , Jian Tan , Ness Shroff

In the online packet buffering problem (also known as the unweighted FIFO variant of buffer management), we focus on a single network packet switching device with several input ports and one output port. This device forwards unit-size,…

Data Structures and Algorithms · Computer Science 2012-08-15 Marcin Bienkowski

Packet traffic in complex networks undergoes the jamming transition from free-flow to congested state as the number of packets in the system increases. Here we study such jamming transition when queues are operated by the priority queuing…

Other Condensed Matter · Physics 2015-05-13 K. Kim , B. Kahng , D. Kim

We consider the heavy-traffic approximation to the $GI/M/s$ queueing system in the Halfin-Whitt regime, where both the number of servers $s$ and the arrival rate $\lambda$ grow large (taking the service rate as unity), with…

Probability · Mathematics 2013-02-14 Brian H. Fralix , Charles Knessl , Johan S. H. van Leeuwaarden

We analyze opportunistic schemes for transmission scheduling from one of $n$ homogeneous queues whose channel states fluctuate independently. Considered schemes consist of the LCQ policy, which transmits from a longest connected queue in…

Performance · Computer Science 2008-10-02 Murat Alanyali , Maxim Dashouk

We present an overview of scalable load balancing algorithms which provide favorable delay performance in large-scale systems, and yet only require minimal implementation overhead. Aimed at a broad audience, the paper starts with an…

Performance · Computer Science 2017-12-25 Mark van der Boor , Sem C. Borst , Johan S. H. van Leeuwaarden , Debankur Mukherjee

With the rapid advance of information technology, network systems have become increasingly complex and hence the underlying system dynamics are often unknown or difficult to characterize. Finding a good network control policy is of…

Performance · Computer Science 2022-04-08 Bai Liu , Qiaomin Xie , Eytan Modiano

Modern networks exhibit a high degree of variability in link rates. Cellular network bandwidth inherently varies with receiver motion and orientation, while class-based packet scheduling in datacenter and service provider networks induces…

Networking and Internet Architecture · Computer Science 2022-02-10 Prateesh Goyal , Mohammad Alizadeh , Thomas E. Anderson

In this thesis, we propose and analyze a multi-server model that captures a performance trade-off between centralized and distributed processing. In our model, a fraction $p$ of an available resource is deployed in a centralized manner…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-03-23 Kuang Xu

In this work, we study the stationary distribution of the scaled queue length vector process in multiclass queueing networks operating under static buffer priority service policies. We establish that when subjected to a multi-scale heavy…

Probability · Mathematics 2024-11-06 J. G. Dai , Dongyan Huo

The Join-the-Shortest-Queue (JSQ) load-balancing scheme is known to minimise the average delay of jobs in homogeneous systems consisting of identical servers. However, it performs poorly in heterogeneous systems where servers have different…

Probability · Mathematics 2022-10-04 Sanidhay Bhambay , Arpan Mukhopadhyay

We establish a unified analytical framework for load balancing systems, which allows us to construct a general class $\Pi$ of policies that are both throughput optimal and heavy-traffic delay optimal. This general class $\Pi$ includes as…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-13 Xingyu Zhou , Fei Wu , Jian Tan , Yin Sun , Ness Shroff

We consider the FCFS $GI/GI/n$ queue in the Halfin-Whitt heavy traffic regime, and prove bounds for the steady-state probability of delay (s.s.p.d.) for generally distributed processing times. We prove that there exist $\epsilon_1,…

Probability · Mathematics 2016-09-02 David A. Goldberg