English
Related papers

Related papers: Zero-Waiting Load Balancing with Heterogeneous Ser…

200 papers

Current-day data centers and high-volume cloud services employ a broad set of heterogeneous servers. In such settings, client requests typically arrive at multiple entry points, and dispatching them to servers is an urgent distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-27 Guy Goren , Shay Vargaftik , Yoram Moses

The model is motivated by the problem of load distribution in large-scale cloud-based data processing systems. We consider a heterogeneous service system, consisting of multiple large server pools. The pools are different in that their…

Probability · Mathematics 2015-06-11 Alexander Stolyar

To efficiently manage serverless computing platforms, a key aspect is the auto-scaling of services, i.e., the set of computational resources allocated to a service adapts over time as a function of the traffic demand. The objective is to…

Optimization and Control · Mathematics 2025-02-13 Jonatha Anselmi , Bruno Gaujal , Louis-Sebastien Rebuffi

Understanding the detailed queueing behavior of a networking session is critical in enabling low-latency services over the Internet. Especially when the packet arrival and service rates at the queue of a link vary over time and moreover…

Networking and Internet Architecture · Computer Science 2017-04-25 Wonjun Hwang , Yoora Kim , Kyunghan Lee

In 1987, J.W. Cohen analyzed the so-called Serve the Longest Queue (SLQ) queueing system, where a single server attends two non-symmetric $M/G/1$-type queues, exercising a non-preemptive priority switching policy. Cohen further analyzed in…

Probability · Mathematics 2022-04-19 Efrat Perel , Nir Perel , Uri Yechiali

Queueing networks are typically modelled assuming that the arrival process is exogenous, and unaffected by admission control, scheduling policies, etc. In many situations, however, users choose the time of their arrival strategically,…

Computer Science and Game Theory · Computer Science 2011-12-15 Harsha Honnappa , Rahul Jain

This paper addresses the analysis of the queue-length process of single-server queues under overdispersion, i.e., queues fed by an arrival process for which the variance of the number of arrivals in a given time window exceeds the…

Probability · Mathematics 2020-04-21 Onno Boxma , Mariska Heemskerk , Michel Mandjes

This work studies queues in a Euclidean space. Consider $N$ servers that are distributed uniformly in $[0,1]^d$. Customers arrive at the servers according to independent stationary processes. Upon arrival, they probabilistically decide…

Probability · Mathematics 2024-09-05 B. R. Vinay Kumar , Lasse Leskelä

This study presents a multi-zone queuing network model for steady-state ride-pooling operations that serve heterogeneous demand, and then builds upon this model to optimize the design of ride-pooling services. Spatial heterogeneity is…

Optimization and Control · Mathematics 2023-06-29 Yining Liu , Yanfeng Ouyang

We introduce a multiclass single-server queueing system in which the arrival rates depend on the current job in service. The system is characterized by a matrix of arrival rates in lieu of a vector of arrival rates. Our proposed model…

Probability · Mathematics 2018-08-21 Philip Ernst , Søren Asmussen , John Hasenbein

We consider the FCFS $\mathit{GI}/\mathit{GI}/n$ queue in the so-called Halfin-Whitt heavy traffic regime. We prove that under minor technical conditions the associated sequence of steady-state queue length distributions, normalized by…

Probability · Mathematics 2013-12-04 David Gamarnik , David A. Goldberg

Full-duplex wireless communication has the potential to double the capacity of wireless networks by reducing the band occupancy of transmissions. However, a full-duplex capability cannot always reduce the band occupancy because the real…

Networking and Internet Architecture · Computer Science 2018-12-18 Makoto Kobayashi , Shunsuke Saruwatari , Takashi Watanabe

Heavy traffic analysis for load balancing policies has relied heavily on the condition of state-space collapse onto a single-dimensional line in previous works. In this paper, via Lyapunov-drift analysis, we rigorously prove that even under…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-11 Xingyu Zhou , Jian Tan , Ness Shroff

This paper presents a heavy-traffic analysis of the behavior of a single-server queue under an Earliest-Deadline-First (EDF) scheduling policy in which customers have deadlines and are served only until their deadlines elapse. The…

Probability · Mathematics 2011-04-07 Łukasz Kruk , John Lehoczky , Kavita Ramanan , Steven Shreve

We study a general $k$ dimensional infinite server queues process with Markov switching, Poisson arrivals and where the service times are fat tailed with index $\alpha\in (0,1)$. When the arrival rate is sped up by a factor $n^\gamma$, the…

Probability · Mathematics 2021-06-21 Landy Rabehasaina

The discrete time queueing system is highly applicable to modern telecommunication systems, where it provides adaptive packet handling, congestion controlled security/inspection, energy efficient operation, and supports bursty traffic…

Information Theory · Computer Science 2026-02-27 Ashish Verma , Sourav Pradhan

Heterogeneous computing systems provide high performance and energy efficiency. However, to optimally utilize such systems, solutions that distribute the work across host CPUs and accelerating devices are needed. In this paper, we present a…

Software Engineering · Computer Science 2021-06-04 Suejb Memeti , Sabri Pllana

Dynamic affinity load balancing of multi-type tasks on multi-skilled servers, when the service rate of each task type on each of the servers is known and can possibly be different from each other, is an open problem for over three decades.…

Performance · Computer Science 2020-03-05 Ali Yekkehkhany , Rakesh Nagi

We study a dynamic scheduling problem for a multi-class queueing network with a large pool of statistically identical servers. The arrival processes are Poisson, and service times and patience times are assumed to be exponentially…

Probability · Mathematics 2015-10-30 Ari Arapostathis , Anup Biswas , Guodong Pang

We study a queueing network with a single shared server that serves the queues in a cyclic order. External customers arrive at the queues according to independent Poisson processes. After completing service, a customer either leaves the…

Probability · Mathematics 2014-08-04 Marko Boon , Rob van der Mei , Erik Winands