English
Related papers

Related papers: Zero-Waiting Load Balancing with Heterogeneous Ser…

200 papers

This paper examines a continuous-time routing system with general interarrival and service time distributions, operating under the join-the-shortest-queue and power-of-two-choices policies. Under a weaker set of assumptions than those…

Probability · Mathematics 2025-03-28 Jin Guang , Yaosheng Xu , J. G. Dai

Motivated by applications in online marketplaces such as ride-hailing, we study how strategic servers impact the system performance. We consider a discrete-time process in which, heterogeneous types of customers and servers arrive. Each…

Optimization and Control · Mathematics 2021-06-25 Sushil Mahavir Varma , Francisco Castro , Siva Theja Maguluri

We consider the heavy-traffic approximation to the $GI/M/s$ queueing system in the Halfin-Whitt regime, where both the number of servers $s$ and the arrival rate $\lambda$ grow large (taking the service rate as unity), with…

Probability · Mathematics 2013-02-14 Brian H. Fralix , Charles Knessl , Johan S. H. van Leeuwaarden

We consider an M/M/N/K/FCFS system (N>0, K>=N), where the servers operate at (possibly) heterogeneous service rates. In this situation, the steady state behavior depends on the routing policy that is used to select which idle server serves…

Performance · Computer Science 2016-03-23 Sherwin Doroudi , Ragavendran Gopalakrishnan

We consider load balancing in large-scale heterogeneous server systems in the presence of data locality that imposes constraints on which tasks can be assigned to which servers. The constraints are naturally captured by a bipartite graph…

Probability · Mathematics 2022-12-01 Zhisheng Zhao , Debankur Mukherjee , Ruoyu Wu

This paper examines the performance of multi-class multi-server bipartite queueing systems under a FCFS-ALIS service discipline, where each arriving customer is only compatible with a subset of servers. We analyze the system under…

Probability · Mathematics 2023-03-31 Lisa Aoki Hillas , Rene Caldentey , Varun Gupta

This paper studies the steady-state properties of the Join the Shortest Queue model in the Halfin-Whitt regime. We focus on the process tracking the number of idle servers, and the number of servers with non-empty buffers. Recently,…

Probability · Mathematics 2019-06-12 Anton Braverman

Recent development of peer-to-peer (P2P) services (e.g. streaming, file sharing, and storage) systems introduces a new type of queue systems that receive little attention before, where both job and server arrive and depart randomly. Current…

Performance · Computer Science 2016-05-11 Taoyu Li , Minghua Chen , Tony Lee , Xing Li

A many-server queueing system is considered in which customers arrive according to a renewal process and have service and patience times that are drawn from two independent sequences of independent, identically distributed random variables.…

Probability · Mathematics 2012-04-30 Weining Kang , Kavita Ramanan

Traffic load-balancing in datacenters alleviates hot spots and improves network utilization. In this paper, a stable in-network load-balancing algorithm is developed in the setting of software-defined networking. A control plane configures…

Networking and Internet Architecture · Computer Science 2016-12-07 Sucha Supittayapornpong , Michael J. Neely

We consider a service system with an infinite number of exponential servers sharing a finite service capacity. The servers are ordered according to their speed, and arriving customers join the fastest idle server. A capacity allocation is…

Probability · Mathematics 2018-08-23 Refael Hassin , Liron Ravner

Load balancing across parallel servers is an important class of congestion control problems that arises in service systems. An effective load balancer relies heavily on accurate, real-time congestion information to make routing decisions.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-24 Gal Mendelson , Xu Kuang

We consider a general queueing system with price-sensitive customers in which the service provider seeks to balance two objectives, maximizing the average revenue rate and minimizing the average queue length. Customers arrive according to a…

Data Structures and Algorithms · Computer Science 2025-12-09 Jacob Bergquist , Adam N. Elmachtoub

Zero queueing delay is highly desirable in large-scale computing systems. Existing work has shown that it can be asymptotically achieved by using the celebrated Power-of-$d$-choices (pod) policy with a probe overhead $d =…

Performance · Computer Science 2020-11-03 Wentao Weng , Weina Wang

Performance evaluation of the routing node in terms of latency is the characteristics of an efficient design of Buffer in input module. It is intended to study and quantify the behavior of the single packet array design in relation to the…

Hardware Architecture · Computer Science 2013-02-19 Nilesh A. Mohota , Sanjay L. Badjate

Single-server queues with customer abandonment arise in call centers and many service systems, but steady-state performance measures remain analytically intractable beyond Markovian assumptions. This paper develops Robust Queueing (RQ)…

Probability · Mathematics 2026-03-03 Wei You

Distributed load balancing is the act of allocating jobs among a set of servers as evenly as possible. There are mainly two versions of the load balancing problem that have been studied in the literature: static and dynamic. The static…

Performance · Computer Science 2020-11-04 Nitish K. Panigrahy , Thirupathaiah Vasantam , Prithwish Basu , Don Towsley

Motivated by applications in data center networks, in this paper, we study the problem of scheduling in an input queued switch. While throughput maximizing algorithms in a switch are well-understood, delay analysis was developed only…

Probability · Mathematics 2022-06-15 Prakirt Jhunjhunwala , Siva Theja Maguluri

We study the problem of assigning $K$ identical servers to a set of $N$ parallel queues in a time-slotted queueing system. The connectivity of each queue to each server is randomly changing with time; each server can serve at most one queue…

Optimization and Control · Mathematics 2015-03-19 Hassan Halabian , Ioannis Lambadaris , Yannis Viniotis , Chung-Horng Lung

In this paper, we study the stability of light traffic achieved by a scheduling algorithm which is suitable for heterogeneous traffic networks. Since analyzing a scheduling algorithm is intractable using the conventional mathematical tool,…

Networking and Internet Architecture · Computer Science 2016-04-07 Rukhsana Ruby , Victor C. M. Leung