English
Related papers

Related papers: Job Dispatching Policies for Queueing Systems with…

200 papers

We consider the following distributed service model: jobs with unit mean, exponentially distributed, and independent processing times arrive as a Poisson process of rate $\lambda n$, with $0<\lambda<1$, and are immediately dispatched by a…

Probability · Mathematics 2017-09-14 David Gamarnik , John N. Tsitsiklis , Martin Zubeldia

We consider a simple computation offloading model where jobs can either be fully processed in the cloud or be partially processed at a local server before being sent to the cloud to complete processing. Our goal is to design a policy for…

Systems and Control · Electrical Eng. & Systems 2025-09-24 Darin Jeff , Eytan Modiano

A queue is required when a service provider is not able to handle jobs arriving over the time. In a highly flexible and dynamic environment, some jobs might demand for faster execution at run-time especially when the resources are limited…

Performance · Computer Science 2015-03-24 Yash Gupta , Kamalakar Karlapalem

Traditionally, research focusing on the design of routing and staffing policies for service systems has modeled servers as having fixed (possibly heterogeneous) service rates. However, service systems are generally staffed by people.…

Computer Science and Game Theory · Computer Science 2016-03-24 Ragavendran Gopalakrishnan , Sherwin Doroudi , Amy R. Ward , Adam Wierman

Recent workload measurements in Google data centers provide an opportunity to challenge existing models and, more broadly, to enhance the understanding of dispatching policies in computing clusters. Through extensive data-driven…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-27 Mert Yildiz , Alexey Rolich , Andrea Baiocchi

Heterogeneity is becoming increasingly ubiquitous in modern large-scale computer systems. Developing good load balancing policies for systems whose resources have varying speeds is crucial in achieving low response times. Indeed, how best…

Performance · Computer Science 2020-06-26 Kristen Gardner , Jazeem Abdul Jaleel , Alexander Wickeham , Sherwin Doroudi

A large proportion of jobs submitted to modern computing clusters and data centers are parallelizable and capable of running on a flexible number of computing cores or servers. Although allocating more servers to such a job results in a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-17 Samira Ghanbarian , Arpan Mukhopadhyay , Ravi R. Mazumdar , Fabrice M. Guillemin

We study a class of scheduling problems, where each job is divided into a batch of unit-size tasks and these tasks can be executed in parallel on multiple servers with New-Better-than-Used (NBU) service time distributions. While many delay…

Networking and Internet Architecture · Computer Science 2023-10-02 Yin Sun , C. Emre Koksal , Ness B. Shroff

Most existing routing strategies to improve transport efficiency have little attention what order should the packets be delivered, just simply used first-in-first-out queue discipline. However, it is far from optimal. In this paper we apply…

Networking and Internet Architecture · Computer Science 2018-01-11 Ganhua Wu , Huijie Yang

We consider a service system with an infinite number of exponential servers sharing a finite service capacity. The servers are ordered according to their speed, and arriving customers join the fastest idle server. A capacity allocation is…

Probability · Mathematics 2018-08-23 Refael Hassin , Liron Ravner

We consider a natural scheduling problem which arises in many distributed computing frameworks. Jobs with diverse resource requirements (e.g. memory requirements) arrive over time and must be served by a cluster of servers, each with a…

Networking and Internet Architecture · Computer Science 2019-01-21 Konstantinos Psychas , Javad Ghaderi

In multi-server distributed queueing systems, the access of stochastically arriving jobs to resources is often regulated by a dispatcher, also known as load balancer. A fundamental problem consists in designing a load balancing algorithm…

Probability · Mathematics 2025-02-23 Jonatha Anselmi , Francois Dufour

In the context of load balancing, Lu et al. introduced the distributed Join-Idle-Queue algorithm, where a group of dispatchers distribute jobs to a cluster of parallel servers. Each dispatcher maintains a queue of idle servers; when a job…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-07 Michael Mitzenmacher

We study the design of dynamic scheduling controls in closed queueing networks with a fixed number of jobs. Each time a server becomes available, the controller has (limited) flexibility in choosing the buffer from which to serve a job. If…

Probability · Mathematics 2022-10-18 Siddhartha Banerjee , Yash Kanoria , Pengyu Qian

Retailers use a variety of mechanisms to enable sales and delivery. A relatively new offering by companies is curbside pickup where customers purchase goods online, schedule a pickup time, and come to a pickup facility to receive their…

Optimization and Control · Mathematics 2020-05-27 Bahar Çavdar , Tuğçe Işık

We consider a discrete-time system comprising a first-come-first-served queue, a non-preemptive server, and a scheduler that governs the assignment of tasks in the queue to the server. The server has an availability state that indicates, at…

Applications · Statistics 2021-01-15 Michael Lin , Richard J. La , Nuno C. Martins

We consider a heterogeneous distributed service system, consisting of $n$ servers with unknown and possibly different processing rates. Jobs with unit mean and independent processing times arrive as a renewal process of rate $\lambda n$,…

Performance · Computer Science 2020-07-15 David Gamarnik , John N. Tsitsiklis , Martin Zubeldia

We study the problem of deploying a fleet of mobile robots to service tasks that arrive stochastically over time and at random locations in an environment. This is known as the Dynamic Vehicle Routing Problem (DVRP) and requires robots to…

We study the scheduling polices for asymptotically optimal delay in queueing systems with switching overhead. Such systems consist of a single server that serves multiple queues, and some capacity is lost whenever the server switches to…

Performance · Computer Science 2017-01-17 Ping-Chun Hsieh , I-Hong Hou , Xi Liu

We consider a queueing system composed of a dispatcher that routes deterministically jobs to a set of non-observable queues working in parallel. In this setting, the fundamental problem is which policy should the dispatcher implement to…

Performance · Computer Science 2025-02-23 Jonatha Anselmi , Bruno Gaujal , Tommaso Nesti