English
Related papers

Related papers: SEH: Size Estimate Hedging for Single-Server Queue…

200 papers

The problem of online scheduling of multi-server jobs is considered, where there are a total of $K$ servers, and each job requires concurrent service from multiple servers for it to be processed. Each job on its arrival reveals its…

Data Structures and Algorithms · Computer Science 2024-07-02 Rahul Vaze

We consider a distributed server system consisting of a large number of servers, each with limited capacity on multiple resources (CPU, memory, disk, etc.). Jobs with different rewards arrive over time and require certain amounts of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-29 Konstantinos Psychas , Javad Ghaderi

Motivated by recent work on scheduling with predicted job sizes, we consider the performance of scheduling algorithms with minimal advice, namely a single bit. Besides demonstrating the power of very limited advice, such schemes are quite…

Performance · Computer Science 2020-06-30 Michael Mitzenmacher

The shortest-remaining-processing-time (SRPT) scheduling policy has been extensively studied, for more than 50 years, in single-server queues with infinitely patient jobs. Yet, much less is known about its performance in multiserver queues.…

Probability · Mathematics 2021-02-12 Jing Dong , Rouba Ibrahim

In this paper, we explore how a natural generalization of Shortest Remaining Processing Time (SRPT) can be a powerful \emph{meta-algorithm} for online scheduling. The meta-algorithm processes jobs to maximally reduce the objective of the…

Data Structures and Algorithms · Computer Science 2024-09-06 Qingyun Chen , Sungjin Im , Aditya Petety

Efficient scheduling is crucial for interactive Large Language Model (LLM) applications, where low request completion time directly impacts user engagement. Size-based scheduling algorithms like Shortest Remaining Process Time (SRPT) aim to…

Machine Learning · Computer Science 2024-10-03 Rana Shahout , Eran Malach , Chunwei Liu , Weifan Jiang , Minlan Yu , Michael Mitzenmacher

We present and study a new model for energy-aware and profit-oriented scheduling on a single processor. The processor features dynamic speed scaling as well as suspension to a sleep mode. Jobs arrive over time, are preemptable, and have…

Data Structures and Algorithms · Computer Science 2012-09-14 Peter Kling , Andreas Cord-Landwehr , Frederik Mallmann-Trenn

We study size-based schedulers, and focus on the impact of inaccurate job size information on response time and fairness. Our intent is to revisit previous results, which allude to performance degradation for even small errors on job size…

Data Structures and Algorithms · Computer Science 2014-07-28 Matteo Dell'Amico , Damiano Carra , Mario Pastorelli , Pietro Michiardi

We present a new framework for designing nonpreemptive and job-size oblivious scheduling policies in the multiserver-job queueing model. The main requirement is to identify a static and balanced sub-partition of the server set and ensure…

Performance · Computer Science 2025-02-04 Jonatha Anselmi , Josu Doncel

We consider the problem of online preemptive scheduling on a single machine to minimize the total flow time. In clairvoyant scheduling, where job processing times are revealed upon arrival, the Shortest Remaining Processing Time (SRPT)…

Data Structures and Algorithms · Computer Science 2026-02-16 Alexander Lindermayr , Guido Schäfer , Jens Schlöter , Leen Stougie

Service time fluctuations heavily affect the performance of queueing systems, causing long waiting times and backlogs. Recently, it was shown that when service times are solely determined by the server, service resetting can mitigate the…

Probability · Mathematics 2024-10-08 Ofek Lauber Bonomo , Uri Yechiali , Shlomi Reuveni

We consider a single-server queue with renewal arrivals and i.i.d. service times, in which the server employs either the preemptive Shortest Remaining Processing Time (SRPT) policy, or its non-preemptive variant, Shortest Job First (SJF).…

Probability · Mathematics 2010-07-16 H. Christian Gromoll , Martin Keutel

In the context of decision making under explorable uncertainty, scheduling with testing is a powerful technique used in the management of computer systems to improve performance via better job-dispatching decisions. Upon job arrival, a…

Performance · Computer Science 2025-02-13 Jonatha Anselmi , Josu Doncel

Multi-server queueing systems are widely used models for job scheduling in machine learning, wireless networks, crowdsourcing, and healthcare systems. This paper considers a multi-server system with multiple servers and multiple types of…

Machine Learning · Computer Science 2023-06-05 Zixian Yang , R. Srikant , Lei Ying

Serverless functions are a cloud computing paradigm where the provider takes care of resource management tasks such as resource provisioning, deployment, and auto-scaling. The only resource management task that developers are still in…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-08 Simon Eismann , Long Bui , Johannes Grohmann , Cristina L. Abad , Nikolas Herbst , Samuel Kounev

We study the asymptotic response time tail in the M/G/n multi-server queue with heavy-tailed (regularly varying) job sizes, a setting representative of modern computing workloads. For single-server systems, tail optimization is well…

Performance · Computer Science 2026-05-14 Zhouzi Li , Mor Harchol-Balter , Alan Scheller-Wolf

This paper considers the scheduling of stochastic jobs on parallel identical machines to minimize the expected total weighted completion time. While this is a classical problem with a significant body of research on approximation algorithms…

Data Structures and Algorithms · Computer Science 2026-01-27 Benjamin Moseley , Kirk Pruhs , Marc Uetz , Rudy Zhou

We study a single-server scheduling problem for the objective of minimizing the expected cumulative holding cost incurred by jobs, where parameters defining stochastic job holding costs are unknown to the scheduler. We consider a general…

Machine Learning · Computer Science 2022-09-22 Dabeen Lee , Milan Vojnovic

Due to its optimality on a single machine for the problem of minimizing average flow time, Shortest-Remaining-Processing-Time (\srpt) appears to be the most natural algorithm to consider for the problem of minimizing average flow time on…

Data Structures and Algorithms · Computer Science 2010-11-10 Kyle Fox , Benjamin Moseley

We consider a large-scale parallel-server system, where each server independently adjusts its processing speed in a decentralized manner. The objective is to minimize the overall cost, which comprises the average cost of maintaining the…

Optimization and Control · Mathematics 2023-06-06 Daan Rutten , Martin Zubeldia , Debankur Mukherjee