English
Related papers

Related papers: Low-latency job scheduling with preemption for the…

200 papers

We consider a distributed computing network consisting of a master and multiple workers processing tasks of different types. The master is running multiple applications. Each application stochastically generates real-time jobs with a strict…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-31 Yu-Pin Hsu , Yu-Chih Huang , Shin-Lin Shieh

In a large-scale computing cluster, the job completions can be substantially delayed due to two sources of variability, namely, variability in the job size and that in the machine service capacity. To tackle this issue, existing works have…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-07-07 Huanle Xu , Gustavo de Veciana , Wing Cheong Lau , Kunxiao Zhou

In online scheduling, jobs are available one by one and each job must be scheduled irrevocably before the availability of the next job. Semi-online scheduling is a relaxed variant of online scheduling, where an additional memory in terms of…

Data Structures and Algorithms · Computer Science 2020-05-19 Debasis Dwibedy , Rakesh Mohanty

We consider the following scheduling problem. There is a single machine and the jobs will arrive for completion online. Each job j is preemptive and, upon its arrival, its other characteristics are immediately revealed to the machine: the…

Data Structures and Algorithms · Computer Science 2015-09-14 Patrick Loiseau , Xiaohu Wu

We present a new online algorithm for profit-oriented scheduling on multiple speed-scalable processors. Moreover, we provide a tight analysis of the algorithm's competitiveness. Our results generalize and improve upon work by…

Data Structures and Algorithms · Computer Science 2012-09-19 Peter Kling , Peter Pietrzyk

As distributed optimization scales to meet the demands of Large Language Model (LLM) training, hardware failures become increasingly non-negligible. Existing fault-tolerant training methods often introduce significant computational or…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-21 Rizhen Hu , Yutong He , Ran Yan , Mou Sun , Binghang Yuan , Kun Yuan

We present a scheduler that improves cluster utilization and job completion times by packing tasks having multi-resource requirements and inter-dependencies. While the problem is algorithmically very hard, we achieve near-optimality on the…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-26 Robert Grandl , Srikanth Kandula , Sriram Rao , Aditya Akella , Janardhan Kulkarni

Cache partitioning techniques have been successfully adopted to mitigate interference among concurrently executing real-time tasks on multi-core processors. Considering that the execution time of a cache-sensitive task strongly depends on…

Hardware Architecture · Computer Science 2023-10-05 Binqi Sun , Debayan Roy , Tomasz Kloda , Andrea Bastoni , Rodolfo Pellizzoni , Marco Caccamo

We consider the problem of scheduling multiprocessor jobs to minimize the total completion time under the given energy budget. Each multiprocessor job requires more than one processor at the same moment of time. Processors may operate at…

Optimization and Control · Mathematics 2021-07-22 Alexander Kononov , Yulia Kovalenko

We introduce a novel adversarial model for scheduling with explorable uncertainty. In this model, the processing time of a job can potentially be reduced (by an a priori unknown amount) by testing the job. Testing a job $j$ takes one unit…

Data Structures and Algorithms · Computer Science 2020-05-15 Christoph Dürr , Thomas Erlebach , Nicole Megow , Julie Meißner

Large language models have been widely deployed in various applications, encompassing both interactive online tasks and batched offline tasks. Given the burstiness and latency sensitivity of online tasks, over-provisioning resources is…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-08 Zhibin Wang , Shipeng Li , Xue Li , Yuhang Zhou , Zhonghui Zhang , Zibo Wang , Rong Gu , Chen Tian , Kun Yang , Sheng Zhong

Algorithms with predictions is a recent framework that has been used to overcome pessimistic worst-case bounds in incomplete information settings. In the context of scheduling, very recent work has leveraged machine-learned predictions to…

Data Structures and Algorithms · Computer Science 2022-12-08 Eric Balkanski , Tingting Ou , Clifford Stein , Hao-Ting Wei

High-performance computing systems are complex machines whose behaviour is governed by the correct functioning of its many subsystems. Among these, the workload scheduler has a crucial impact on the timely execution of the jobs continuously…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-14 Daniela Loreti , Davide Leone , Andrea Borghesi

In Real-time system, utilization based schedulability test is a common approach to determine whether or not tasks can be admitted without violating deadline requirements. The exact problem has previously been proven intractable even upon…

Software Engineering · Computer Science 2011-01-11 Jagbeer Singh

We analyze the problem of job scheduling with preempting on weighted jobs that can have either linear or exponential penalties. We review relevant literature on the problem and create and describe a few online algorithms that perform…

Data Structures and Algorithms · Computer Science 2023-01-26 Frederick Tang , Fareed Sheriff , Andrew Wang

More and more companies have deployed machine learning (ML) clusters, where deep learning (DL) models are trained for providing various AI-driven services. Efficient resource scheduling is essential for maximal utilization of expensive DL…

Machine Learning · Computer Science 2019-09-16 Yanghua Peng , Yixin Bao , Yangrui Chen , Chuan Wu , Chen Meng , Wei Lin

Simultaneously supporting latency- and throughout-sensitive workloads in a shared environment is an increasingly more common challenge in big data clusters. Despite many advances, existing cluster schedulers force the same performance goal…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-10 Tan N. Le , Xiao Sun , Mosharaf Chowdhury , Zhenhua Liu

We consider fundamental scheduling problems motivated by energy issues. In this framework, we are given a set of jobs, each with a release time, deadline and required processing length. The jobs need to be scheduled on a machine so that at…

Data Structures and Algorithms · Computer Science 2016-10-27 Jessica Chang , Samir Khuller , Koyel Mukherjee

We consider scheduling problems for unit jobs with release times, where the number or size of the gaps in the schedule is taken into consideration, either in the objective function or as a constraint. Except for a few papers on energy…

Data Structures and Algorithms · Computer Science 2020-07-21 Marek Chrobak , Mordecai Golin , Tak-Wah Lam , Dorian Nogneng

Recent years have witnessed a large amount of decentralized data in various (edge) devices of end-users, while the decentralized data aggregation remains complicated for machine learning jobs because of regulations and laws. As a practical…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-28 Ji Liu , Juncheng Jia , Beichen Ma , Chendi Zhou , Jingbo Zhou , Yang Zhou , Huaiyu Dai , Dejing Dou