English
Related papers

Related papers: Scheduling Coflows with Precedence Constraints for…

200 papers

A coflow is a collection of parallel flows belonging to the same job. It has the all-or-nothing property: a coflow is not complete until the completion of all its constituent flows. In this paper, we focus on optimizing \emph{coflow-level…

Networking and Internet Architecture · Computer Science 2017-01-11 Qingkai Liang , Eytan Modiano

To improve the application-level communication performance, scheduling of coflows, a collection of parallel flows sharing the same objective, is prevalent in modern data center networks (DCNs). Meanwhile, a hybrid-switched DCN design…

Networking and Internet Architecture · Computer Science 2023-06-19 Xin Wang , Hong Shen , Hui Tian

In distributed computing frameworks like MapReduce, Spark, and Dyrad, a coflow is a set of flows transferring data between two stages of a job. The job cannot start its next stage unless all flows in the coflow finish. To improve the…

Networking and Internet Architecture · Computer Science 2018-12-18 Li Shi , Junwei Zhang , Yang Liu , Thomas Robertazzi

The average coflow completion time (CCT) is the standard performance metric in coflow scheduling. However, standard CCT minimization may introduce unfairness between the data transfer phase of different computing jobs. Thus, while progress…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-16 Francesco De Pellegrini , Vaibhav Kumar Gupta , Rachid El Azouzi , Serigne Gueye , Cedric Richier , Jeremie Leguay

We study the classical scheduling problem on parallel machines %with precedence constraints where the precedence graph has the bounded depth $h$. Our goal is to minimize the maximum completion time. We focus on developing approximation…

Data Structures and Algorithms · Computer Science 2023-02-02 Bin Fu , Yumei Huo , Hairong Zhao

The coflow scheduling problem is considered: given an input/output switch with each port having a fixed capacity, find a scheduling algorithm that minimizes the weighted sum of the coflow completion times respecting the port capacities,…

Data Structures and Algorithms · Computer Science 2020-04-14 Akhil Bhimaraju , Debanuj Nayak , Rahul Vaze

We consider the problem of scheduling a set of jobs on a set of identical parallel machines, with the aim of minimizing the total weighted completion time. The problem has been solved in the literature with a number of mathematical…

Data Structures and Algorithms · Computer Science 2020-06-24 Arthur Kramer , Mauro Dell'Amico , Manuel Iori

Motivated by modern parallel computing applications, we consider the problem of scheduling parallel-task jobs with heterogeneous resource requirements in a cluster of machines. Each job consists of a set of tasks that can be processed in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-03 Mehrnoosh Shafiee , Javad Ghaderi

We consider routing in reconfigurable networks, which is also known as coflow scheduling in the literature. The algorithmic literature generally (perhaps implicitly) assumes that the amount of data to be transferred is large. Thus the…

Data Structures and Algorithms · Computer Science 2026-03-17 Alexander Lindermayr , Kirk Pruhs , Andréa W. Richa , Tegan Wilson

Many emerging distributed applications, including big data analytics, generate a number of flows that concurrently transport data across data center networks. To improve their performance, it is required to account for the behavior of a…

Networking and Internet Architecture · Computer Science 2020-07-07 Cristian Hernandez Benet , Andreas J. Kassler , Gianni Antichi , Theophilus A. Benson , Gergely Pongracz

We consider a parallel system of $m$ identical machines prone to unpredictable crashes and restarts, trying to cope with the continuous arrival of tasks to be executed. Tasks have different computational requirements (i.e., processing time…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-21 Elli Zavou , Antonio Fernández Anta

We consider the pull-based broadcast scheduling model. In this model, there are n unit-sized pages of information available at the server. Requests arrive over time at the server asking for a specific page. When the server transmits a page,…

Data Structures and Algorithms · Computer Science 2013-09-17 Sungjin Im , Maxim Sviridenko

We consider the precedence-constrained scheduling problem to minimize the total weighted completion time. For a single machine several $2$-approximation algorithms are known, which are based on linear programming and network flows. We show…

Data Structures and Algorithms · Computer Science 2023-09-22 Sven Jäger , Philipp Warode

Scheduling a set of jobs over a collection of machines is a fundamental problem that needs to be solved millions of times a day in various computing platforms: in operating systems, in large data clusters, and in data centers. Along with…

Data Structures and Algorithms · Computer Science 2018-07-10 Janardhan Kulkarni , Shi Li

Scheduling is an important task allowing parallel systems to perform efficiently and reliably. For modern computation systems, divisible load is a special type of data which can be divided into arbitrary sizes and independently processed in…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-07 Fei Wu , Yang Cao , Thomas Robertazzi

This paper studies the scheduling of jobs of different families on parallel machines with qualification constraints. Originating from semiconductor manufacturing, this constraint imposes a time threshold between the execution of two jobs of…

Artificial Intelligence · Computer Science 2020-11-23 Margaux Nattaf , Arnaud Malapert

This paper investigates co-scheduling algorithms for processing a set of parallel applications. Instead of executing each application one by one, using a maximum degree of parallelism for each of them, we aim at scheduling several…

Data Structures and Algorithms · Computer Science 2013-05-01 Guillaume Aupy , Manu Shantharam , Anne Benoit , Yves Robert , Padma Raghavan

This paper presents improved approximation algorithms for the problem of multiprocessor scheduling under uncertainty, or SUU, in which the execution of each job may fail probabilistically. This problem is motivated by the increasing use of…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-02-19 Christopher Crutchfield , Zoran Dzunic , Jeremy T. Fineman , David R. Karger , Jacob Scott

We consider the online buffer minimization in multiprocessor systems with conflicts problem (in short, the buffer minimization problem) in the recently introduced flow model. In an online fashion, workloads arrive on some of the $n$…

Data Structures and Algorithms · Computer Science 2025-11-26 Niklas Haas , Sören Schmitt , Rob van Stee

In the past decade, increasingly network scheduling techniques have been proposed to boost the distributed application performance. Flow-level metrics, such as flow completion time (FCT), are based on the abstraction of flows yet they…

Networking and Internet Architecture · Computer Science 2019-01-18 Jiawei Fei , Yang Shi , Qun Huang , Mei Wen