English
Related papers

Related papers: Non-clairvoyant Scheduling of Coflows

200 papers

Modern data centers face new scheduling challenges in optimizing job-level performance objectives, where a significant challenge is the scheduling of highly parallel data flows with a common performance goal (e.g., the shuffle operations in…

Networking and Internet Architecture · Computer Science 2016-03-28 Zhen Qiu , Cliff Stein , Yuan Zhong

Many emerging distributed applications, including big data analytics, generate a number of flows that concurrently transport data across data center networks. To improve their performance, it is required to account for the behavior of a…

Networking and Internet Architecture · Computer Science 2020-07-07 Cristian Hernandez Benet , Andreas J. Kassler , Gianni Antichi , Theophilus A. Benson , Gergely Pongracz

Coflow provides a key application-layer abstraction for capturing communication patterns, enabling the efficient coordination of parallel data flows to reduce job completion times in distributed systems. Modern data center networks (DCNs)…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-10 Xin Wang , Hong Shen , Hui Tian , Dong Wang

In distributed computing frameworks like MapReduce, Spark, and Dyrad, a coflow is a set of flows transferring data between two stages of a job. The job cannot start its next stage unless all flows in the coflow finish. To improve the…

Networking and Internet Architecture · Computer Science 2018-12-18 Li Shi , Junwei Zhang , Yang Liu , Thomas Robertazzi

Coflow has emerged as a fundamental application-layer abstraction in distributed systems, representing communication dependencies and enabling collaborative management of related flows to enhance job completion efficiency. To meet the…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-30 Xin Wang , Hong Shen , Hui Tian , Ye Tao

Consider a problem in which $n$ jobs that are classified into $k$ types arrive over time at their release times and are to be scheduled on a single machine so as to minimize the maximum flow time. The machine requires a setup taking $s$…

Data Structures and Algorithms · Computer Science 2017-09-19 Alexander Mäcker , Manuel Malatyali , Friedhelm Meyer auf der Heide , Sören Riechers

Datacenter networks commonly facilitate the transmission of data in distributed computing frameworks through coflows, which are collections of parallel flows associated with a common task. Most of the existing research has concentrated on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-24 Olivier Brun , Rachid El-Azouzi , Quang-Trung Luu , Francesco De Pellergrini , Balakrishna J. Prabhu , Cédric Richier

We consider energy-efficient scheduling on multiprocessors, where the speed of each processor can be individually scaled, and a processor consumes power $s^{\alpha}$ when running at speed $s$, for $\alpha>1$. A scheduling algorithm needs to…

Data Structures and Algorithms · Computer Science 2014-10-14 Hongyang Sun , Yuxiong He , Wen-Jing Hsu , Rui Fan

We provide an algorithm giving a $\frac{140}{41}$($<3.415$)-approximation for Coflow Scheduling and a $4.36$-approximation for Coflow Scheduling with release dates. This improves upon the best known $4$- and respectively $5$-approximations…

Data Structures and Algorithms · Computer Science 2025-03-03 Lars Rohwedder , Leander Schnaars

In data-parallel computing frameworks, intermediate parallel data is often produced at various stages which needs to be transferred among servers in the datacenter network (e.g. the shuffle phase in MapReduce). A stage often cannot start or…

Data Structures and Algorithms · Computer Science 2017-04-28 Mehrnoosh Shafiee , Javad Ghaderi

Scheduling questions arise naturally in many different areas among which operating system design, compiling,... In real life systems, the characteristics of the jobs (such as release time and processing time) are usually unknown and…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Julien Robert , Nicolas Schabanel

We study the problem of minimizing total completion time on parallel machines subject to varying processing capacity. In this paper, we develop an approximation scheme for the problem under the data stream model where the input data is…

Data Structures and Algorithms · Computer Science 2022-04-06 Bin Fu , Yumei Huo , Hairong Zhao

The average coflow completion time (CCT) is the standard performance metric in coflow scheduling. However, standard CCT minimization may introduce unfairness between the data transfer phase of different computing jobs. Thus, while progress…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-16 Francesco De Pellegrini , Vaibhav Kumar Gupta , Rachid El Azouzi , Serigne Gueye , Cedric Richier , Jeremie Leguay

In non-clairvoyant scheduling, the goal is to minimize the total job completion time without prior knowledge of individual job processing times. This classical online optimization problem has recently gained attention through the framework…

Data Structures and Algorithms · Computer Science 2025-09-25 Ziyad Benomar , Romain Cosson , Alexander Lindermayr , Jens Schlöter

We consider routing in reconfigurable networks, which is also known as coflow scheduling in the literature. The algorithmic literature generally (perhaps implicitly) assumes that the amount of data to be transferred is large. Thus the…

Data Structures and Algorithms · Computer Science 2026-03-17 Alexander Lindermayr , Kirk Pruhs , Andréa W. Richa , Tegan Wilson

We consider scheduling in a quantum switch with stochastic entanglement generation, finite quantum memories, and decoherence. The objective is to design a scheduling algorithm with polynomial-time computational complexity that stabilizes a…

Optimization and Control · Mathematics 2026-03-31 R. Srikant

Most of the early input-queued switch research focused on establishing throughput optimality of the max-weight scheduling policy, with some recent research showing that max-weight scheduling is optimal with respect to total expected delay…

Optimization and Control · Mathematics 2020-10-13 Yingdong Lu , Mark S. Squillante , Tonghoon Suk

Collaborative edge computing has become a popular paradigm where edge devices collaborate by sharing resources. Data dissemination is a fundamental problem in CEC to decide what data is transmitted from which device and how. Existing works…

Networking and Internet Architecture · Computer Science 2024-05-30 Yuvraj Sahni , Jiannong Cao , Lei Yang , Shengwei Wang

In this paper, we consider the problem of link scheduling in multi-hop wireless networks under general interference constraints. Our goal is to design scheduling schemes that do not use per-flow or per-destination information, maintain a…

Networking and Internet Architecture · Computer Science 2012-06-14 Bo Ji , Changhee Joo , Ness B. Shroff

Determining contingency aware dispatch decisions by solving a security-constrained optimal power flow (SCOPF) is challenging for real-world power systems, as the high problem dimensionality often leads to impractical computational…

Systems and Control · Electrical Eng. & Systems 2020-05-19 Richard Weinhold , Robert Mieth