English
Related papers

Related papers: Saath: Speeding up CoFlows by Exploiting the Spati…

200 papers

Coflow scheduling improves data-intensive application performance by improving their networking performance. State-of-the-art online coflow schedulers in essence approximate the classic Shortest-Job-First (SJF) scheduling by learning the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-27 Akshay Jajoo , Y. Charlie Hu , Xiaojun Lin

Datacenter networks routinely support the data transfers of distributed computing frameworks in the form of coflows, i.e., sets of concurrent flows related to a common task. The vast majority of the literature has focused on the problem of…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-04 Quang-Trung Luu , Olivier Brun , Rachid El-Azouzi , Francesco De Pellegrini , Balakrishna J. Prabhu , Cédric Richier

The average coflow completion time (CCT) is the standard performance metric in coflow scheduling. However, standard CCT minimization may introduce unfairness between the data transfer phase of different computing jobs. Thus, while progress…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-16 Francesco De Pellegrini , Vaibhav Kumar Gupta , Rachid El Azouzi , Serigne Gueye , Cedric Richier , Jeremie Leguay

In distributed computing frameworks like MapReduce, Spark, and Dyrad, a coflow is a set of flows transferring data between two stages of a job. The job cannot start its next stage unless all flows in the coflow finish. To improve the…

Networking and Internet Architecture · Computer Science 2018-12-18 Li Shi , Junwei Zhang , Yang Liu , Thomas Robertazzi

Many emerging distributed applications, including big data analytics, generate a number of flows that concurrently transport data across data center networks. To improve their performance, it is required to account for the behavior of a…

Networking and Internet Architecture · Computer Science 2020-07-07 Cristian Hernandez Benet , Andreas J. Kassler , Gianni Antichi , Theophilus A. Benson , Gergely Pongracz

Coflow provides a key application-layer abstraction for capturing communication patterns, enabling the efficient coordination of parallel data flows to reduce job completion times in distributed systems. Modern data center networks (DCNs)…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-10 Xin Wang , Hong Shen , Hui Tian , Dong Wang

Co-flows model a modern scheduling setting that is commonly found in a variety of applications in distributed and cloud computing. In co-flow scheduling, there are $m$ input ports and $m$ output ports. Each co-flow $j \in J$ can be…

Data Structures and Algorithms · Computer Science 2018-12-04 Sungjin Im , Manish Purohit

Coflow is a recently proposed network abstraction for data-parallel computing applications. This paper considers scheduling coflows with precedence constraints in identical parallel networks, such as to minimize the total weighted…

Data Structures and Algorithms · Computer Science 2022-07-15 Chi-Yeh Chen

Datacenter networks commonly facilitate the transmission of data in distributed computing frameworks through coflows, which are collections of parallel flows associated with a common task. Most of the existing research has concentrated on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-24 Olivier Brun , Rachid El-Azouzi , Quang-Trung Luu , Francesco De Pellergrini , Balakrishna J. Prabhu , Cédric Richier

This paper addresses the scheduling problem of coflows in identical parallel networks, which is a well-known $NP$-hard problem. Coflow is a relatively new network abstraction used to characterize communication patterns in data centers. We…

Data Structures and Algorithms · Computer Science 2023-12-21 Chi-Yeh Chen

This paper focuses on the problem of coflow scheduling with precedence constraints in identical parallel networks, which is a well-known $\mathcal{NP}$-hard problem. Coflow is a relatively new network abstraction used to characterize…

Data Structures and Algorithms · Computer Science 2023-12-21 Chi-Yeh Chen

To improve the application-level communication performance, scheduling of coflows, a collection of parallel flows sharing the same objective, is prevalent in modern data center networks (DCNs). Meanwhile, a hybrid-switched DCN design…

Networking and Internet Architecture · Computer Science 2023-06-19 Xin Wang , Hong Shen , Hui Tian

Co-flows model a modern scheduling setting that is commonly found in a variety of applications in distributed and cloud computing. A stochastic co-flow task contains a set of parallel flows with randomly distributed sizes. Further, many…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-26 Ruijiu Mao , Vaneet Aggarwal , Mung Chiang

Collaborative edge computing has become a popular paradigm where edge devices collaborate by sharing resources. Data dissemination is a fundamental problem in CEC to decide what data is transmitted from which device and how. Existing works…

Networking and Internet Architecture · Computer Science 2024-05-30 Yuvraj Sahni , Jiannong Cao , Lei Yang , Shengwei Wang

A coflow is a collection of parallel flows belonging to the same job. It has the all-or-nothing property: a coflow is not complete until the completion of all its constituent flows. In this paper, we focus on optimizing \emph{coflow-level…

Networking and Internet Architecture · Computer Science 2017-01-11 Qingkai Liang , Eytan Modiano

Coflow has emerged as a fundamental application-layer abstraction in distributed systems, representing communication dependencies and enabling collaborative management of related flows to enhance job completion efficiency. To meet the…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-30 Xin Wang , Hong Shen , Hui Tian , Ye Tao

Coflow is a recently proposed network abstraction to capture communication patterns in data centers. The coflow scheduling problem in large data centers is one of the most important $NP$-hard problems. Previous research on coflow scheduling…

Data Structures and Algorithms · Computer Science 2022-07-15 Chi-Yeh Chen

With the rapid advancement of technology, parallel computing applications have become increasingly popular and are commonly executed in large data centers. These applications involve two phases: computation and communication, which are…

Data Structures and Algorithms · Computer Science 2023-06-16 Chi-Yeh Chen , Jun Chen

Many modern datacenter applications involve large-scale computations composed of multiple data flows that need to be completed over a shared set of distributed resources. Such a computation completes when all of its flows complete. A useful…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-12 Hamidreza Jahanjou , Erez Kantor , Rajmohan Rajaraman

Modern data centers face new scheduling challenges in optimizing job-level performance objectives, where a significant challenge is the scheduling of highly parallel data flows with a common performance goal (e.g., the shuffle operations in…

Networking and Internet Architecture · Computer Science 2016-03-28 Zhen Qiu , Cliff Stein , Yuan Zhong
‹ Prev 1 2 3 10 Next ›