English
Related papers

Related papers: A Case for Sampling Based Learning Techniques in C…

200 papers

Coflow scheduling improves data-intensive application performance by improving their networking performance. State-of-the-art Coflow schedulers in essence approximate the classic online Shortest-Job-First (SJF) scheduling, designed for a…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-17 Akshay Jajoo , Rohan Gandhi , Y. Charlie Hu , Cheng-Kok Koh

Datacenter networks routinely support the data transfers of distributed computing frameworks in the form of coflows, i.e., sets of concurrent flows related to a common task. The vast majority of the literature has focused on the problem of…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-04 Quang-Trung Luu , Olivier Brun , Rachid El-Azouzi , Francesco De Pellegrini , Balakrishna J. Prabhu , Cédric Richier

With the rapid advancement of technology, parallel computing applications have become increasingly popular and are commonly executed in large data centers. These applications involve two phases: computation and communication, which are…

Data Structures and Algorithms · Computer Science 2023-06-16 Chi-Yeh Chen , Jun Chen

This paper focuses on the problem of coflow scheduling with precedence constraints in identical parallel networks, which is a well-known $\mathcal{NP}$-hard problem. Coflow is a relatively new network abstraction used to characterize…

Data Structures and Algorithms · Computer Science 2023-12-21 Chi-Yeh Chen

Coflow is a recently proposed network abstraction for data-parallel computing applications. This paper considers scheduling coflows with precedence constraints in identical parallel networks, such as to minimize the total weighted…

Data Structures and Algorithms · Computer Science 2022-07-15 Chi-Yeh Chen

Modern data centers face new scheduling challenges in optimizing job-level performance objectives, where a significant challenge is the scheduling of highly parallel data flows with a common performance goal (e.g., the shuffle operations in…

Networking and Internet Architecture · Computer Science 2016-03-28 Zhen Qiu , Cliff Stein , Yuan Zhong

Many modern datacenter applications involve large-scale computations composed of multiple data flows that need to be completed over a shared set of distributed resources. Such a computation completes when all of its flows complete. A useful…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-12 Hamidreza Jahanjou , Erez Kantor , Rajmohan Rajaraman

Datacenter networks commonly facilitate the transmission of data in distributed computing frameworks through coflows, which are collections of parallel flows associated with a common task. Most of the existing research has concentrated on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-24 Olivier Brun , Rachid El-Azouzi , Quang-Trung Luu , Francesco De Pellergrini , Balakrishna J. Prabhu , Cédric Richier

In distributed computing frameworks like MapReduce, Spark, and Dyrad, a coflow is a set of flows transferring data between two stages of a job. The job cannot start its next stage unless all flows in the coflow finish. To improve the…

Networking and Internet Architecture · Computer Science 2018-12-18 Li Shi , Junwei Zhang , Yang Liu , Thomas Robertazzi

This paper addresses the scheduling problem of coflows in identical parallel networks, which is a well-known $NP$-hard problem. Coflow is a relatively new network abstraction used to characterize communication patterns in data centers. We…

Data Structures and Algorithms · Computer Science 2023-12-21 Chi-Yeh Chen

Coflow is a recently proposed networking abstraction to help improve the communication performance of data-parallel computing jobs. In multi-stage jobs, each job consists of multiple coflows and is represented by a Directed Acyclic Graph…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-22 Xin Wang , Hong Shen

Coflow provides a key application-layer abstraction for capturing communication patterns, enabling the efficient coordination of parallel data flows to reduce job completion times in distributed systems. Modern data center networks (DCNs)…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-10 Xin Wang , Hong Shen , Hui Tian , Dong Wang

The coflow scheduling problem has emerged as a popular abstraction in the last few years to study data communication problems within a data center. In this basic framework, each coflow has a set of communication demands and the goal is to…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-18 Mosharaf Chowdhury , Samir Khuller , Manish Purohit , Sheng Yang , Jie You

Clustered Federated Multitask Learning (CFL) was introduced as an efficient scheme to obtain reliable specialized models when data is imbalanced and distributed in a non-i.i.d. (non-independent and identically distributed) fashion amongst…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-20 Abdullatif Albaseer , Mohamed Abdallah , Ala Al-Fuqaha , Aiman Erbad

Coflow is a recently proposed network abstraction to capture communication patterns in data centers. The coflow scheduling problem in large data centers is one of the most important $NP$-hard problems. Previous research on coflow scheduling…

Data Structures and Algorithms · Computer Science 2022-07-15 Chi-Yeh Chen

Coflow scheduling models communication requests in parallel computing frameworks where multiple data flows between shared resources need to be completed before computation can continue. In this paper, we introduce Path-based Coflow…

Data Structures and Algorithms · Computer Science 2020-02-18 Alexander Eckl , Luisa Peter , Maximilian Schiffer , Susanne Albers

Many emerging distributed applications, including big data analytics, generate a number of flows that concurrently transport data across data center networks. To improve their performance, it is required to account for the behavior of a…

Networking and Internet Architecture · Computer Science 2020-07-07 Cristian Hernandez Benet , Andreas J. Kassler , Gianni Antichi , Theophilus A. Benson , Gergely Pongracz

Coflow is a network abstraction used to represent communication patterns in data centers. The coflow scheduling problem encountered in large data centers is a challenging $\mathcal{NP}$-hard problem. This paper tackles the scheduling…

Data Structures and Algorithms · Computer Science 2023-12-29 Chi-Yeh Chen

We consider routing in reconfigurable networks, which is also known as coflow scheduling in the literature. The algorithmic literature generally (perhaps implicitly) assumes that the amount of data to be transferred is large. Thus the…

Data Structures and Algorithms · Computer Science 2026-03-17 Alexander Lindermayr , Kirk Pruhs , Andréa W. Richa , Tegan Wilson

To improve the application-level communication performance, scheduling of coflows, a collection of parallel flows sharing the same objective, is prevalent in modern data center networks (DCNs). Meanwhile, a hybrid-switched DCN design…

Networking and Internet Architecture · Computer Science 2023-06-19 Xin Wang , Hong Shen , Hui Tian
‹ Prev 1 2 3 10 Next ›