English
Related papers

Related papers: Scheduling Coflows in Multi-Core OCS Networks with…

200 papers

A coflow is a collection of parallel flows belonging to the same job. It has the all-or-nothing property: a coflow is not complete until the completion of all its constituent flows. In this paper, we focus on optimizing \emph{coflow-level…

Networking and Internet Architecture · Computer Science 2017-01-11 Qingkai Liang , Eytan Modiano

Coflow is a recently proposed networking abstraction to help improve the communication performance of data-parallel computing jobs. In multi-stage jobs, each job consists of multiple coflows and is represented by a Directed Acyclic Graph…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-22 Xin Wang , Hong Shen

Coflow scheduling models communication requests in parallel computing frameworks where multiple data flows between shared resources need to be completed before computation can continue. In this paper, we introduce Path-based Coflow…

Data Structures and Algorithms · Computer Science 2020-02-18 Alexander Eckl , Luisa Peter , Maximilian Schiffer , Susanne Albers

We consider the problem of designing a packet-level congestion control and scheduling policy for datacenter networks. Current datacenter networks primarily inherit the principles that went into the design of Internet, where congestion…

Networking and Internet Architecture · Computer Science 2017-10-10 Devavrat Shah , Qiaomin Xie

We study how to reduce the reconfiguration time in hybrid optical-electrical Datacenter Networks (DCNs). With a layer of Optical Circuit Switches (OCSes), hybrid optical-electrical DCNs can reconfigure its logical topologies to better match…

Networking and Internet Architecture · Computer Science 2023-12-20 Shuyuan Zhang , Shu Shan , Shizhen Zhao

We consider routing in reconfigurable networks, which is also known as coflow scheduling in the literature. The algorithmic literature generally (perhaps implicitly) assumes that the amount of data to be transferred is large. Thus the…

Data Structures and Algorithms · Computer Science 2026-03-17 Alexander Lindermayr , Kirk Pruhs , Andréa W. Richa , Tegan Wilson

The rapid growth of AI training has dramatically increased datacenter traffic demand and energy consumption, which has motivated renewed interest in optical circuit switches (OCSes) as a high-bandwidth, energy-efficient alternative for AI…

Networking and Internet Architecture · Computer Science 2026-03-10 Kevin Liang , Litao Qiao , Isaac Keslassy , Bill Lin

The average coflow completion time (CCT) is the standard performance metric in coflow scheduling. However, standard CCT minimization may introduce unfairness between the data transfer phase of different computing jobs. Thus, while progress…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-16 Francesco De Pellegrini , Vaibhav Kumar Gupta , Rachid El Azouzi , Serigne Gueye , Cedric Richier , Jeremie Leguay

With the ever-growing need of data in HPC applications, the congestion at the I/O level becomes critical in super-computers. Architectural enhancement such as burst-buffers and pre-fetching are added to machines, but are not sufficient to…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-23 Guillaume Aupy , Ana Gainaru , Valentin Le Fèvre

Major chip manufacturers have all introduced multicore microprocessors. Multi-socket systems built from these processors are used for running various server applications. However to the best of our knowledge current commercial operating…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-24 Suryanarayana Murthy Durbhakula

Co-flows model a modern scheduling setting that is commonly found in a variety of applications in distributed and cloud computing. A stochastic co-flow task contains a set of parallel flows with randomly distributed sizes. Further, many…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-26 Ruijiu Mao , Vaneet Aggarwal , Mung Chiang

Many optical circuit switched data center networks (DCN) have been proposed in the past to attain higher capacity and topology reconfigurability, though commercial adoption of these architectures have been minimal. One major challenge these…

Networking and Internet Architecture · Computer Science 2020-10-02 Min Yee Teh , Shizhen Zhao , Peirui Cao , Keren Bergman

In this paper, a novel reconfigurable architecture is proposed for multifunctional image signal processing systems. A circuit-switched NoC is used to provide interconnection because the non-TMD links ensure fixed throughput, which is a…

Hardware Architecture · Computer Science 2013-10-15 Feitian Li , Fei Qiao , Qi Wei , Huazhong Yang

This paper optimizes the scheduling and routing of the co-flows of MapReduce shuffling phase in state-of-the-art and proposed Passive Optical Networking (PON)-based Data Centre Network (DCN) architectures. A time-slotted Mixed Integer…

Networking and Internet Architecture · Computer Science 2020-08-11 Sanaa Hamid Mohamed , Ali Hammadi , Taisir E. H. El-Gorashi , Jaafar Mohamed Hashim Elmirghani

Collaborative edge computing (CEC) is an emerging paradigm for heterogeneous devices to collaborate on edge computation jobs. For congestible links and computing units, delay-optimal forwarding and offloading for service chain tasks (e.g.,…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-12 Jinkun Zhang , Edmund Yeh

In the past decade, increasingly network scheduling techniques have been proposed to boost the distributed application performance. Flow-level metrics, such as flow completion time (FCT), are based on the abstraction of flows yet they…

Networking and Internet Architecture · Computer Science 2019-01-18 Jiawei Fei , Yang Shi , Qun Huang , Mei Wen

With the rapid transformation of computer hardware and algorithms, mobile networking has evolved from low data carrying capacity and high latency to better-optimized networks, either by enhancing the digital network or using different…

Networking and Internet Architecture · Computer Science 2023-11-09 Wenbo Zhu

Data center networks leverage multiple parallel paths connecting end host pairs to offer high bisection bandwidth for cluster computing applications. However, state of the art distributed multi-pathing protocols such as Equal Cost Multipath…

Networking and Internet Architecture · Computer Science 2013-07-30 Wenzhi Cui , Chen Qian

Scheduling is an important task allowing parallel systems to perform efficiently and reliably. For modern computation systems, divisible load is a special type of data which can be divided into arbitrary sizes and independently processed in…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-07 Fei Wu , Yang Cao , Thomas Robertazzi

This paper studies the problem of congestion control and scheduling in ad hoc wireless networks that have to support a mixture of best-effort and real-time traffic. Optimization and stochastic network theory have been successful in…

Networking and Internet Architecture · Computer Science 2009-12-13 Juan Jose Jaramillo , R. Srikant