English
Related papers

Related papers: Efficient Coflow Scheduling in Hybrid-Switched Dat…

200 papers

Many emerging distributed applications, including big data analytics, generate a number of flows that concurrently transport data across data center networks. To improve their performance, it is required to account for the behavior of a…

Networking and Internet Architecture · Computer Science 2020-07-07 Cristian Hernandez Benet , Andreas J. Kassler , Gianni Antichi , Theophilus A. Benson , Gergely Pongracz

With the rapid advancement of technology, parallel computing applications have become increasingly popular and are commonly executed in large data centers. These applications involve two phases: computation and communication, which are…

Data Structures and Algorithms · Computer Science 2023-06-16 Chi-Yeh Chen , Jun Chen

Hybrid intra-data centre networks, with optical and electrical capabilities, are attracting research interest in recent years. This is attributed to the emergence of new bandwidth greedy applications and novel computing paradigms. A key…

Networking and Internet Architecture · Computer Science 2013-06-04 Ibrahim Kabiru Musa , Stuart Walker

A coflow is a collection of parallel flows belonging to the same job. It has the all-or-nothing property: a coflow is not complete until the completion of all its constituent flows. In this paper, we focus on optimizing \emph{coflow-level…

Networking and Internet Architecture · Computer Science 2017-01-11 Qingkai Liang , Eytan Modiano

Coflow scheduling models communication requests in parallel computing frameworks where multiple data flows between shared resources need to be completed before computation can continue. In this paper, we introduce Path-based Coflow…

Data Structures and Algorithms · Computer Science 2020-02-18 Alexander Eckl , Luisa Peter , Maximilian Schiffer , Susanne Albers

Collaborative edge computing has become a popular paradigm where edge devices collaborate by sharing resources. Data dissemination is a fundamental problem in CEC to decide what data is transmitted from which device and how. Existing works…

Networking and Internet Architecture · Computer Science 2024-05-30 Yuvraj Sahni , Jiannong Cao , Lei Yang , Shengwei Wang

Co-flows model a modern scheduling setting that is commonly found in a variety of applications in distributed and cloud computing. In co-flow scheduling, there are $m$ input ports and $m$ output ports. Each co-flow $j \in J$ can be…

Data Structures and Algorithms · Computer Science 2018-12-04 Sungjin Im , Manish Purohit

The performance of distributed and data-centric applications often critically depends on the interconnecting network. Emerging reconfigurable datacenter networks (RDCNs) are a particularly innovative approach to improve datacenter…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-14 Neta Rozen Schiff , Klaus-Tycho Foerster , Stefan Schmid , David Hay

The average coflow completion time (CCT) is the standard performance metric in coflow scheduling. However, standard CCT minimization may introduce unfairness between the data transfer phase of different computing jobs. Thus, while progress…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-16 Francesco De Pellegrini , Vaibhav Kumar Gupta , Rachid El Azouzi , Serigne Gueye , Cedric Richier , Jeremie Leguay

In this work, we provide the design and implementation of a switch-assisted congestion control algorithm for data center networks (DCNs). In particular, we provide a prototype of the switch-driven congestion control algorithm and deploy it…

Networking and Internet Architecture · Computer Science 2021-06-29 Ahmed M. Abdelmoniem , Brahim Bensaou

We study how to reduce the reconfiguration time in hybrid optical-electrical Datacenter Networks (DCNs). With a layer of Optical Circuit Switches (OCSes), hybrid optical-electrical DCNs can reconfigure its logical topologies to better match…

Networking and Internet Architecture · Computer Science 2023-12-20 Shuyuan Zhang , Shu Shan , Shizhen Zhao

Applications in data-parallel computing typically consist of multiple stages. In each stage, a set of intermediate parallel data flows (Coflow) is produced and transferred between servers to enable starting of next stage. While there has…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-23 Mehrnoosh Shafiee , Javad Ghaderi

We consider the problem of designing a packet-level congestion control and scheduling policy for datacenter networks. Current datacenter networks primarily inherit the principles that went into the design of Internet, where congestion…

Networking and Internet Architecture · Computer Science 2017-10-10 Devavrat Shah , Qiaomin Xie

Data center networks leverage multiple parallel paths connecting end host pairs to offer high bisection bandwidth for cluster computing applications. However, state of the art distributed multi-pathing protocols such as Equal Cost Multipath…

Networking and Internet Architecture · Computer Science 2013-07-30 Wenzhi Cui , Chen Qian

Efficient load-balancing mechanisms are critical for maximizing performance and increasing the quality of service (QoS) of data center networks (DCNs). Obtaining the optimal QoS while minimizing resource consumption remains a significant…

Networking and Internet Architecture · Computer Science 2026-01-15 Aymen Hasan Alawadi

With the rapid transformation of computer hardware and algorithms, mobile networking has evolved from low data carrying capacity and high latency to better-optimized networks, either by enhancing the digital network or using different…

Networking and Internet Architecture · Computer Science 2023-11-09 Wenbo Zhu

In this paper we analyze the problem of optimal task scheduling for data centers. Given the available resources and tasks, we propose a fast distributed iterative algorithm which operates over a large scale network of nodes and allows each…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-08 Apostolos I. Rikos , Andreas Grammenos , Evangelia Kalyvianaki , Christoforos N. Hadjicostis , Themistoklis Charalambous , Karl H. Johansson

We study the scheduling of flows on a switch with the goal of optimizing metrics related to the response time of the flows. The input to the problem is a sequence of flow requests on a switch, where the switch is represented by a bipartite…

Data Structures and Algorithms · Computer Science 2020-05-28 Hamidreza Jahanjou , Rajmohan Rajaraman , David Stalfa

Today's datacenter networks (DCNs) have been built upon multipath topologies where each path contains multiple links. However, flow scheduling schemes proposed to minimize flow completion times (FCT) in DCNs are based on algorithms which…

Networking and Internet Architecture · Computer Science 2018-07-19 Soheil Abbasloo , Yang Xu , H. Jonathan Chao

The coflow scheduling problem is considered: given an input/output switch with each port having a fixed capacity, find a scheduling algorithm that minimizes the weighted sum of the coflow completion times respecting the port capacities,…

Data Structures and Algorithms · Computer Science 2020-04-14 Akhil Bhimaraju , Debanuj Nayak , Rahul Vaze