English
Related papers

Related papers: O(K)-Approximation Coflow Scheduling in K-Core Opt…

200 papers

Applications in data-parallel computing typically consist of multiple stages. In each stage, a set of intermediate parallel data flows (Coflow) is produced and transferred between servers to enable starting of next stage. While there has…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-23 Mehrnoosh Shafiee , Javad Ghaderi

Co-flows model a modern scheduling setting that is commonly found in a variety of applications in distributed and cloud computing. A stochastic co-flow task contains a set of parallel flows with randomly distributed sizes. Further, many…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-26 Ruijiu Mao , Vaneet Aggarwal , Mung Chiang

Coflow scheduling models communication requests in parallel computing frameworks where multiple data flows between shared resources need to be completed before computation can continue. In this paper, we introduce Path-based Coflow…

Data Structures and Algorithms · Computer Science 2020-02-18 Alexander Eckl , Luisa Peter , Maximilian Schiffer , Susanne Albers

The rapid growth of AI training has dramatically increased datacenter traffic demand and energy consumption, which has motivated renewed interest in optical circuit switches (OCSes) as a high-bandwidth, energy-efficient alternative for AI…

Networking and Internet Architecture · Computer Science 2026-03-10 Kevin Liang , Litao Qiao , Isaac Keslassy , Bill Lin

This paper optimizes the scheduling and routing of the co-flows of MapReduce shuffling phase in state-of-the-art and proposed Passive Optical Networking (PON)-based Data Centre Network (DCN) architectures. A time-slotted Mixed Integer…

Networking and Internet Architecture · Computer Science 2020-08-11 Sanaa Hamid Mohamed , Ali Hammadi , Taisir E. H. El-Gorashi , Jaafar Mohamed Hashim Elmirghani

We study how to reduce the reconfiguration time in hybrid optical-electrical Datacenter Networks (DCNs). With a layer of Optical Circuit Switches (OCSes), hybrid optical-electrical DCNs can reconfigure its logical topologies to better match…

Networking and Internet Architecture · Computer Science 2023-12-20 Shuyuan Zhang , Shu Shan , Shizhen Zhao

We consider routing in reconfigurable networks, which is also known as coflow scheduling in the literature. The algorithmic literature generally (perhaps implicitly) assumes that the amount of data to be transferred is large. Thus the…

Data Structures and Algorithms · Computer Science 2026-03-17 Alexander Lindermayr , Kirk Pruhs , Andréa W. Richa , Tegan Wilson

The coflow scheduling problem is considered: given an input/output switch with each port having a fixed capacity, find a scheduling algorithm that minimizes the weighted sum of the coflow completion times respecting the port capacities,…

Data Structures and Algorithms · Computer Science 2020-04-14 Akhil Bhimaraju , Debanuj Nayak , Rahul Vaze

This paper addresses the challenging scheduling problem of coflows with release times, with the objective of minimizing the total weighted completion time. Previous literature has predominantly concentrated on establishing the scheduling…

Data Structures and Algorithms · Computer Science 2023-12-27 Chi-Yeh Chen

In this work, we propose and experimentally assess the automatic and flexible NSs configurations of optical OPSquare DCN controlled and orchestrated by an extended SDN control plane for multi-tenant applications with differentiated QoS…

Networking and Internet Architecture · Computer Science 2020-04-22 Xuwei Xue , Fu Wang , Fernando Agraz , Albert Pagès , Bitao Pan , Fulong Yan , Xiaotao Guo , Salvatore Spadaro , Nicola Calabretta

Hybrid intra-data centre networks, with optical and electrical capabilities, are attracting research interest in recent years. This is attributed to the emergence of new bandwidth greedy applications and novel computing paradigms. A key…

Networking and Internet Architecture · Computer Science 2013-06-04 Ibrahim Kabiru Musa , Stuart Walker

This paper studies the problem of congestion control and scheduling in ad hoc wireless networks that have to support a mixture of best-effort and real-time traffic. Optimization and stochastic network theory have been successful in…

Networking and Internet Architecture · Computer Science 2009-12-13 Juan Jose Jaramillo , R. Srikant

Software-defined networking (SDN) as a new paradigm for networking provides efficient resource reallocation platform in emerging cloud data center networks. The dynamic nature of cloud data center network's traffic, as well as the existence…

Networking and Internet Architecture · Computer Science 2018-04-03 Mohammad Mahdi Tajiki , Behzad Akbari , Nader Mokari

The massive integration of distributed energy resources changes the operational demands of the electric power distribution system, motivating optimization-based approaches. The added computational complexities of the resulting optimal power…

Optimization and Control · Mathematics 2023-07-04 Yunqi Luo , Rabayet Sadnan , Bala Krishnamoorthy , Anamika Dubey

Data center networks leverage multiple parallel paths connecting end host pairs to offer high bisection bandwidth for cluster computing applications. However, state of the art distributed multi-pathing protocols such as Equal Cost Multipath…

Networking and Internet Architecture · Computer Science 2013-07-30 Wenzhi Cui , Chen Qian

In data-parallel computing frameworks, intermediate parallel data is often produced at various stages which needs to be transferred among servers in the datacenter network (e.g. the shuffle phase in MapReduce). A stage often cannot start or…

Data Structures and Algorithms · Computer Science 2017-04-28 Mehrnoosh Shafiee , Javad Ghaderi

The proliferation of wireless communications networks over the past decades, combined with the scarcity of the wireless spectrum, have motivated a significant effort towards increasing the throughput of wireless networks. One of the major…

Signal Processing · Electrical Eng. & Systems 2022-06-27 Emeka Abakasanga , Nir Shlezinger , Ron Dabora

As more IoT applications gradually move towards the cloud-edge collaborative mode, the containerized scheduling of workflows extends from the cloud to the edge. However, given the high delay of the communication network, loose coupling of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-03 Chenggang Shan , Runze Gao , Qinghua Han , Zhen Yang , Jinhui Zhang , Yuanqing Xia

Machine learning training places immense demands on cluster networks, motivating specialized architectures and co-design with parallelization strategies. Recent designs incorporating optical circuit switches (OCSes) are promising, offering…

Networking and Internet Architecture · Computer Science 2026-02-20 Daniel Amir , Ori Cohen , Jakob Krebs , Mark Silberstein

Major chip manufacturers have all introduced multicore microprocessors. Multi-socket systems built from these processors are used for running various server applications. However to the best of our knowledge current commercial operating…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-24 Suryanarayana Murthy Durbhakula