English
Related papers

Related papers: DiFS: Distributed Flow Scheduling for Data Center …

200 papers

We present the design of a new large scale orchestration layer for accelerators. Our system, Pathways, is explicitly designed to enable exploration of new systems and ML research ideas, while retaining state of the art performance for…

Diffusion-based generation is increasingly powering production content pipelines; however, deploying these models at scale remains a significant challenge. Model weights frequently exceed the memory capacity of commodity GPUs, while the…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-26 Hantian Zha , Teng Ma , Yang Yong , Haiwen Fu , Ruiyang Ma , Wei Gao , Ruihao Gong , Xianglong Liu , Wei Wang , Yunpeng Chai

Hybrid intra-data centre networks, with optical and electrical capabilities, are attracting research interest in recent years. This is attributed to the emergence of new bandwidth greedy applications and novel computing paradigms. A key…

Networking and Internet Architecture · Computer Science 2013-06-04 Ibrahim Kabiru Musa , Stuart Walker

Parallel real-time embedded applications can be modelled as directed acyclic graphs (DAGs) whose nodes model subtasks and whose edges model precedence constraints among subtasks. Efficiently scheduling such parallel tasks can be challenging…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-24 Shardul Lendve , Konstantinos Bletsas , Pedro F. Souto

Using multiple datacenters allows for higher availability, load balancing and reduced latency to customers of cloud services. To distribute multiple copies of data, cloud providers depend on inter-datacenter WANs that ought to be used…

Networking and Internet Architecture · Computer Science 2018-04-30 Mohammad Noormohammadpour , Cauligi S. Raghavendra , Sriram Rao , Srikanth Kandula

In the paper, a new mechanism for Software-Defined Networking (SDN) flow aggregation accompanied with multipath transmission is proposed. The aggregation results in a low number of flow entries in core switches. This type of scalability…

Networking and Internet Architecture · Computer Science 2020-06-11 Zbigniew Duliński , Grzegorz Rzym , Piotr Chołda

In the edge-cloud continuum, datacenters provide microservices (MSs) to mobile users, with each MS having specific latency constraints and computational requirements. Deploying such a variety of MSs matching their requirements with the…

Networking and Internet Architecture · Computer Science 2023-05-02 Itamar Cohen , Paolo Giaccone , Carla Fabiana Chiasserini

This paper presents resource management techniques for allocating communication and computational resources in a distributed stream processing platform. The platform is designed to exploit the synergy of two classes of network connections…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-03-25 Shah Asaduzzaman , Muthucumaru Maheswaran

Transactional frequent subgraph mining identifies frequent subgraphs in a collection of graphs. This research problem has wide applicability and increasingly requires higher scalability over single machine solutions to address the needs of…

Databases · Computer Science 2017-03-07 André Petermann , Martin Junghanns , Erhard Rahm

With the rapid transformation of computer hardware and algorithms, mobile networking has evolved from low data carrying capacity and high latency to better-optimized networks, either by enhancing the digital network or using different…

Networking and Internet Architecture · Computer Science 2023-11-09 Wenbo Zhu

This paper first presents a parallel solution for the Flowshop Scheduling Problem in parallel environment, and then proposes a novel load balancing strategy. The proposed Proportional Fairness Strategy (PFS) takes computational performance…

Networking and Internet Architecture · Computer Science 2008-09-22 Zheng Sun , Xiaohong Huang , Yan Ma

In this paper we analyze the problem of optimal task scheduling for data centers. Given the available resources and tasks, we propose a fast distributed iterative algorithm which operates over a large scale network of nodes and allows each…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-08 Apostolos I. Rikos , Andreas Grammenos , Evangelia Kalyvianaki , Christoforos N. Hadjicostis , Themistoklis Charalambous , Karl H. Johansson

Hybrid IP networks that use both control paradigms - distributed and centralized - promise the best of two worlds: programmability and agility of SDN, and reliability and fault tolerance of distributed routing protocols like OSPF. The…

Networking and Internet Architecture · Computer Science 2016-10-27 Marcel Caria , Admela Jukan , Marco Hoffmann

Employing channel adaptive resource allocation can yield to a large enhancement in almost any performance metric of Device-to-Device (D2D) communications. We observe that D2D users are able to estimate their local Channel State Information…

Information Theory · Computer Science 2019-02-26 Rita Ibrahim , Mohamad Assaad , Berna Sayrac , Azeddine Gati

Load balancing is critical for distributed storage to meet strict service-level objectives (SLOs). It has been shown that a fast cache can guarantee load balancing for a clustered storage system. However, when the system scales out to…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-18 Zaoxing Liu , Zhihao Bai , Zhenming Liu , Xiaozhou Li , Changhoon Kim , Vladimir Braverman , Xin Jin , Ion Stoica

With the advent of 5G and the evolution of Internet protocols, industrial applications are moving from vertical solutions to general purpose IP-based infrastructures that need to meet deterministic Quality of Service (QoS) requirements. The…

Networking and Internet Architecture · Computer Science 2020-10-29 Jonatan Krolikowski , Sebastien Martin , Paolo Medagliani , Jeremie Leguay , Shuang Chen , Xiaodong Chang , Xuesong Geng

Traditional IP multicast routing is not suitable for cloud data center (DC) networks due to the need for supporting large numbers of groups with large group sizes. State-of-the-art DC multicast routing approaches aim to overcome the…

Networking and Internet Architecture · Computer Science 2020-08-12 Jarallah Alqahtani , Bechir Hamdaoui

In an age where the distribution of information is crucial, current file sharing solutions suffer significant deficiencies. Popular systems such as Google Drive, torrenting and IPFS suffer issues with compatibility, accessibility and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-22 Julian Boesch

Data center applications use multicast as an effective method to reduce bandwidth cost. However, traditional multicast protocols designed for IP networks are usually bottlenecked by the limited state capacity on switches. In this paper, we…

Networking and Internet Architecture · Computer Science 2014-04-01 Wenzhi Cui , Chen Qian

RDMA-empowered cloud services are gradually deployed across datacenters (DCs) with multiple paths, which exhibit new properties of path asymmetry, delayed congestion signals, and simultaneous flow routing collisions, and further fail…

Networking and Internet Architecture · Computer Science 2026-04-10 Dong-Yang Yu , Yuchao Zhang , Xiaodi Wang , Jun Wang , Wenfei Wu , Haipeng Yao , Wendong Wang , Ke Xu