English
Related papers

Related papers: Metaflow: A DAG-Based Network Abstraction for Dist…

200 papers

In the present-day, distributed applications are commonly spread across multiple datacenters, reaching out to edge and fog computing locations. The transition away from single datacenter hosting is driven by capacity constraints in…

Networking and Internet Architecture · Computer Science 2024-06-19 Berta Serracanta , Alberto Rodriguez-Natal , Fabio Maino , Albert Cabellos

With the rapid advancement of technology, parallel computing applications have become increasingly popular and are commonly executed in large data centers. These applications involve two phases: computation and communication, which are…

Data Structures and Algorithms · Computer Science 2023-06-16 Chi-Yeh Chen , Jun Chen

Agentic workflows in large language model systems integrate retrieval, reasoning, and memory, but existing frameworks suffer from scalability and reproducibility limitations due to fragmented data orchestration, serialization overhead, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-05 Arup Kumar Sarker , Mills Staylor , Aymen Alsaadi , Gregor von Laszewski , Shantenu Jha , Geoffrey Fox

Apart from forming the backbone of compiler optimization, static dataflow analysis has been widely applied in a vast variety of applications, such as bug detection, privacy analysis, program comprehension, etc. Despite its importance,…

Programming Languages · Computer Science 2024-12-18 Zewen Sun , Yujin Zhang , Duanchen Xu , Yiyu Zhang , Yun Qi , Yueyang Wang , Yi Li , Zhaokang Wang , Yue Li , Xuandong Li , Zhiqiang Zuo , Qingda Lu , Wenwen Peng , Shengjian Guo

Multi-access Edge Computing (MEC) is an enabling technology to leverage new network applications, such as virtual/augmented reality, by providing faster task processing at the network edge. This is done by deploying servers closer to the…

Networking and Internet Architecture · Computer Science 2023-11-28 Gabriel F. C. de Queiroz , José F. de Rezende , Valmir C. Barbosa

With the increasing importance of distributed scientific workflows, there is a critical need to ensure Quality of Service (QoS) constraints, such as minimizing time or limiting execution to resource subsets. However, the unpredictable…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-02 Md Hasanur Rashid , Jesun Firoz , Nathan R. Tallent , Luanzheng Guo , Meng Tang , Dong Dai

Classifying network traffic according to their application-layer protocols is an important task in modern networks for traffic management and network security. Existing payload-based or statistical methods of application identification…

Networking and Internet Architecture · Computer Science 2011-05-31 Fei He , Fan Xiang , Yibo Xue , Jun Li

Whereas distributed computing research has been very successful in exploring the solvability/impossibility border of distributed computing problems like consensus in representative classes of computing models with respect to model…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-27 Hugo Rincon Galeana , Ulrich Schmid

Many scientific workflows can be represented by a Directed Acyclic Graph (DAG) where each node represents a task, and there will be a directed edge between two tasks if and only if there is a dependency relationship between the two i.e. the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-12-20 Atharva Tekawade , Suman Banerjee

Orchestrating centralised service-oriented workflows presents significant scalability challenges that include: the consumption of network bandwidth, degradation of performance, and single points of failure. This paper presents a high-level…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-11-11 Ward Jaradat , Alan Dearle , Adam Barker

Many real-world scientific workflows can be represented by a Directed Acyclic Graph (DAG), where each node represents a task and a directed edge signifies a dependency between two tasks. Due to the increasing computational resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-04 Atherve Tekawade , Suman Banerjee

The coflow scheduling problem has emerged as a popular abstraction in the last few years to study data communication problems within a data center. In this basic framework, each coflow has a set of communication demands and the goal is to…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-18 Mosharaf Chowdhury , Samir Khuller , Manish Purohit , Sheng Yang , Jie You

Co-flows model a modern scheduling setting that is commonly found in a variety of applications in distributed and cloud computing. In co-flow scheduling, there are $m$ input ports and $m$ output ports. Each co-flow $j \in J$ can be…

Data Structures and Algorithms · Computer Science 2018-12-04 Sungjin Im , Manish Purohit

Co-flows model a modern scheduling setting that is commonly found in a variety of applications in distributed and cloud computing. A stochastic co-flow task contains a set of parallel flows with randomly distributed sizes. Further, many…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-26 Ruijiu Mao , Vaneet Aggarwal , Mung Chiang

Recent trend towards increasing large machine learning models require both training and inference tasks to be distributed. Considering the huge cost of training these models, it is imperative to unlock optimizations in computation and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-29 Abhinav Jangda , Jun Huang , Guodong Liu , Amir Hossein Nodehi Sabet , Saeed Maleki , Youshan Miao , Madanlal Musuvathi , Todd Mytkowicz , Olli Sarikivi

To improve the application-level communication performance, scheduling of coflows, a collection of parallel flows sharing the same objective, is prevalent in modern data center networks (DCNs). Meanwhile, a hybrid-switched DCN design…

Networking and Internet Architecture · Computer Science 2023-06-19 Xin Wang , Hong Shen , Hui Tian

Datacenter networks commonly facilitate the transmission of data in distributed computing frameworks through coflows, which are collections of parallel flows associated with a common task. Most of the existing research has concentrated on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-24 Olivier Brun , Rachid El-Azouzi , Quang-Trung Luu , Francesco De Pellergrini , Balakrishna J. Prabhu , Cédric Richier

Multiprocessor scheduling of hard real-time tasks modeled by directed acyclic graphs (DAGs) exploits the inherent parallelism presented by the model. For DAG tasks, a node represents a request to execute an object on one of the available…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-02 Corey Tessler , Venkata P. Modekurthy , Nathan Fisher , Abusayeed Saifullah

The overall performance of a distributed system is highly dependent on the communication efficiency of the system. Although network resources (links, bandwidth) are becoming increasingly more available, the communication performance of data…

Data Structures and Algorithms · Computer Science 2009-06-02 Mugurel Ionut Andreica , Eliana-Dina Tirsa , Nicolae Tapus , Florin Pop , Ciprian Mihai Dobre

With the rapid transformation of computer hardware and algorithms, mobile networking has evolved from low data carrying capacity and high latency to better-optimized networks, either by enhancing the digital network or using different…

Networking and Internet Architecture · Computer Science 2023-11-09 Wenbo Zhu