English
Related papers

Related papers: A Scheduling Algorithm to Maximize Storm Throughpu…

200 papers

Many real-world scientific workflows can be represented by a Directed Acyclic Graph (DAG), where each node represents a task and a directed edge signifies a dependency between two tasks. Due to the increasing computational resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-04 Atherve Tekawade , Suman Banerjee

The impact of transformer networks is booming, yet, they come with significant computational complexity. It is therefore essential to understand how to optimally map and execute these networks on modern neural processor hardware. So far,…

Hardware Architecture · Computer Science 2024-06-17 Steven Colleman , Arne Symons , Victor J. B. Jung , Marian Verhelst

Major chip manufacturers have all introduced multicore microprocessors. Multi-socket systems built from these processors are routinely used for running various server applications. Depending on the application that is run on the system,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-09-25 Murthy Durbhakula

Finding the best way to schedule operations in a computation graph is a classical NP-hard problem which is central to compiler optimization. However, evaluating the goodness of a schedule on the target hardware can be very time-consuming.…

Artificial Intelligence · Computer Science 2023-02-15 David W. Zhang , Corrado Rainone , Markus Peschl , Roberto Bondesan

Cloud resource management is often modeled by two-dimensional bin packing with a set of items that correspond to tasks having fixed CPU and memory requirements. However, applications running in clouds are much more flexible: modern…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-01 Bartłomiej Przybylski , Paweł Żuk , Krzysztof Rzadca

This paper presents a case for exploiting the synergy of dedicated and opportunistic network resources in a distributed hosting platform for data stream processing applications. Our previous studies have demonstrated the benefits of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Shah Asaduzzaman , Muthucumaru Maheswaran

The conventional design of real-time approaches depends heavily on the normal performance of systems and it often becomes incapacitated in dealing with catastrophic scenarios effectively. There are several investigations carried out to…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-07-22 A. Christy Persya , T. R. Gopalakrishnan Nair

The dynamic adaptation of resource levels enables the system to enhance energy efficiency while maintaining the necessary computational resources, particularly in scenarios where workloads fluctuate significantly over time. The proposed…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-14 Said Muhammad , Lahlou Laaziz , Nadjia Kara , Phat Tan Nguyen , Timothy Murphy

Partitioning graphs into blocks of roughly equal size such that few edges run between blocks is a frequently needed operation when processing graphs on a parallel computer. When a topology of a distributed system is known an important task…

Data Structures and Algorithms · Computer Science 2020-01-23 Marcelo Fonseca Faraj , Alexander van der Grinten , Henning Meyerhenke , Jesper Larsson Träff , Christian Schulz

Heterogeneous multicore architectures are becoming increasingly popular due to their potential of achieving high performance and energy efficiency compared to the homogeneous multicore architectures. In such systems, the real-time…

Operating Systems · Computer Science 2014-05-29 Guangmo Tong , Cong Liu

Modern machine learning workloads use large models, with complex structures, that are very expensive to execute. The devices that execute complex models are becoming increasingly heterogeneous as we see a flourishing of domain-specific…

Machine Learning · Computer Science 2020-11-02 Jakub Tarnawski , Amar Phanishayee , Nikhil R. Devanur , Divya Mahajan , Fanny Nina Paravecino

The recent explosive growth of deep learning (DL) models has necessitated a compelling need for efficient job scheduling for distributed deep learning training with mixed parallelisms (DDLwMP) in GPU clusters. This paper proposes an…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-13 Ziyue Luo , Jia Liu , Myungjin Lee , Ness B. Shroff

This paper presents resource management techniques for allocating communication and computational resources in a distributed stream processing platform. The platform is designed to exploit the synergy of two classes of network connections…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-03-25 Shah Asaduzzaman , Muthucumaru Maheswaran

We present a scheduler that improves cluster utilization and job completion times by packing tasks having multi-resource requirements and inter-dependencies. While the problem is algorithmically very hard, we achieve near-optimality on the…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-26 Robert Grandl , Srikanth Kandula , Sriram Rao , Aditya Akella , Janardhan Kulkarni

We study a distributed framework for stochastic optimization which is inspired by models of collective motion found in nature (e.g., swarming) with mild communication requirements. Specifically, we analyze a scheme in which each one of $N >…

Optimization and Control · Mathematics 2018-08-08 Shi Pu , Alfredo Garcia

Developing high-performance and energy-efficient algorithms for maximum matchings is becoming increasingly important in social network analysis, computational sciences, scheduling, and others. In this work, we propose the first maximum…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-29 Maciej Besta , Marc Fischer , Tal Ben-Nun , Dimitri Stanojevic , Johannes De Fine Licht , Torsten Hoefler

Proportional Fair (PF) is a scheduling technique to maintain a balance between maximizing throughput and ensuring fairness to users. Dual Connectivity (DC) technique was introduced by the 3rd Generation Partnership Project (3GPP) to improve…

Networking and Internet Architecture · Computer Science 2020-02-18 Pradnya Kiri Taksande , Prasanna Chaporkar , Pranav Jha , Abhay Karandikar

Neuromorphic Systems-on-Chip (NSoCs) are becoming heterogeneous by integrating general-purpose processors (GPPs) and neural processing units (NPUs) on the same SoC. For embedded systems, an NSoC may need to execute user applications built…

Hardware Architecture · Computer Science 2022-09-30 Anup Das

Ensuring the highest training throughput to maximize resource efficiency, while maintaining fairness among users, is critical for deep learning (DL) training in heterogeneous GPU clusters. However, current DL schedulers provide only limited…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-28 Zizhao Mo , Huanle Xu , Wing Cheong Lau

The utilization of cloud environments to deploy scientific workflow applications is an emerging trend in scientific community. In this area, the main issue is the scheduling of workflows, which is known as an NP-complete problem. Apart from…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-17 J. E. Ndamlabin Mboula , V. C. Kamla , M. H. Hilman , C. Tayou Djamegni