English
Related papers

Related papers: Do the Hard Stuff First: Scheduling Dependent Comp…

200 papers

This study presents a machine learning-assisted approach to optimize task scheduling in cluster systems, focusing on node-affinity constraints. Traditional schedulers like Kubernetes struggle with real-time adaptability, whereas the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-30 Leszek Sliwko , Jolanta Mizera-Pietraszko

The operating system's role in a computer system is to manage the various resources. One of these resources is the Central Processing Unit. It is managed by a component of the operating system called the CPU scheduler. Schedulers are…

Operating Systems · Computer Science 2010-11-09 George Anderson , Tshilidzi Marwala , Fulufhelo V. Nelwamondo

Recent years have witnessed a rapid growth of distributed machine learning (ML) frameworks, which exploit the massive parallelism of computing clusters to expedite ML training. However, the proliferation of distributed ML frameworks also…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-16 Menglu Yu , Jia Liu , Chuan Wu , Bo Ji , Elizabeth S. Bentley

We consider a distributed computing network consisting of a master and multiple workers processing tasks of different types. The master is running multiple applications. Each application stochastically generates real-time jobs with a strict…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-31 Yu-Pin Hsu , Yu-Chih Huang , Shin-Lin Shieh

This paper focuses on the analysis of real-time non preemptive multiprocessor scheduling with precedence and several latency constraints. It aims to specify a schedulability condition which enables a designer to check a priori -without…

Operating Systems · Computer Science 2013-01-22 Omar Kermia

Scheduling applications on wide-area distributed systems is useful for obtaining quick and reliable results in an efficient manner. Optimized scheduling algorithms are fundamentally important in order to achieve optimized resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-06-28 Diana Moise , Eliza Moise , Florin Pop , Valentin Cristea

Large batch jobs such as Deep Learning, HPC and Spark require far more computational resources and higher cost than conventional online service. Like the processing of other time series data, these jobs possess a variety of characteristics…

Machine Learning · Computer Science 2020-10-13 Peng Gao

Job scheduling in cloud computing environments is a critical yet complex problem. Cloud computing user job requirements are highly dynamic and uncertain, while cloud computing resources are heterogeneous and constrained. This paper studies…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-25 Guang Fang , Yuxiang Zhao

High-performance computing systems are complex machines whose behaviour is governed by the correct functioning of its many subsystems. Among these, the workload scheduler has a crucial impact on the timely execution of the jobs continuously…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-14 Daniela Loreti , Davide Leone , Andrea Borghesi

Results from the research and development of a Data Intensive and Network Aware (DIANA) scheduling engine, to be used primarily for data intensive sciences such as physics analysis, are described. In Grid analyses, tasks can involve…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-11-11 Ashiq Anjum , Richard McClatchey , Arshad Ali , Ian Willers

Cloud computing is an emerging technology in distributed computing which facilitates pay per model as per user demand and requirement.Cloud consist of a collection of virtual machine which includes both computational and storage facility.…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-04-09 Dr. Amit Agarwal , Saloni Jain

Deep Learning (DL) workloads have rapidly increased in popularity in enterprise clusters and several new cluster schedulers have been proposed in recent years to support these workloads. With rapidly evolving DL workloads, it is challenging…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-21 Saurabh Agarwal , Amar Phanishayee , Shivaram Venkataraman

Several companies and research institutes are moving their CPU-intensive applications to hybrid High Performance Computing (HPC) cloud environments. Such a shift depends on the creation of software systems that help users decide where a job…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-30 Renato L. F. Cunha , Eduardo R. Rodrigues , Leonardo P. Tizzei , Marco A. S. Netto

Many real-world scientific workflows can be represented by a Directed Acyclic Graph (DAG), where each node represents a task and a directed edge signifies a dependency between two tasks. Due to the increasing computational resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-04 Atherve Tekawade , Suman Banerjee

Many academic disciplines - including information systems, computer science, and operations management - face scheduling problems as important decision making tasks. Since many scheduling problems are NP-hard in the strong sense, there is a…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-26 Gerhard Rauchecker , Guido Schryen

The rapid development of cloud-native architecture has promoted the widespread application of container technology, but the optimization problems in container scheduling and resource management still face many challenges. This paper…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-24 Xiaoye Wang

Cache partitioning techniques have been successfully adopted to mitigate interference among concurrently executing real-time tasks on multi-core processors. Considering that the execution time of a cache-sensitive task strongly depends on…

Hardware Architecture · Computer Science 2023-10-05 Binqi Sun , Debayan Roy , Tomasz Kloda , Andrea Bastoni , Rodolfo Pellizzoni , Marco Caccamo

This research addresses the multiprocessor scheduling problem of hard real-time systems, and it especially focuses on optimal and global schedulers when practical constraints are taken into account. First, we propose an improvement of the…

Operating Systems · Computer Science 2011-01-25 Shelby Funk , Vincent Nelis , Joel Goossens , Dragomir Milojevic , Geoffrey Nelissen

The aim of this paper is to provide a description of deep-learning-based scheduling approach for academic-purpose high-performance computing systems. The share of academic-purpose distributed computing systems (DCS) reaches 17.4 percents…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-10-08 Andrey Gritsenko

Containerization technology offers lightweight OS-level virtualization, and enables portability, reproducibility, and flexibility by packing applications with low performance overhead and low effort to maintain and scale them. Moreover,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-22 Peini Liu , Jordi Guitart