English
Related papers

Related papers: MRSch: Multi-Resource Scheduling for HPC

200 papers

The following interdisciplinary article presents a memetic algorithm with applying deep reinforcement learning (DRL) for solving practically oriented dual resource constrained flexible job shop scheduling problems (DRC-FJSSP). From research…

Machine Learning · Computer Science 2023-07-10 Felix Grumbach , Nour Eldin Alaa Badr , Pascal Reusch , Sebastian Trojahn

GPU-based heterogeneous architectures are now commonly used in HPC clusters. Due to their architectural simplicity specialized for data-level parallelism, GPUs can offer much higher computational throughput and memory bandwidth than CPUs in…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-15 Urvij Saroliya , Eishi Arima , Dai Liu , Martin Schulz

The primary motivation for uptake of virtualization has been resource isolation, capacity management and resource customization allowing resource providers to consolidate their resources in virtual machines. Various approaches have been…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-09-27 Omer Khalid , Ivo Maljevic , Richard Anthony , Miltos Petridis , Kevin Parrot , Markus Schulz

With the rapid development of deep learning, deep reinforcement learning (DRL) began to appear in the field of resource scheduling in recent years. Based on the previous research on DRL in the literature, we introduce online resource…

Artificial Intelligence · Computer Science 2018-06-22 Yufei Ye , Xiaoqin Ren , Jin Wang , Lingxiao Xu , Wenxia Guo , Wenqiang Huang , Wenhong Tian

This paper presents a systematic review of mapping and scheduling strategies within the High-Performance Computing (HPC) compute continuum, with a particular emphasis on heterogeneous systems. It introduces a prototype workflow to establish…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-19 Aasish Kumar Sharma , Julian Kunkel

Machine scheduling aims to optimize job assignments to machines while adhering to manufacturing rules and job specifications. This optimization leads to reduced operational costs, improved customer demand fulfillment, and enhanced…

In this paper, we~present a novel scheduling solution for a class of System-on-Chip (SoC) systems where heterogeneous chip resources (DSP, FPGA, GPU, etc.) must be efficiently scheduled for continuously arriving hierarchical jobs with their…

Artificial Intelligence · Computer Science 2020-06-08 Tegg Taekyong Sung , Jeongsoo Ha , Jeewoo Kim , Alex Yahja , Chae-Bong Sohn , Bo Ryu

High-Performance Computing (HPC) job scheduling involves balancing conflicting objectives such as minimizing makespan, reducing wait times, optimizing resource use, and ensuring fairness. Traditional methods, including heuristic-based,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-05 Prachi Jadhav , Hongwei Jin , Ewa Deelman , Prasanna Balaprakash

We propose a novel job scheduling approach for homogeneous cluster computing platforms. Its key feature is the use of virtual machine technology to share fractional node resources in a precise and controlled manner. Other VM-based…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-06-27 Henri Casanova , Mark Stillwell , Frédéric Vivien

Dependency-aware job scheduling in the cluster is NP-hard. Recent work shows that Deep Reinforcement Learning (DRL) is capable of solving it. It is difficult for the administrator to understand the DRL-based policy even though it achieves…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-21 Shaojun Zhang , Chen Wang , Albert Zomaya

This study addresses the challenge of resource scheduling optimization in edge-cloud collaborative computing using deep reinforcement learning (DRL). The proposed DRL-based approach improves task processing efficiency, reduces overall…

Machine Learning · Computer Science 2025-04-30 Yuqing Wang , Xiao Yang

New HPC machines are getting close to the exascale. Power consumption for those machines has been increasing, and researchers are studying ways to reduce it. A second trend is HPC machines' growing complexity, with increasing heterogeneous…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-24 Marco D'Amico , Julita Corbalan

Dynamic resource management is essential for optimizing computational efficiency in modern high-performance computing (HPC) environments, particularly as systems scale. While research has demonstrated the benefits of malleability in…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-18 Sergio Iserte , Iker Martín-Álvarez , Krzysztof Rojek , José I. Aliaga , Maribel Castillo , Weronika Folwarska , Antonio J. Peña

We consider networked control systems consisting of multiple independent controlled subsystems, operating over a shared communication network. Such systems are ubiquitous in cyber-physical systems, Internet of Things, and large-scale…

Systems and Control · Computer Science 2018-06-14 Burak Demirel , Arunselvan Ramaswamy , Daniel E. Quevedo , Holger Karl

The charging scheduling problem of Electric Buses (EBs) is investigated based on Deep Reinforcement Learning (DRL). A Markov Decision Process (MDP) is conceived, where the time horizon includes multiple charging and operating periods in a…

Machine Learning · Computer Science 2025-05-16 Jiaju Qi , Lei Lei , Thorsteinn Jonsson , Lajos Hanzo

Efficient scheduling of distributed deep learning (DL) jobs in large GPU clusters is crucial for resource efficiency and job performance. While server sharing among jobs improves resource utilization, interference among co-located DL jobs…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-28 Xiaoyang Zhao , Chuan Wu

In mobile crowdsourcing (MCS), mobile users accomplish outsourced human intelligence tasks. MCS requires an appropriate task assignment strategy, since different workers may have different performance in terms of acceptance rate and…

Machine Learning · Computer Science 2018-11-09 Sabrina Klos , Cem Tekin , Mihaela van der Schaar , Anja Klein

Job schedulers are a key component of scalable computing infrastructures. They orchestrate all of the work executed on the computing infrastructure and directly impact the effectiveness of the system. Recently, job workloads have…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-06 Albert Reuther , Chansup Byun , William Arcand , David Bestor , Bill Bergeron , Matthew Hubbell , Michael Jones , Peter Michaleas , Andrew Prout , Antonio Rosa , Jeremy Kepner

Adaptive Mixed-Criticality (AMC) is a fixed-priority preemptive scheduling algorithm for mixed-criticality hard real-time systems. It dominates many other scheduling algorithms for mixed-criticality systems, but does so at the cost of…

Operating Systems · Computer Science 2024-11-04 Bruno Mendes , Pedro F. Souto , Pedro C. Diniz

Optimizing resource utilization in high-performance computing (HPC) clusters is essential for maximizing both system efficiency and user satisfaction. However, traditional rigid job scheduling often results in underutilized resources and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-20 Patrick Zojer , Jonas Posner , Taylan Özden