English
Related papers

Related papers: Optimisation of job scheduling for supercomputers …

200 papers

Today, companies and data centers are moving towards cloud and serverless storage systems instead of traditional file systems. As a result of such a transition, allocating sufficient resources to users and parties to satisfy their service…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-04 Seyed Esmaeil Mirvakili , Samuel Just , Carlos Maltzahn

The IT organizations invests heavy capital by consuming large scale infrastructure and advanced operating platforms. The advances in technology has resulted in emergence of cloud computing, which is promising technology to achieve the…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-10-01 K. S. Rashmi , V. Suma , M. Vaidehi

Multicore shared cache processors pose a challenge for designers of embedded systems who try to achieve minimal and predictable execution time of workloads consisting of several jobs. To address this challenge the cache is statically…

Data Structures and Algorithms · Computer Science 2012-11-26 Avinatan Hassidim , Haim Kaplan , Omry Tuval

The assessment of a job's Quality of Service (QoS) often revolves around its flow time, also referred to as response time. This study delves into two fundamental objectives for scheduling jobs: the average flow time and the maximum flow…

Data Structures and Algorithms · Computer Science 2025-05-02 Tung-Wei Kuo

Maximizing resource utilization by performing an efficient resource provisioning is a key factor for any cloud provider: commercial actors can maximize their revenues, whereas scientific and non-commercial providers can maximize their…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-29 Álvaro López García , Enol Fernández-del-Castillo , Isabel Campos Plasencia

With continuous advances in deep learning, distributed training is becoming common in GPU clusters. Specifically, for emerging workloads with diverse amounts, ratios, and patterns of communication, we observe that network contention can…

Machine Learning · Computer Science 2023-11-01 Junyeol Ryu , Jeongyoon Eo

The recent explosive growth of deep learning (DL) models has necessitated a compelling need for efficient job scheduling for distributed deep learning training with mixed parallelisms (DDLwMP) in GPU clusters. This paper proposes an…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-13 Ziyue Luo , Jia Liu , Myungjin Lee , Ness B. Shroff

Finding the best way to leverage non-volatile memory (NVM) on modern database systems is still an open problem. The answer is far from trivial since the clear boundary between memory and storage present in most systems seems to be…

Databases · Computer Science 2019-08-21 Lucas Lersch , Wolfgang Lehner , Ismail Oukid

Work-stealing is a widely used technique for balancing irregular parallel workloads, and most modern runtime systems adopt lock-free work-stealing deques to reduce contention and improve scalability. However, existing algorithms are…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-09 Raja Sai Nandhan Yadav Kataru , Danial Davarnia , Ali Jannesari

We consider the following shared-resource scheduling problem: Given a set of jobs $J$, for each $j\in J$ we must schedule a job-specific processing volume of $v_j>0$. A total resource of $1$ is available at any time. Jobs have a resource…

Data Structures and Algorithms · Computer Science 2023-10-11 Christoph Damerius , Peter Kling , Florian Schneider

Modern data centers serve workloads which are capable of exploiting parallelism. When a job parallelizes across multiple servers it will complete more quickly, but jobs receive diminishing returns from being allocated additional servers.…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-20 Benjamin Berg , Rein Vesilo , Mor Harchol-Balter

As the popularity of quantum computing continues to grow, efficient quantum machine access over the cloud is critical to both academic and industry researchers across the globe. And as cloud quantum computing demands increase exponentially,…

Quantum Physics · Physics 2022-03-28 Gokul Subramanian Ravi , Kaitlin N. Smith , Prakash Murali , Frederic T. Chong

Cloud computing has emerged as a powerful and elastic platform for internet service hosting, yet it also draws concerns of the unpredictable performance of cloud-based services due to network congestion. To offer predictable performance,…

Networking and Internet Architecture · Computer Science 2017-01-10 Ruozhou Yu , Guoliang Xue , Xiang Zhang , Dan Li

With multiple identical unit speed servers, the online problem of scheduling jobs that migrate between two phases, limitedly parallelizable or completely sequential, and choosing their respective speeds to minimize the total flow time is…

Data Structures and Algorithms · Computer Science 2022-05-03 Rahul Vaze

We present and study a new model for energy-aware and profit-oriented scheduling on a single processor. The processor features dynamic speed scaling as well as suspension to a sleep mode. Jobs arrive over time, are preemptable, and have…

Data Structures and Algorithms · Computer Science 2012-09-14 Peter Kling , Andreas Cord-Landwehr , Frederik Mallmann-Trenn

The under exploitation of the available resources risks to be one of the main problems for a computing center. The growing demand of computational power necessarily entails more complex approaches in the management of the computing…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-05-01 Federico Calzolari , Silvia Volpe

In modern computing systems, jobs' resource requirements often vary over time. Accounting for this temporal variability during job scheduling is essential for meeting performance goals. However, theoretical understanding on how to schedule…

Performance · Computer Science 2023-11-01 Yige Hong , Qiaomin Xie , Weina Wang

Deep learning has emerged as a powerful method for extracting valuable information from large volumes of data. However, when new training data arrives continuously (i.e., is not fully available from the beginning), incremental training…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-06 Thomas Bouvier , Bogdan Nicolae , Hugo Chaugier , Alexandru Costan , Ian Foster , Gabriel Antoniu

Shared virtual memory (SVM) is key in heterogeneous systems on chip (SoCs), which combine a general-purpose host processor with a many-core accelerator, both for programmability and to avoid data duplication. However, SVM can bring a…

Hardware Architecture · Computer Science 2018-08-30 Andreas Kurth , Pirmin Vogel , Andrea Marongiu , Luca Benini

Limiting flight delays during operations has become a critical research topic in recent years due to their prohibitive impact on airlines, airports, and passengers. A popular strategy for addressing this problem considers the uncertainty of…

Optimization and Control · Mathematics 2021-09-01 Sujeevraja Sanjeevi , Saravanan Venkatachalam