English
Related papers

Related papers: Do the Hard Stuff First: Scheduling Dependent Comp…

200 papers

Edge computing has become a promising computing paradigm for building IoT (Internet of Things) applications, particularly for applications with specific constraints such as latency or privacy requirements. Due to resource constraints at the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-15 Fei Hu , Kunal Mehta , Shivakant Mishra , Mohammad AlMutawa

Large data and computing centers consume a significant share of the world's energy consumption. A prominent subset of the workloads in such centers are workflows with interdependent tasks, usually represented as directed acyclic graphs…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-12 Dominik Schweisgut , Anne Benoit , Yves Robert , Henning Meyerhenke

Datacenters act as cloud-infrastructure to stakeholders across industry, government, and academia. To meet growing demand yet operate efficiently, datacenter operators employ increasingly more sophisticated scheduling systems, mechanisms,…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-14 Georgios Andreadis , Laurens Versluis , Fabian Mastenbroek , Alexandru Iosup

Many companies now use crowdsourcing to leverage external (as well as internal) crowds to perform specialized work, and so methods of improving efficiency are critical. Tasks in crowdsourcing systems with specialized work have multiple…

Multiagent Systems · Computer Science 2016-01-19 Avhishek Chatterjee , Michael Borokhovich , Lav R. Varshney , Sriram Vishwanath

As AI cluster sizes continue to expand and the demand for large-language-model (LLM) training and inference workloads grows rapidly, traditional scheduling systems face significant challenges in balancing resource utilization, scheduling…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-03 Lingling Zeng , Gen Zhang , Jialin Peng , Xiang Xu , Yuan Xu , Lijun Ma

Today high-performance computing (HPC) platforms are still dominated by batch jobs. Accordingly, effective batch job scheduling is crucial to obtain high system efficiency. Existing HPC batch job schedulers typically leverage heuristic…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-03 Di Zhang , Dong Dai , Youbiao He , Forrest Sheng Bao , Bing Xie

Diverse workloads such as interactive supercomputing, big data analysis, and large-scale AI algorithm development, requires a high-performance scheduler. This paper presents a novel node-based scheduling approach for large scale simulations…

Adaptive workloads can change on--the--fly the configuration of their jobs, in terms of number of processes. In order to carry out these job reconfigurations, we have designed a methodology which enables a job to communicate with the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-01 Sergio Iserte , Rafael Mayo , Enrique S. Quintana-Orti , Vicenc Beltran , Antonio J. Peña

Performing efficient resource provisioning is a fundamental aspect for any resource provider. Local Resource Management Systems (LRMS) have been used in data centers for decades in order to obtain the best usage of the resources, providing…

We describe in this paper a new method for building an efficient algorithm for scheduling jobs in a cluster. Jobs are considered as parallel tasks (PT) which can be scheduled on any number of processors. The main feature is to consider two…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-16 Pierre-Francois Dutot , Lionel Eyraud , Grégory Mounié , Denis Trystram

We study a scheduling problem in which jobs may be split into parts, where the parts of a split job may be processed simultaneously on more than one machine. Each part of a job requires a setup time, however, on the machine where the job…

Data Structures and Algorithms · Computer Science 2012-12-11 Frans Schalekamp , Rene Sitters , Suzanne van der Ster , Leen Stougie , Victor Verdugo , Anke van Zuylen

We propose a novel GPU-cluster scheduler for distributed DL (DDL) workloads that enables proximity based consolidation of GPU resources based on the DDL jobs' sensitivities to the anticipated communication-network delays. Our scheduler…

Performance · Computer Science 2025-11-11 Aakash Sharma , Vivek M. Bhasi , Sonali Singh , George Kesidis , Mahmut T. Kandemir , Chita R. Das

The primary motivation for uptake of virtualization has been resource isolation, capacity management and resource customization allowing resource providers to consolidate their resources in virtual machines. Various approaches have been…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-09-27 Omer Khalid , Ivo Maljevic , Richard Anthony , Miltos Petridis , Kevin Parrot , Markus Schulz

Cloud computing is a new archetype that provides dynamic computing services to cloud users through the support of datacenters that employs the services of datacenter brokers which discover resources and assign them Virtually. The focus of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-29 J. Kok Konjaang , J. Y. Maipan-uku , Kumangkem Kennedy Kubuga

Competitive analysis of online algorithms has commonly been applied to understand the behaviour of real-time systems during overload conditions. While competitive analysis provides insight into the behaviour of certain algorithms, it is…

Performance · Computer Science 2018-06-06 Sathish Gopalakrishnan

For a cloud service provider, delivering optimal system performance while fulfilling Quality of Service (QoS) obligations is critical for maintaining a viably profitable business. This goal is often hard to attain given the irregular nature…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-14 Husam Suleiman , Otman Basir

Realizing an optimal task scheduling by taking into account the business importance of jobs has become a matter of interest in pay and use model of Cloud computing. Introduction of an appropriate model for an efficient task scheduling…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-07-22 Vivek Sharma , T. R. Gopalakrishnan Nair

Assigning jobs onto identical machines with the objective to minimize the maximal load is one of the most basic problems in combinatorial optimization. Motivated by product planing and data placement, we study a natural extension called…

Data Structures and Algorithms · Computer Science 2019-09-27 Klaus Jansen , Alexandra Lassota , Marten Maack

Burst-Buffering is a promising storage solution that introduces an intermediate highthroughput storage buffer layer to mitigate the I/O bottleneck problem that the current High-Performance Computing (HPC) platforms suffer. The existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-17 Benbo Zha , Hong Shen

In Grids scheduling decisions are often made on the basis of jobs being either data or computation intensive: in data intensive situations jobs may be pushed to the data and in computation intensive situations data may be pulled to the…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-07-06 Richard McClatchey , Ashiq Anjum , Heinz Stockinger , Arshad Ali , Ian Willers , Michael Thomas