English
Related papers

Related papers: Three Practical Workflow Schedulers for Easy Maxim…

200 papers

Online scheduling has been a well studied and challenging research problem over the last five decades since the pioneering work of Graham with immense practical significance in various applications such as interactive parallel processing,…

Operating Systems · Computer Science 2020-01-15 Debasis Dwibedy , Rakesh Mohanty

In this paper we describe HeSP, a complete simulation framework to study a general task scheduling-partitioning problem on heterogeneous architectures, which treats recursive task partitioning and scheduling decisions on equal footing.…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-02-18 Anton Rey , Francisco D. Igual , Manuel Prieto-Matías

Modern datacenters schedule heterogeneous workloads across geo-distributed sites with diverse compute capacities, electricity prices, and thermal conditions. Compute utilization, heat generation, cooling demand, and energy consumption are…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-20 Nilavra Pathak , Samadrita Biswas , Nirmalya Roy

Distributed data processing systems like MapReduce, Spark, and Flink are popular tools for analysis of large datasets with cluster resources. Yet, users often overprovision resources for their data processing jobs, while the resource usage…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-16 Lauritz Thamsen , Ilya Verbitskiy , Sasho Nedelkoski , Vinh Thuy Tran , Vinicius Meyer , Miguel G. Xavier , Odej Kao , Cesar A. F. De Rose

We study a scheduling problem in which jobs may be split into parts, where the parts of a split job may be processed simultaneously on more than one machine. Each part of a job requires a setup time, however, on the machine where the job…

Data Structures and Algorithms · Computer Science 2012-12-11 Frans Schalekamp , Rene Sitters , Suzanne van der Ster , Leen Stougie , Victor Verdugo , Anke van Zuylen

Modern platforms are using accelerators in conjunction with standard processing units in order to reduce the running time of specific operations, such as matrix operations, and improve their performance. Scheduling on such hybrid platforms…

Data Structures and Algorithms · Computer Science 2020-02-11 Vincent Fagnon , Imed Kacem , Giorgio Lucarelli , Bertrand Simon

In this paper, we proposed an effective approach for scheduling of multiprocessor unit time tasks with chain precedence on to large multiprocessor system. The proposed longest chain maximum processor scheduling algorithm is proved to be…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-08-14 T. K. Agrawal , R. Sharma , M. Ghose , A. Sahu

Nowadays, we are to find out solutions to huge computing problems very rapidly. It brings the idea of parallel computing in which several machines or processors work cooperatively for computational tasks. In the past decades, there are a…

Programming Languages · Computer Science 2014-02-07 Brijender Kahanwal

Co-flows model a modern scheduling setting that is commonly found in a variety of applications in distributed and cloud computing. A stochastic co-flow task contains a set of parallel flows with randomly distributed sizes. Further, many…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-26 Ruijiu Mao , Vaneet Aggarwal , Mung Chiang

This paper addresses the problem of scheduling a set of jobs that are released over the time on a set of identical parallel machines, aiming at the minimization of the total weighted completion time. This problem, referred to as $P|r_j|\sum…

Optimization and Control · Mathematics 2020-06-30 Arthur Kramer , Mauro Dell'Amico , Dominique Feillet , Manuel Iori

In this paper, we introduce Heteroflow, a new C++ library to help developers quickly write parallel CPU-GPU programs using task dependency graphs. Heteroflow leverages the power of modern C++ and task-based approaches to enable efficient…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-17 Tsung-Wei Huang , Yibo Lin

This paper addresses a production scheduling problem derived from an industrial use case, focusing on unrelated parallel machine scheduling with the personnel availability constraint. The proposed model optimizes the production plan over a…

Artificial Intelligence · Computer Science 2024-02-27 Maziyar Khadivi , Mostafa Abbasi , Todd Charter , Homayoun Najjaran

Resource allocation in High Performance Computing (HPC) environments presents a complex and multifaceted challenge for job scheduling algorithms. Beyond the efficient allocation of system resources, schedulers must account for and optimize…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-08 Matthew Sgambati , Aleksandar Vakanski , Matthew Anderson

One typical use case of large-scale distributed computing in data centers is to decompose a computation job into many independent tasks and run them in parallel on different machines, sometimes known as the "embarrassingly parallel"…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-04-07 Da Wang , Gauri Joshi , Gregory Wornell

This paper presents a multiagent approach as a paradigm for scheduling parallel jobs in a parallel system. Scheduling parallel jobs is performed as a means to balance the load of a system in order to improve the performance of a parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-29 Jaderick P. Pabico

Hybrid AI-HPC workflows combine large-scale simulation, training, high-throughput inference, and tightly coupled, agent-driven control within a single execution campaign. These workflows impose heterogeneous and often conflicting…

The Tapis framework provides APIs for automating job execution on remote resources, including HPC clusters and servers running in the cloud. Tapis can simplify the interaction with remote cyberinfrastructure (CI), but the current services…

Performance · Computer Science 2024-08-08 Joe Stubbs , Smruti Padhy , Richard Cardone

New HPC machines are getting close to the exascale. Power consumption for those machines has been increasing, and researchers are studying ways to reduce it. A second trend is HPC machines' growing complexity, with increasing heterogeneous…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-24 Marco D'Amico , Julita Corbalan

The performance of anytime algorithms can be improved by simultaneously solving several instances of algorithm-problem pairs. These pairs may include different instances of a problem (such as starting from a different initial state),…

Artificial Intelligence · Computer Science 2011-06-28 L. Finkelstein , S. Markovitch , E. Rivlin

Parallel computing is a standard approach to achieving high-performance computing (HPC). Three commonly used methods to implement parallel computing include: 1) applying multithreading technology on single-core or multi-core CPUs; 2)…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-18 Xinyao Yi