English
Related papers

Related papers: Predicting Dynamic Memory Requirements for Scienti…

200 papers

Many scientific workflows can be modeled as a Directed Acyclic Graph (henceforth mentioned as DAG) where the nodes represent individual tasks, and the directed edges represent data and control flow dependency between two tasks. Due to the…

Computers and Society · Computer Science 2022-12-20 Atharva Tekawade , Suman Banerjee

A novel energy reduction strategy to maximally exploit the dynamic workload variation is proposed for the offline voltage scheduling of preemptive systems. The idea is to construct a fully-preemptive schedule that leads to minimum energy…

Other Computer Science · Computer Science 2011-11-09 Lap-Fai Leung , Chi-Ying Tsui , Xiaobo Sharon Hu

Infrastructure as a service clouds hide the complexity of maintaining the physical infrastructure with a slight disadvantage: they also hide their internal working details. Should users need knowledge about these details e.g., to increase…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-20 Gabor Kecskemeti , Zsolt Nemeth , Attila Kertesz , Rajiv Ranjan

Scientific workflows are a cornerstone of modern scientific computing. They are used to describe complex computational applications that require efficient and robust management of large volumes of data, which are typically stored/processed…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-03 Rafael Ferreira da Silva , Loïc Pottier , Tainã Coleman , Ewa Deelman , Henri Casanova

Data-intensive scientific workflows increasingly rely on high-performance computing (HPC) systems, complementing traditional Grid and Cloud platforms. However, workflow scheduling on HPC infrastructures remains challenging due to the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-26 Aurelio Vivas , Harold Castro

Scientific workflows typically comprise a multitude of different processing steps which often are executed in parallel on different partitions of the input data. These executions, in turn, must be scheduled on the compute nodes of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-18 Jonathan Bader , Fabian Lehmann , Alexander Groth , Lauritz Thamsen , Dominik Scheinert , Jonathan Will , Ulf Leser , Odej Kao

Scientific applications in HPC environment are more com-plex and more data-intensive nowadays. Scientists usually rely on workflow system to manage the complexity: simply define multiple processing steps into a single script and let the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-17 Dong Dai , Robert Ross , Dounia Khaldi , Yonghong Yan , Matthieu Dorier , Neda Tavakoli , Yong Chen

Cloud Computing has emerged as a key technology to deliver and manage computing, platform, and software services over the Internet. Task scheduling algorithms play an important role in the efficiency of cloud computing services as they aim…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-14 Mbarka Soualhia , Foutse Khomh , Sofiene Tahar

Modern GPU datacenters are critical for delivering Deep Learning (DL) models and services in both the research community and industry. When operating a datacenter, optimization of resource scheduling and management can bring significant…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-07 Qinghao Hu , Peng Sun , Shengen Yan , Yonggang Wen , Tianwei Zhang

Dataflow devices represent an avenue towards saving the control and data movement overhead of Load-Store Architectures. Various dataflow accelerators have been proposed, but how to efficiently schedule applications on such devices remains…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-06 Tiziano De Matteis , Lukas Gianinazzi , Johannes de Fine Licht , Torsten Hoefler

Motivation: Traditional computational cluster schedulers are based on user inputs and run time needs request for memory and CPU, not IO. Heavily IO bound task run times, like ones seen in many big data and bioinformatics problems, are…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-27 Christopher Harrison , Christine R. Kirkpatrick , Inês Dutra

Leaking information about the execution behavior of critical real-time tasks may lead to serious consequences, including violations of temporal constraints and even severe failures. We study information leakage for a special class of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-05 Mohammad Fakhruddin Babar , Zain A. H. Hammadeh , Mohammad Hamad , Monowar Hasan

Although High Performance Computing (HPC) users understand basic resource requirements such as the number of CPUs and memory limits, internal infrastructural utilization data is exclusively leveraged by cluster operators, who use it to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-19 Abel Souza , Kristiaan Pelckmans , Johan Tordsson

Accurate prediction of resource consumption and runtime for cloud workflow jobs is critical for scheduling efficiency, yet remains challenging due to the semi-structured nature of job configurations -- comprising shell commands,…

Machine Learning · Computer Science 2026-05-18 Yuxuan Yin , Shengke Zhou , Yunjie Zhang , Ajay Mohindra , Boxun Xu , Peng Li

Scientific applications typically generate large volumes of floating-point data, making lossy compression one of the most effective methods for data reduction, thereby lowering storage requirements and improving performance in large-scale…

Performance · Computer Science 2024-12-11 Youyuan Liu , Taolue Yang , Sian Jin

Memory-to-memory data streaming is essential for modern scientific workflows that require near real-time data analysis, experimental steering, and informed decision-making during experiment execution. It eliminates the latency bottlenecks…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-10 Anjus George , Michael J. Brim , Christopher Zimmer , Tyler J. Skluzacek , A. J. Ruckman , Gustav R. Jansen , Sarp Oral

Task graphs provide a simple way to describe scientific workflows (sets of tasks with dependencies) that can be executed on both HPC clusters and in the cloud. An important aspect of executing such graphs is the used scheduling algorithm.…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-18 Jakub Beránek , Stanislav Böhm , Vojtěch Cima

Co-scheduling of jobs in data-centers is a challenging scenario, where jobs can compete for resources yielding to severe slowdowns or failed executions. Efficient job placement on environments where resources are shared requires awareness…

Machine Learning · Computer Science 2020-07-07 David Buchaca Prats , Joan Marcual , Josep Lluís Berral , David Carrera

Workflow is a common term used to describe a systematic breakdown of tasks that need to be performed to solve a problem. This concept has found best use in scientific and business applications for streamlining and improving the performance…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-08 Samiya Khan , Kashish Ara Shakil , Mansaf Alam

Nowadays, data-centers are largely under-utilized because resource allocation is based on reservation mechanisms which ignore actual resource utilization. Indeed, it is common to reserve resources for peak demand, which may occur only for a…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-03 Francesco Pace , Dimitrios Milios , Damiano Carra , Daniele Venzano , Pietro Michiardi