English
Related papers

Related papers: KS+: Predicting Workflow Task Memory Usage Over Ti…

200 papers

Co-scheduling of jobs in data-centers is a challenging scenario, where jobs can compete for resources yielding to severe slowdowns or failed executions. Efficient job placement on environments where resources are shared requires awareness…

Machine Learning · Computer Science 2020-07-07 David Buchaca Prats , Joan Marcual , Josep Lluís Berral , David Carrera

Many organizations routinely analyze large datasets using systems for distributed data-parallel processing and clusters of commodity resources. Yet, users need to configure adequate resources for their data processing jobs. This requires…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-02 Lauritz Thamsen , Dominik Scheinert , Jonathan Will , Jonathan Bader , Odej Kao

Scientific workflows are critical to scientific data analysis and often involve computationally intensive processing of large datasets on compute clusters. As such, their execution tends to be long-running and resource-intensive, resulting…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-09 Kathleen West , Youssef Moawad , Fabian Lehmann , Vasilis Bountris , Ulf Leser , Yehia Elkhatib , Lauritz Thamsen

Making it intelligent is a promising way in System/OS design. This paper proposes OSML+, a new ML-based resource scheduling mechanism for co-located cloud services. OSML+ intelligently schedules the cache and main memory bandwidth resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-22 Xinglei Dou , Lei Liu , Limin Xiao

Quantum computing resources are increasingly being incorporated into high-performance computing (HPC) environments as co-processors for hybrid workloads. To support this paradigm, quantum devices must be treated as schedulable first-class…

The Cloud Computing paradigm is providing system architects with a new powerful tool for building scalable applications. Clouds allow allocation of resources on a "pay-as-you-go" model, so that additional resources can be requested during…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-03-17 Moreno Marzolla , Raffaela Mirandola

With the increasing and elastic demand for cloud resources, finding an optimal task scheduling mechanism become a challenge for cloud service providers. Due to the time-varying nature of resource demands in length and processing over time…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-14 Seyedakbar Mostafavi , Vesal Hakami

Task graphs provide a simple way to describe scientific workflows (sets of tasks with dependencies) that can be executed on both HPC clusters and in the cloud. An important aspect of executing such graphs is the used scheduling algorithm.…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-18 Jakub Beránek , Stanislav Böhm , Vojtěch Cima

In this work, we aim to solve a practical use-case of unsupervised clustering which has applications in predictive maintenance in the energy operations sector using quantum computers. Using only cloud access to quantum computers, we…

Quantum Physics · Physics 2022-09-13 Stephen DiAdamo , Corey O'Meara , Giorgio Cortiana , Juan Bernabé-Moreno

Computing workflows in heterogeneous multiprocessor systems are frequently modeled as directed acyclic graphs of tasks and data blocks, which represent computational modules and their dependencies in the form of data produced by a task and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-14 Junwen Ding , Liangcai Song , Siyuan Li , Chen Wu , Ronghua He , Zhouxing Su , Zhipeng Lü

As more IoT applications gradually move towards the cloud-edge collaborative mode, the containerized scheduling of workflows extends from the cloud to the edge. However, given the high delay of the communication network, loose coupling of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-03 Chenggang Shan , Runze Gao , Qinghua Han , Zhen Yang , Jinhui Zhang , Yuanqing Xia

In science, problems in many fields can be solved by processing datasets using a series of computationally expensive algorithms, sometimes referred to as workflows. Traditionally, the configurations of these workflows are optimized to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-20 Philipp Thamm , Ulf Leser

Both the training and use of Large Language Models (LLMs) require large amounts of energy. Their increasing popularity, therefore, raises critical concerns regarding the energy efficiency and sustainability of data centers that host them.…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-02 Grant Wilkins , Srinivasan Keshav , Richard Mortier

Increased adoption of scientific workflows in the community has urged for the development of multi-tenant platforms that provide these workflow executions as a service. As a result, Workflow-as-a-Service (WaaS) concept has been created by…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-25 Muhammad H. Hilman , Maria A. Rodriguez , Rajkumar Buyya

Efficient task scheduling is paramount in the Linux kernel, where the Completely Fair Scheduler (CFS) meticulously manages CPU resources to balance high utilization with interactive responsiveness. This research pioneers the use of deep…

Machine Learning · Computer Science 2025-05-22 Sampanna Yashwant Kahu

Industries are considering the adoption of cloud and edge computing for real-time applications due to current improvements in network latencies and the advent of Fog and Edge computing. Current cloud paradigms are not designed for real-time…

Operating Systems · Computer Science 2023-07-04 Isser Kadusale , Gautam Gala , Gerhard Fohler

Memory disaggregation has recently been adopted in data centers to improve resource utilization, motivated by cost and sustainability. Recent studies on large-scale HPC facilities have also highlighted memory underutilization. A promising…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-30 Jacob Wahlgren , Gabin Schieffer , Maya Gokhale , Ivy Peng

Quantum reservoir computing is a class of quantum machine learning algorithms involving a reservoir of an echo state network based on a register of qubits, but the dependence of its memory capacity on the hyperparameters is still rather…

Quantum Physics · Physics 2023-02-24 Riccardo Molteni , Claudio Destri , Enrico Prati

The utilization of cloud environments to deploy scientific workflow applications is an emerging trend in scientific community. In this area, the main issue is the scheduling of workflows, which is known as an NP-complete problem. Apart from…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-17 J. E. Ndamlabin Mboula , V. C. Kamla , M. H. Hilman , C. Tayou Djamegni

This work studies the behavior of state-of-the-art memory controller designs when executing scale-out workloads. It considers memory scheduling techniques, memory page management policies, the number of memory channels, and the address…

Hardware Architecture · Computer Science 2016-12-01 Mostafa Mahmoud , Andreas Moshovos