English
Related papers

Related papers: Task Runtime Prediction in Scientific Workflows Us…

200 papers

Analytical models developed in offline settings with pre-prepared data are typically used to predict students' performance. However, when data are available over time, this learning method is not suitable anymore. Online learning is…

Computers and Society · Computer Science 2024-07-16 Chahrazed Labba , Anne Boyer

Scientific workflows are designed as directed acyclic graphs (DAGs) and consist of multiple dependent task definitions. They are executed over a large amount of data, often resulting in thousands of tasks with heterogeneous compute…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-19 Jonathan Bader , Nicolas Zunker , Soeren Becker , Odej Kao

Efficient resource utilization and perfect user experience usually conflict with each other in cloud computing platforms. Great efforts have been invested in increasing resource utilization but trying not to affect users' experience for…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-04 Hang Dong , Liwen Zhu , Zhao Shan , Bo Qiao , Fangkai Yang , Si Qin , Chuan Luo , Qingwei Lin , Yuwen Yang , Gurpreet Virdi , Saravan Rajmohan , Dongmei Zhang , Thomas Moscibroda

Scientific workflows typically comprise a multitude of different processing steps which often are executed in parallel on different partitions of the input data. These executions, in turn, must be scheduled on the compute nodes of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-18 Jonathan Bader , Fabian Lehmann , Alexander Groth , Lauritz Thamsen , Dominik Scheinert , Jonathan Will , Ulf Leser , Odej Kao

Increased adoption of scientific workflows in the community has urged for the development of multi-tenant platforms that provide these workflow executions as a service. As a result, Workflow-as-a-Service (WaaS) concept has been created by…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-25 Muhammad H. Hilman , Maria A. Rodriguez , Rajkumar Buyya

We present and formalize a general approach for profiling workload by leveraging only a priori available static metadata to supply appropriate resource needs. Understanding the requirements and characteristics of a workload's runtime is…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-30 Andrea Morichetta , Stefan Nastic , Victor Casamayor Pujol , Schahram Dustdar

Host load prediction is essential for dynamic resource scaling and job scheduling in a cloud computing environment. In this context, workload prediction is challenging because of several issues. First, it must be accurate to enable precise…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-27 Amin Setayesh , Hamid Hadian , Radu Prodan

Resource sharing between multiple workloads has become a prominent practice among cloud service providers, motivated by demand for improved resource utilization and reduced cost of ownership. Effective resource sharing, however, remains an…

The aim of this paper is to provide a description of deep-learning-based scheduling approach for academic-purpose high-performance computing systems. The share of academic-purpose distributed computing systems (DCS) reaches 17.4 percents…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-10-08 Andrey Gritsenko

In the recent years, scientific workflows gained more and more popularity. In scientific workflows, tasks are typically treated as black boxes. Dealing with their complex interrelations to identify optimization potentials and bottlenecks is…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-13 Ansgar Lößer , Joel Witzke , Florian Schintke , Björn Scheuermann

Automatic resource scaling is one advantage of Cloud systems. Cloud systems are able to scale the number of physical machines depending on user requests. Therefore, accurate request prediction brings a great improvement in Cloud systems'…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-10 Min Sang Yoon , Ahmed E. Kamal , Zhengyuan Zhu

Workflows are prevalent in today's computing infrastructures. The workflow model support various different domains, from machine learning to finance and from astronomy to chemistry. Different Quality-of-Service (QoS) requirements and other…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-22 Laurens Versluis , Alexandru Iosup

Load forecasting is essential for the efficient, reliable, and cost-effective management of power systems. Load forecasting performance can be improved by learning the similarities among multiple entities (e.g., regions, buildings).…

Machine Learning · Statistics 2025-02-07 Onintze Zaballa , Verónica Álvarez , Santiago Mazuelas

Predictive autoscaling (autoscaling with workload forecasting) is an important mechanism that supports autonomous adjustment of computing resources in accordance with fluctuating workload demands in the Cloud. In recent works, Reinforcement…

Predictive business process monitoring aims at providing predictions about running instances by analyzing logs of completed cases in a business process. Recently, a lot of research focuses on increasing productivity and efficiency in a…

Artificial Intelligence · Computer Science 2021-09-23 Gyunam Park , Minseok Song

Progress in science is deeply bound to the effective use of high-performance computing infrastructures and to the efficient extraction of knowledge from vast amounts of data. Such data comes from different sources that follow a cycle…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-15 Rosa M Badia , Jorge Ejarque , Francesc Lordan , Daniele Lezzi , Javier Conejero , Javier Álvarez Cid-Fuentes , Yolanda Becerra , Anna Queralt

Competitive analysis of online algorithms has commonly been applied to understand the behaviour of real-time systems during overload conditions. While competitive analysis provides insight into the behaviour of certain algorithms, it is…

Performance · Computer Science 2018-06-06 Sathish Gopalakrishnan

As the amount of available data continues to grow in fields as diverse as bioinformatics, physics, and remote sensing, the importance of scientific workflows in the design and implementation of reproducible data analysis pipelines…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-11 Jonathan Bader , Fabian Skalski , Fabian Lehmann , Dominik Scheinert , Jonathan Will , Lauritz Thamsen , Odej Kao

Given the rapid rise in energy demand by data centers and computing systems in general, it is fundamental to incorporate energy considerations when designing (scheduling) algorithms. Machine learning can be a useful approach in practice by…

Data Structures and Algorithms · Computer Science 2021-12-07 Antonios Antoniadis , Peyman Jabbarzade Ganje , Golnoosh Shahkarami

Dynamic nature of the cloud environment has made distributed resource management process a challenge for cloud service providers. The importance of maintaining the quality of service in accordance with customer expectations as well as the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-08 Sara Kardani-Moghaddam , Rajkumar Buyya , Kotagiri Ramamohanarao