English
Related papers

Related papers: Job Placement Advisor Based on Turnaround Predicti…

200 papers

Cloud platforms are increasingly being used to run HPC workloads. Major cloud providers offer a wide variety of virtual machine (VM) types, enabling users to find the optimal balance between performance and cost. However, this extensive…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-26 Marco A. S. Netto

The workload prediction and resource allocation significantly play an inevitable role in production of an efficient cloud environment. The proactive estimation of future workload followed by decision of resource allocation have become a…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-30 Deepika Saxena , Ashutosh Kumar Singh

Analyzing large datasets with distributed dataflow systems requires the use of clusters. Public cloud providers offer a large variety and quantity of resources that can be used for such clusters. However, picking the appropriate resources…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-28 Jonathan Will , Jonathan Bader , Lauritz Thamsen

The precise estimation of resource usage is a complex and challenging issue due to the high variability and dimensionality of heterogeneous service types and dynamic workloads. Over the last few years, the prediction of resource usage and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-07 Deepika Saxena , Jitendra Kumar , Ashutosh Kumar Singh , Stefan Schmid

In recent years with the advent of high bandwidth internet access availability, the cloud computing applications have boomed. With more and more applications being run over the cloud and an increase in the overall user base of the different…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-25 Sandeep Kumar Patel , Avtar Singh

This paper presents a systematic review of mapping and scheduling strategies within the High-Performance Computing (HPC) compute continuum, with a particular emphasis on heterogeneous systems. It introduces a prototype workflow to establish…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-19 Aasish Kumar Sharma , Julian Kunkel

Nowadays, data-centers are largely under-utilized because resource allocation is based on reservation mechanisms which ignore actual resource utilization. Indeed, it is common to reserve resources for peak demand, which may occur only for a…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-03 Francesco Pace , Dimitrios Milios , Damiano Carra , Daniele Venzano , Pietro Michiardi

Large batch jobs such as Deep Learning, HPC and Spark require far more computational resources and higher cost than conventional online service. Like the processing of other time series data, these jobs possess a variety of characteristics…

Machine Learning · Computer Science 2020-10-13 Peng Gao

Cloud Computing has emerged as a key technology to deliver and manage computing, platform, and software services over the Internet. Task scheduling algorithms play an important role in the efficiency of cloud computing services as they aim…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-14 Mbarka Soualhia , Foutse Khomh , Sofiene Tahar

High Performance Computing (HPC) clouds are becoming an alternative to on-premise clusters for executing scientific applications and business analytics services. Most research efforts in HPC cloud aim to understand the cost-benefit of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-05 Marco A. S. Netto , Rodrigo N. Calheiros , Eduardo R. Rodrigues , Renato L. F. Cunha , Rajkumar Buyya

New HPC machines are getting close to the exascale. Power consumption for those machines has been increasing, and researchers are studying ways to reduce it. A second trend is HPC machines' growing complexity, with increasing heterogeneous…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-24 Marco D'Amico , Julita Corbalan

Configuring a storage system to better serve an application is a challenging task complicated by a multidimensional, discrete configuration space and the high cost of space exploration (e.g., by running the application with different…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-06-11 Lauro Beltrão Costa , Abmar Barros , Samer Al-Kiswany , Hao Yang , Emalayan Vairavanathan , Matei Ripeanu

High-Performance Computing (HPC) centers and cloud providers support an increasingly diverse set of applications on heterogenous hardware. As Artificial Intelligence (AI) and Machine Learning (ML) workloads have become an increasingly…

In modern computing environments, users may have multiple systems accessible to them such as local clusters, private clouds, or public clouds. This abundance of choices makes it difficult for users to select the system and configuration for…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-05 Amir Nassereldine , Safaa Diab , Mohammed Baydoun , Kenneth Leach , Maxim Alt , Dejan Milojicic , Izzat El Hajj

The use of High Performance Computing (HPC) in commercial and consumer IT applications is becoming popular. They need the ability to gain rapid and scalable access to high-end computing capabilities. Cloud computing promises to deliver such…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-09-08 Saurabh Kumar Garg , Chee Shin Yeo , Arun Anandasivam , Rajkumar Buyya

Many organizations routinely analyze large datasets using systems for distributed data-parallel processing and clusters of commodity resources. Yet, users need to configure adequate resources for their data processing jobs. This requires…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-02 Lauritz Thamsen , Dominik Scheinert , Jonathan Will , Jonathan Bader , Odej Kao

Minimizing job scheduling time is a fundamental issue in data center networks that has been extensively studied in recent years. The incoming jobs require different CPU and memory units, and span different number of time slots. The…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-21 Weijia Chen , Yuedong Xu , Xiaofeng Wu

Large multi-tenant production clusters often have to handle a variety of jobs and applications with a variety of complex resource usage characteristics. It is non-trivial and non-optimal to manually create placement rules for scheduling…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-31 Subrata Mitra , Shanka Subhra Mondal , Nikhil Sheoran , Neeraj Dhake , Ravinder Nehra , Ramanuja Simha

We conducted a systematic survey of emerging quantum-HPC platforms, which integrate quantum computers and High-Performance Computing (HPC) systems through co-location. Currently, it remains unclear whether such platforms provide tangible…

Edge computing has become a very popular service that enables mobile devices to run complex tasks with the help of network-based computing resources. However, edge clouds are often resource-constrained, which makes resource allocation a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-02 Caroline Rublein , Fidan Mehmeti , Mark Mahon , Thomas F. La Porta