English
Related papers

Related papers: Job Placement Advisor Based on Turnaround Predicti…

200 papers

Today high-performance computing (HPC) platforms are still dominated by batch jobs. Accordingly, effective batch job scheduling is crucial to obtain high system efficiency. Existing HPC batch job schedulers typically leverage heuristic…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-03 Di Zhang , Dong Dai , Youbiao He , Forrest Sheng Bao , Bing Xie

High-Performance Computing (HPC) schedulers must balance user performance with facility-wide resource constraints. The task boils down to selecting the optimal number of nodes for a given job. We present a surrogate-assisted multi-objective…

Machine Learning · Computer Science 2026-01-23 Ashna Nawar Ahmed , Banooqa Banday , Terry Jones , Tanzima Z. Islam

Selecting appropriate computational resources for data processing jobs on large clusters is difficult, even for expert users like data engineers. Inadequate choices can result in vastly increased costs, without significantly improving…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-06 Jonathan Will , Lauritz Thamsen , Jonathan Bader , Dominik Scheinert , Odej Kao

Developing reliable workload predictive models can affect many aspects of clinical decision making procedure. The primary challenge in healthcare systems is handling the demand uncertainty over the time. This issue becomes more critical for…

Computers and Society · Computer Science 2019-01-04 Mohammad Hessam Olya , Dongxiao Zhu , Kai Yang

Virtualization technology has enabled applications to be decoupled from the underlying hardware providing the benefits of portability, better control over execution environment and isolation. It has been widely adopted in scientific grids…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-09-27 Omer Khalid , Ivo Maljevic , Richard Anthony , Miltos Petridis , Kevin Parrot , Markus Schulz

The field of algorithms with predictions incorporates machine learning advice in the design of online algorithms to improve real-world performance. A central consideration is the extent to which predictions can be trusted -- while existing…

Machine Learning · Statistics 2026-03-26 Judy Hanwen Shen , Ellen Vitercik , Anders Wikum

In light of recent work on scheduling with predicted job sizes, we consider the effect of the cost of predictions in queueing systems, removing the assumption in prior research that predictions are external to the system's resources and/or…

Machine Learning · Computer Science 2024-02-07 Rana Shahout , Michael Mitzenmacher

The rapid growth of AI, data-intensive science, and digital twin technologies has driven an unprecedented demand for high-performance computing (HPC) across the research ecosystem. While national laboratories and industrial hyperscalers…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-25 Peng Shu , Junhao Chen , Zhengliang Liu , Huaqin Zhao , Xinliang Li , Tianming Liu

Technological advances in the past decade, hardware and software alike, have made access to high-performance computing (HPC) easier than ever. We review these advances from a statistical computing perspective. Cloud computing makes access…

Computation · Statistics 2021-07-19 Seyoon Ko , Hua Zhou , Jin J. Zhou , Joong-Ho Won

Artificial intelligence (AI) and Machine learning (ML) workloads are an increasingly larger share of the compute workloads in traditional High-Performance Computing (HPC) centers and commercial cloud systems. This has led to changes in…

Motivated by modern parallel computing applications, we consider the problem of scheduling parallel-task jobs with heterogeneous resource requirements in a cluster of machines. Each job consists of a set of tasks that can be processed in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-03 Mehrnoosh Shafiee , Javad Ghaderi

Hybrid quantum-classical applications pose significant resource management challenges due to heterogeneity and dynamism in both infrastructure and workloads. Quantum-HPC environments integrate quantum processing units (QPUs) with diverse…

Quantum Physics · Physics 2026-04-07 Pradeep Mantha , Florian J. Kiwit , Nishant Saurabh , Shantenu Jha , Andre Luckow

Companies are rushing to deliver their services and solutions through the cloud. The scheduling process is very critical in reducing delays. Scheduling also has a role in accessing resources without excessive waiting time. All this in…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-28 M A El-Dosuky , Gamal H Eladl

Cloud computing technology has been one of the most critical developments in provisioning both hardware and software infrastructure in recent years. Container technology is a new cloud technology that boosts the booting of applications,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-01 Abdullah Alelyani , Ghulam Mubasher Hassan , Amitava Datta

Many existing scientific workflows require High Performance Computing environments to produce results in a timely manner. These workflows have several software library components and use different environments, making the deployment and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-26 Liliane Kunstmann , Débora Pina , Daniel de Oliveira , Marta Mattoso

With the rise in data centre virtualization, there are increasing choices as to where to place workloads, be it in web applications, Enterprise IT or in Network Function Virtualisation. Workload placement approaches available today…

Networking and Internet Architecture · Computer Science 2017-05-10 Ruoyang Xiu , John Evans

With the rapid development of virtualization techniques, cloud data centers allow for cost effective, flexible, and customizable deployments of applications on virtualized infrastructure. Virtual machine (VM) placement aims to assign each…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-22 Abdulaziz Alashaikh , Eisa Alanazi , Ala Al-Fuqaha

High-performance computing (HPC) clusters are widely used in-house at scientific and academic research institutions. For some users, the transition from running their analyses on a single workstation to running them on a complex,…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-01 Jamie J. Alnasir

Mobile micro-clouds are promising for enabling performance-critical cloud applications. However, one challenge therein is the dynamics at the network edge. In this paper, we study how to place service instances to cope with these dynamics,…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-09-19 Shiqiang Wang , Rahul Urgaonkar , Ting He , Kevin Chan , Murtaza Zafer , Kin K. Leung

Cloud computing is emerging as an important platform for business, personal and mobile computing applications. In this paper, we study a stochastic model of cloud computing, where jobs arrive according to a stochastic process and request…

Performance · Computer Science 2012-06-07 Siva Theja Maguluri , R Srikant , Lei Ying