中文
相关论文

相关论文: Predicting batch queue job wait times for informed…

200 篇论文

Distributed cloud environments hosting data-intensive applications often experience slowdowns due to network congestion, asymmetric bandwidth, and inter-node data shuffling. These factors are typically not captured by traditional host-level…

分布式、并行与集群计算 · 计算机科学 2025-11-21 Sankalpa Timilsina , Susmit Shannigrahi

Job submissions of parallel applications to production supercomputer systems will have to be carefully tuned in terms of the job submission parameters to obtain minimum response times. In this work, we have developed an end-to-end resource…

分布式、并行与集群计算 · 计算机科学 2020-08-20 Swetha Hariharan , Prakash Murali , Abhishek Pasari , Sathish Vadhiyar

Minimizing waiting time for tasks waiting in the queue for execution is one of the important scheduling cri-teria which took a wide area in scheduling preemptive tasks. In this paper we present Changeable Time Quan-tum (CTQ) approach…

分布式、并行与集群计算 · 计算机科学 2010-03-30 Samih Mohemmed Mostafa

Accurately estimating workload runtime is a longstanding goal in computer systems, and plays a key role in efficient resource provisioning, latency minimization, and various other system management tasks. Runtime prediction is particularly…

机器学习 · 计算机科学 2025-03-11 Tianshu Huang , Arjun Ramesh , Emily Ruppel , Nuno Pereira , Anthony Rowe , Carlee Joe-Wong

Job schedulers are a key component of scalable computing infrastructures. They orchestrate all of the work executed on the computing infrastructure and directly impact the effectiveness of the system. Recently, job workloads have…

Retailers use a variety of mechanisms to enable sales and delivery. A relatively new offering by companies is curbside pickup where customers purchase goods online, schedule a pickup time, and come to a pickup facility to receive their…

最优化与控制 · 数学 2020-05-27 Bahar Çavdar , Tuğçe Işık

As resource estimation for jobs is difficult, users often overestimate their requirements. Both commercial clouds and academic campus clusters suffer from low resource utilization and long wait times as the resource estimates for jobs,…

分布式、并行与集群计算 · 计算机科学 2019-05-27 Gourav Rattihalli , Pankaj Saha , Madhusudhan Govindaraju , Devesh Tiwari

Energy consumption is one of the most critical concerns in designing computing devices, ranging from portable embedded systems to computer cluster systems. Furthermore, in the past decade, cluster systems have increasingly risen as popular…

分布式、并行与集群计算 · 计算机科学 2019-12-12 Amirhossein Esmaili , Massoud Pedram

Scientific workflow management systems support large-scale data analysis on cluster infrastructures. For this, they interact with resource managers which schedule workflow tasks onto cluster nodes. In addition to workflow task descriptions,…

分布式、并行与集群计算 · 计算机科学 2025-04-30 Jonathan Bader , Kathleen West , Soeren Becker , Svetlana Kulagina , Fabian Lehmann , Lauritz Thamsen , Henning Meyerhenke , Odej Kao

The ability to accurately estimate job runtime properties allows a scheduler to effectively schedule jobs. State-of-the-art online cluster job schedulers use history-based learning, which uses past job execution information to estimate the…

分布式、并行与集群计算 · 计算机科学 2021-11-17 Akshay Jajoo , Y. Charlie Hu , Xiaojun Lin , Nan Deng

Today high-performance computing (HPC) platforms are still dominated by batch jobs. Accordingly, effective batch job scheduling is crucial to obtain high system efficiency. Existing HPC batch job schedulers typically leverage heuristic…

分布式、并行与集群计算 · 计算机科学 2020-09-03 Di Zhang , Dong Dai , Youbiao He , Forrest Sheng Bao , Bing Xie

New HPC machines are getting close to the exascale. Power consumption for those machines has been increasing, and researchers are studying ways to reduce it. A second trend is HPC machines' growing complexity, with increasing heterogeneous…

分布式、并行与集群计算 · 计算机科学 2021-06-24 Marco D'Amico , Julita Corbalan

Many algorithms in workflow scheduling and resource provisioning rely on the performance estimation of tasks to produce a scheduling plan. A profiler that is capable of modeling the execution of tasks and predicting their runtime…

分布式、并行与集群计算 · 计算机科学 2019-03-01 Muhammad H. Hilman , Maria A. Rodriguez , Rajkumar Buyya

Modern High Performance Computing (HPC) systems are complex machines, with major impacts on economy and society. Along with their computational capability, their energy consumption is also steadily raising, representing a critical issue…

分布式、并行与集群计算 · 计算机科学 2023-08-31 Francesco Antici , Andrea Borghesi , Zeynep Kiziltan

As the popularity of quantum computing continues to grow, efficient quantum machine access over the cloud is critical to both academic and industry researchers across the globe. And as cloud quantum computing demands increase exponentially,…

量子物理 · 物理学 2022-03-28 Gokul Subramanian Ravi , Kaitlin N. Smith , Prakash Murali , Frederic T. Chong

The ever-growing processing power of supercomputers in recent decades enables us to explore increasing complex scientific problems. Effective scheduling these jobs is crucial for individual job performance and system efficiency. The…

分布式、并行与集群计算 · 计算机科学 2021-09-21 Yuping Fan

Accommodating long-running deep learning (DL) training and inference jobs is challenging on GPU clusters that use traditional batch schedulers, such as Slurm. Given fixed wall clock time limits, DL researchers usually need to run a sequence…

分布式、并行与集群计算 · 计算机科学 2023-06-27 Qiyang Ding , Pengfei Zheng , Shreyas Kudari , Shivaram Venkataraman , Zhao Zhang

Effective patient queue management to minimize patient wait delays and patient overcrowding is one of the major challenges faced by hospitals. Unnecessary and annoying waits for long periods result in substantial human resource and time…

计算机与社会 · 计算机科学 2019-11-26 Jianguo Chen , Kenli Li , Zhuo Tang , Kashif Bilal , Keqin Li

Separating the short jobs from the long is a known technique to improve scheduling performance. In this paper we describe a method we developed for accurately predicting the runtimes classes of the jobs to enable this separation. Our method…

机器学习 · 统计学 2016-05-24 Anat Reiner-Benaim , Anna Grabarnick , Edi Shmueli

Using high-quality nation-wide social security data combined with machine learning tools, we develop predictive models of income support receipt intensities for any payment enrolee in the Australian social security system between 2014 and…

综合经济学 · 经济学 2021-05-14 Dario Sansone , Anna Zhu