中文
相关论文

相关论文: I/O Burst Prediction for HPC Clusters using Darsha…

200 篇论文

Fault tolerance overhead of high performance computing (HPC) applications is becoming critical to the efficient utilization of HPC systems at large scale. HPC applications typically tolerate fail-stop failures by checkpointing. Another…

分布式、并行与集群计算 · 计算机科学 2011-06-22 Erlin Yao , Mingyu Chen , Rui Wang , Wenli Zhang , Guangming Tan

Modern HPC workload managers and their careful tuning contribute to the high utilization of HPC clusters. However, due to inevitable uncertainty it is impossible to completely avoid node idleness. Although such idle slots are usually too…

分布式、并行与集群计算 · 计算机科学 2022-11-03 Bartłomiej Przybylski , Maciej Pawlik , Paweł Żuk , Bartłomiej Łagosz , Maciej Malawski , Krzysztof Rzadca

Automatic resource scaling is one advantage of Cloud systems. Cloud systems are able to scale the number of physical machines depending on user requests. Therefore, accurate request prediction brings a great improvement in Cloud systems'…

分布式、并行与集群计算 · 计算机科学 2015-07-10 Min Sang Yoon , Ahmed E. Kamal , Zhengyuan Zhu

Modern high performance computing (HPC) systems exhibit a rapid growth in size, both "horizontally" in the number of nodes, as well as "vertically" in the number of cores per node. As such, they offer additional levels of hardware…

分布式、并行与集群计算 · 计算机科学 2018-11-06 Ahmed Eleliemy , Ali Mohammed , Florina M. Ciorba

Infrastructure as a service clouds hide the complexity of maintaining the physical infrastructure with a slight disadvantage: they also hide their internal working details. Should users need knowledge about these details e.g., to increase…

分布式、并行与集群计算 · 计算机科学 2018-03-20 Gabor Kecskemeti , Zsolt Nemeth , Attila Kertesz , Rajiv Ranjan

Large batch jobs such as Deep Learning, HPC and Spark require far more computational resources and higher cost than conventional online service. Like the processing of other time series data, these jobs possess a variety of characteristics…

机器学习 · 计算机科学 2020-10-13 Peng Gao

Following the scale-up of new radio (NR) complexity in 5G and beyond, the physical layer's computing load on base stations is increasing under a strictly constrained latency and power budget; base stations must process > 20-Gb/s uplink…

信号处理 · 电气工程与系统科学 2025-08-11 Marco Bertuletti , Yichao Zhang , Alessandro Vanelli-Coralli , Luca Benini

This paper presents SHARP (Supercomputing for High-speed Avoidance and Reactive Planning), a proof-of-concept study demonstrating how high-performance computing (HPC) can enable millisecond-scale responsiveness in robotic control. While…

Real-time and open online course resources of MOOCs have attracted a large number of learners in recent years. However, many new questions were emerging about the high dropout rate of learners. For MOOCs platform, predicting the learning…

计算机与社会 · 计算机科学 2018-08-07 Zhemin Liu , Feng Xiong , Kaifa Zou , Hongzhi Wang

Emerging workloads in high-performance computing (HPC) are embracing significant changes, such as having diverse resource requirements instead of being CPU-centric. This advancement forces cluster schedulers to consider multiple schedulable…

分布式、并行与集群计算 · 计算机科学 2024-04-05 Boyang Li , Yuping Fan , Matthew Dearing , Zhiling Lan , Paul Richy , William Allcocky , Michael Papka

Fast approximations of power flow results are beneficial in power system planning and live operation. In planning, millions of power flow calculations are necessary if multiple years, different control strategies or contingency policies are…

机器学习 · 计算机科学 2020-08-24 Florian Schaefer , Jan-Hendrik Menke , Martin Braun

High-performance computing (HPC) systems are a complex combination of software, processors, memory, networks, and storage systems characterized by frequent disruptive technological advances. Anomalous behavior has to be manually diagnosed…

分布式、并行与集群计算 · 计算机科学 2013-02-19 Charng-Da Lu

The increased use of deep learning (DL) in academia, government and industry has, in turn, led to the popularity of on-premise and cloud-hosted deep learning platforms, whose goals are to enable organizations utilize expensive resources…

分布式、并行与集群计算 · 计算机科学 2020-06-25 Vaibhav Saxena , K. R. Jayaram , Saurav Basu , Yogish Sabharwal , Ashish Verma

Power consumption is a critical consideration in high performance computing systems and it is becoming the limiting factor to build and operate Petascale and Exascale systems. When studying the power consumption of existing systems running…

分布式、并行与集群计算 · 计算机科学 2015-01-27 Radim Vavřík , Antoni Portero , Štěpán Kuchař , Martin Golasowski , Simone Libutti , Giuseppe Massari , William Fornaciari , Vít Vondrák

The ability to understand how a scientific application is executed on a large HPC system is of great importance in allocating resources within the HPC data center. In this paper, we describe how we used system performance data to identify:…

分布式、并行与集群计算 · 计算机科学 2020-09-15 David Brayford , Christoph Bernau , Wolfram Hesse , Carla Guillen

Machine learning interatomic potentials (ML-IAPs) enable quantum-accurate, classical molecular dynamics simulations of large systems, beyond reach of density functional theory (DFT). Yet, their efficiency and ability to predict systems…

材料科学 · 物理学 2023-11-07 Lei Zhang , Gábor Csányi , Erik van der Giessen , Francesco Maresca

We examine the efficiency of clustering a set of points, when the encompassing metric space may be preprocessed in advance. In computational problems of this genre, there is a first stage of preprocessing, whose input is a collection of…

数据结构与算法 · 计算机科学 2012-08-28 Tsvi Kopelowitz , Robert Krauthgamer

Large-scale distributed computing systems often contain thousands of distributed nodes (machines). Monitoring the conditions of these nodes is important for system management purposes, which, however, can be extremely resource demanding as…

分布式、并行与集群计算 · 计算机科学 2019-05-23 Tiffany Tuor , Shiqiang Wang , Kin K. Leung , Bong Jun Ko

Host load prediction is essential for dynamic resource scaling and job scheduling in a cloud computing environment. In this context, workload prediction is challenging because of several issues. First, it must be accurate to enable precise…

分布式、并行与集群计算 · 计算机科学 2023-04-27 Amin Setayesh , Hamid Hadian , Radu Prodan

Speed-robust scheduling is the following two-stage problem of scheduling $n$ jobs on $m$ uniformly related machines. In the first stage, the algorithm receives the value of $m$ and the processing times of $n$ jobs; it has to partition the…

数据结构与算法 · 计算机科学 2024-07-17 Josef Minařík , Jiří Sgall