中文
相关论文

相关论文: I/O Burst Prediction for HPC Clusters using Darsha…

200 篇论文

Predicting future resource demand in Cloud Computing is essential for optimizing the trade-off between serving customers' requests efficiently and minimizing the provisioning cost. Modelling prediction uncertainty is also desirable to…

分布式、并行与集群计算 · 计算机科学 2023-11-14 Andrea Rossi , Andrea Visentin , Diego Carraro , Steven Prestwich , Kenneth N. Brown

The front end bottleneck in datacenter workloads has come under increased scrutiny, with the growing code footprint, involvement of numerous libraries and OS services, and the unpredictability in the instruction stream. Our examination of…

硬件体系结构 · 计算机科学 2022-11-22 Yunjin Wang , Chia-Hao Chang , Anand Sivasubramaniam , Niranjan Soundararajan

With the increasing prevalence of scalable file systems in the context of High Performance Computing (HPC), the importance of accurate anomaly detection on runtime logs is increasing. But as it currently stands, many state-of-the-art…

分布式、并行与集群计算 · 计算机科学 2023-01-20 Chris Egersdoerfer , Dong Dai , Di Zhang

The performance of data intensive applications is often dominated by their input/output (I/O) operations but the I/O stack of systems is complex and severely depends on system specific settings and hardware components. This situation makes…

性能 · 计算机科学 2023-06-12 Masoud Gholami , Florian Schintke

Accurately forecasting flight departure delays is essential for improving operational efficiency and mitigating the cascading disruptions that propagate through tightly coupled aircraft rotations. Traditional machine learning approaches…

系统与控制 · 电气工程与系统科学 2025-12-10 Jianyang Zhou

High-performance computing (HPC) requires resilience techniques such as checkpointing in order to tolerate failures in supercomputers. As the number of nodes and memory in supercomputers keeps on increasing, the size of checkpoint data also…

分布式、并行与集群计算 · 计算机科学 2019-06-13 Kai Keller , Leonardo Bautista Gomez

In this paper, we introduce the first machine learning framework for predicting optimal processing times in Single-Level Tree Network (SLTN) architectures for the Divisible Load Theory (DLT) paradigm. Using a feedforward neural network(FNN)…

机器学习 · 计算机科学 2026-05-25 Bharadwaj Veeravalli

Incast traffic in data centers can lead to severe performance degradation, such as packet loss and increased latency. Effectively addressing incast requires prompt and accurate detection. Existing solutions, including MA-ECN, BurstRadar and…

网络与互联网体系结构 · 计算机科学 2025-11-06 Yiming Zheng , Haoran Qi , Lirui Yu , Zhan Shu , Qing Zhao

A heterogeneous architecture composed by a host and an accelerator must frequently deal with situations where several independent tasks are available to be offloaded onto the accelerator. These tasks can be generated by concurrent…

分布式、并行与集群计算 · 计算机科学 2018-07-03 A. J. Lázaro-Muñoz , J. M. González-Linares , J. Gómez-Luna , N. Guil

Many algorithms in workflow scheduling and resource provisioning rely on the performance estimation of tasks to produce a scheduling plan. A profiler that is capable of modeling the execution of tasks and predicting their runtime…

分布式、并行与集群计算 · 计算机科学 2019-03-01 Muhammad H. Hilman , Maria A. Rodriguez , Rajkumar Buyya

The ability to accurately estimate job runtime properties allows a scheduler to effectively schedule jobs. State-of-the-art online cluster job schedulers use history-based learning, which uses past job execution information to estimate the…

分布式、并行与集群计算 · 计算机科学 2021-11-17 Akshay Jajoo , Y. Charlie Hu , Xiaojun Lin , Nan Deng

Effective machine-aided diagnosis and repair of configuration errors continues to elude computer systems designers. Most of the literature targets errors that can be attributed to a single erroneous configuration setting. However, a recent…

软件工程 · 计算机科学 2017-11-15 Zhen Huang , David Lie

Task parallelism research has traditionally focused on optimizing computation-intensive applications. Due to the proliferation of commodity parallel processors, there has been recent interest in supporting interactive applications. Such…

分布式、并行与集群计算 · 计算机科学 2019-06-20 Kyle Singer , Kunal Agrawal , I-Ting Angelina Lee

This paper presents scheduling algorithms for procrastinators, where the speed that a procrastinator executes a job increases as the due date approaches. We give optimal off-line scheduling policies for linearly increasing speed functions.…

数据结构与算法 · 计算机科学 2011-01-05 Michael A. Bender , Raphael Clifford , Kostas Tsichlas

Nowadays, improving the energy efficiency of high-performance computing (HPC) systems is one of the main drivers in scientific and technological research. As large-scale HPC systems require some fault-tolerant method, the opportunities to…

分布式、并行与集群计算 · 计算机科学 2023-11-15 Marina Moran , Javier Balladini , Dolores Rexachs , Enzo Rucci

Cloud Computing has emerged as a key technology to deliver and manage computing, platform, and software services over the Internet. Task scheduling algorithms play an important role in the efficiency of cloud computing services as they aim…

分布式、并行与集群计算 · 计算机科学 2015-07-14 Mbarka Soualhia , Foutse Khomh , Sofiene Tahar

High-performance computing (HPC) clusters are widely used in-house at scientific and academic research institutions. For some users, the transition from running their analyses on a single workstation to running them on a complex,…

分布式、并行与集群计算 · 计算机科学 2021-09-01 Jamie J. Alnasir

In the most popular distributed stream processing frameworks (DSPFs), programs are modeled as a directed acyclic graph. This model allows a DSPF to benefit from the parallelism power of distributed clusters. However, choosing the proper…

分布式、并行与集群计算 · 计算机科学 2023-11-03 Hamid Nasiri , Saeed Nasehi , Arman Divband , Maziar Goudarzi

We consider a parallel system of $m$ identical machines prone to unpredictable crashes and restarts, trying to cope with the continuous arrival of tasks to be executed. Tasks have different computational requirements (i.e., processing time…

分布式、并行与集群计算 · 计算机科学 2016-03-21 Elli Zavou , Antonio Fernández Anta

This study presents a machine learning-assisted approach to optimize task scheduling in cluster systems, focusing on node-affinity constraints. Traditional schedulers like Kubernetes struggle with real-time adaptability, whereas the…

分布式、并行与集群计算 · 计算机科学 2025-09-30 Leszek Sliwko , Jolanta Mizera-Pietraszko