中文
相关论文

相关论文: Failure Analysis of Hadoop Schedulers using an Int…

200 篇论文

In Real-time system, utilization based schedulability test is a common approach to determine whether or not tasks can be admitted without violating deadline requirements. The exact problem has previously been proven intractable even upon…

软件工程 · 计算机科学 2011-01-11 Jagbeer Singh

Modern High Performance Computing (HPC) systems are complex machines, with major impacts on economy and society. Along with their computational capability, their energy consumption is also steadily raising, representing a critical issue…

分布式、并行与集群计算 · 计算机科学 2023-08-31 Francesco Antici , Andrea Borghesi , Zeynep Kiziltan

While advanced analysis of large dataset is in high demand, data sizes have surpassed capabilities of conventional software and hardware. Hadoop framework distributes large datasets over multiple commodity servers and performs parallel…

分布式、并行与集群计算 · 计算机科学 2015-11-17 Woo-Hyun Lee , Hee-Gook Jun , Hyoung-Joo Kim

As machine learning systems move from computer-science laboratories into the open world, their accountability becomes a high priority problem. Accountability requires deep understanding of system behavior and its failures. Current…

机器学习 · 计算机科学 2018-09-21 Besmira Nushi , Ece Kamar , Eric Horvitz

Cloud platforms have emerged as a prominent environment to execute high performance computing (HPC) applications providing on-demand resources as well as scalability. They usually offer different classes of Virtual Machines (VMs) which…

分布式、并行与集群计算 · 计算机科学 2018-10-25 Luan Teylo , Lúcia Maria de A. Drummond , Luciana Arantes , Pierre Sens

Scheduling deep learning (DL) models to train on powerful clusters with accelerators like GPUs and TPUs, presently falls short, either lacking fine-grained heterogeneity awareness or leaving resources substantially under-utilized. To fill…

分布式、并行与集群计算 · 计算机科学 2026-03-17 Abeda Sultana , Nabin Pakka , Fei Xu , Xu Yuan , Li Chen , Nian-Feng Tzeng

Meeting desired application deadlines in cloud processing systems such as MapReduce is crucial as the nature of cloud applications is becoming increasingly mission-critical and deadline-sensitive. It has been shown that the execution times…

分布式、并行与集群计算 · 计算机科学 2018-04-18 Maotong Xu , Sultan Alamro , Tian Lan , Suresh Subramaniam

We present a framework for scheduling multifunction serverless applications over a hybrid public-private cloud. A set of serverless jobs is input as a batch, and the objective is to schedule function executions over the hybrid platform to…

分布式、并行与集群计算 · 计算机科学 2020-06-09 Anirban Das , Andrew Leaf , Carlos A. Varela , Stacy Patterson

Motivated by cloud computing applications, we study the problem of how to optimally deploy new hardware subject to both power and robustness constraints. To model the situation observed in large-scale data centers, we introduce the Online…

数据结构与算法 · 计算机科学 2022-09-05 Konstantina Mellou , Marco Molinaro , Rudy Zhou

Distributed cloud environments hosting data-intensive applications often experience slowdowns due to network congestion, asymmetric bandwidth, and inter-node data shuffling. These factors are typically not captured by traditional host-level…

分布式、并行与集群计算 · 计算机科学 2025-11-21 Sankalpa Timilsina , Susmit Shannigrahi

Consider a system in which tasks of different execution times arrive continuously and have to be executed by a set of processors that are prone to crashes and restarts. In this paper we model and study the impact of parallelism and failures…

分布式、并行与集群计算 · 计算机科学 2013-06-11 Antonio Fernández Anta , Chryssis Georgiou , Dariusz R. Kowalski , Elli Zavou

Increasing data volumes in scientific experiments necessitate the use of high-performance computing (HPC) resources for data analysis. In many scientific fields, the data generated from scientific instruments and supercomputer simulations…

分布式、并行与集群计算 · 计算机科学 2021-03-25 Sam Nickolay , Eun-Sung Jung , Rajkumar Kettimuthu , Ian Foster

As quantum computing moves from isolated experiments toward integration with large-scale workflows, the integration of quantum devices into HPC systems has gained much interest. Quantum cloud providers expose shared devices through…

量子物理 · 物理学 2026-04-10 Sinan Pehlivanoglu , Ulrik de Muelenaere , Peter Kogge , Amr Sabry

MapReduce framework is the de facto standard in Hadoop. Considering the data locality in data centers, the load balancing problem of map tasks is a special case of affinity scheduling problem. There is a huge body of work on affinity…

分布式、并行与集群计算 · 计算机科学 2017-05-10 Mohammadamir Kavousi

MapReduce has been widely applied in various fields of data and compute intensive applications and also it is important programming model for cloud computing. Hadoop is an open-source implementation of MapReduce which operates on terabytes…

分布式、并行与集群计算 · 计算机科学 2014-12-01 Sayalee Narkhede , Trupti Baraskar , Debajyoti Mukhopadhyay

We consider a parallel system of $m$ identical machines prone to unpredictable crashes and restarts, trying to cope with the continuous arrival of tasks to be executed. Tasks have different computational requirements (i.e., processing time…

分布式、并行与集群计算 · 计算机科学 2016-03-21 Elli Zavou , Antonio Fernández Anta

Cloud Computing is a paradigm of both parallel processing and distributed computing. It offers computing facilities as a utility service in pay as par use manner. Virtualization, self service provisioning, elasticity and pay per use are the…

分布式、并行与集群计算 · 计算机科学 2016-12-20 Syed Arshad Ali , Mansaf Alam

The clustering technique has attracted a lot of attention as a promising strategy for parallel debugging in multi-fault scenarios, this heuristic approach (i.e., failure indexing or fault isolation) enables developers to perform multiple…

软件工程 · 计算机科学 2022-07-20 Yi Song , Xiaoyuan Xie , Quanming Liu , Xihao Zhang , Xi Wu

Performance-, power-, and energy-aware scheduling techniques play an essential role in optimally utilizing processing elements (PEs) of heterogeneous systems. List schedulers, a class of low-complexity static schedulers, have commonly been…

分布式、并行与集群计算 · 计算机科学 2021-12-17 Joshua Mack , Samet E. Arda , Umit Y. Ogras , Ali Akoglu

Spectral clustering and cloud computing is emerging branch of computer science or related discipline. It overcome the shortcomings of some traditional clustering algorithm and guarantee the convergence to the optimal solution, thus have to…

分布式、并行与集群计算 · 计算机科学 2015-06-02 Yajun Cui , Yang Zhao , Kafei Xiao , Chenglong Zhang , Lei Wang