中文
相关论文

相关论文: Failure Analysis of Hadoop Schedulers using an Int…

200 篇论文

Cloud computing is an established technology allowing users to share resources on a large scale, never before seen in IT history. A cloud system connects multiple individual servers in order to process related tasks in several environments…

分布式、并行与集群计算 · 计算机科学 2025-09-30 Leszek Sliwko

In this paper we describe HeSP, a complete simulation framework to study a general task scheduling-partitioning problem on heterogeneous architectures, which treats recursive task partitioning and scheduling decisions on equal footing.…

分布式、并行与集群计算 · 计算机科学 2016-02-18 Anton Rey , Francisco D. Igual , Manuel Prieto-Matías

As the Moore's scaling era comes to an end, application specific hardware accelerators appear as an attractive way to improve the performance and power efficiency of our computing systems. A massively heterogeneous system with a large…

操作系统 · 计算机科学 2019-07-02 Kartik Hegde , Abhishek Srivastava , Rohit Agrawal

We study efficiency in a proof-of-work blockchain with non-zero latencies, focusing in particular on the (inequality in) individual miners' efficiencies. Prior work attributed differences in miners' efficiencies mostly to attacks, but we…

密码学与安全 · 计算机科学 2021-06-08 Mohamed Alzayat , Johnnatan Messias , Balakrishnan Chandrasekaran , Krishna P. Gummadi , Patrick Loiseau

Serverless computing has revolutionized cloud computing by offering users an efficient, cost-effective way to develop and deploy applications without managing infrastructure details. However, serverless cloud users remain vulnerable to…

密码学与安全 · 计算机科学 2026-01-15 Wei Shao , Najmeh Nazari , Behnam Omidi , Setareh Rafatirad , Khaled N. Khasawneh , Houman Homayoun , Chongzhou Fang

Clusters, grids, and peer-to-peer (P2P) networks have emerged as popular paradigms for next generation parallel and distributed computing. The management of resources and scheduling of applications in such large-scale distributed systems is…

分布式、并行与集群计算 · 计算机科学 2007-05-23 Rajkumar Buyya , Manzur Murshed

In recent years, much research has focused on how to optimize Hadoop jobs. Their approaches are diverse, ranging from improving HDFS and Hadoop job scheduler to optimizing parameters in Hadoop configurations. Despite their success in…

分布式、并行与集群计算 · 计算机科学 2013-07-12 Woo-Cheol Kim , Changryong Baek , Dongwon Lee

Shared resource interference is observed by applications as dynamic performance asymmetry. Prior art has developed approaches to reduce the impact of performance asymmetry mainly at the operating system and architectural levels. In this…

分布式、并行与集群计算 · 计算机科学 2020-09-24 Jing Chen , Pirah Noor Soomro , Mustafa Abduljabbar , Madhavan Manivannan , Miquel Pericas

Job shop scheduling problems address the routing and sequencing of tasks in a job shop setting. Despite significant interest from operations research and machine learning communities over the years, a comprehensive platform for testing and…

人工智能 · 计算机科学 2025-03-18 Robbert Reijnen , Igor G. Smit , Hongxiang Zhang , Yaoxin Wu , Zaharah Bukhsh , Yingqian Zhang

Cloud computing recently developed into a viable alternative to on-premises systems for executing high-performance computing (HPC) applications. With the emergence of new vendors and hardware options, there is now a growing need to…

分布式、并行与集群计算 · 计算机科学 2018-12-14 Mohammad Mohammadi , Timur Bazhirov

Many systems and services rely on timing assumptions for performance and availability to perform critical aspects of their operation, such as various timeouts for failure detectors or optimizations to concurrency control mechanisms. Many…

分布式、并行与集群计算 · 计算机科学 2023-09-26 Owen Hilyard , Bocheng Cui , Marielle Webster , Abishek Bangalore Muralikrishna , Aleksey Charapko

Cloud computing technology has been one of the most critical developments in provisioning both hardware and software infrastructure in recent years. Container technology is a new cloud technology that boosts the booting of applications,…

分布式、并行与集群计算 · 计算机科学 2021-04-01 Abdullah Alelyani , Ghulam Mubasher Hassan , Amitava Datta

Burst-Buffering is a promising storage solution that introduces an intermediate highthroughput storage buffer layer to mitigate the I/O bottleneck problem that the current High-Performance Computing (HPC) platforms suffer. The existing…

分布式、并行与集群计算 · 计算机科学 2022-10-17 Benbo Zha , Hong Shen

Traditionally, on-demand, rigid, and malleable applications have been scheduled and executed on separate systems. The ever-growing workload demands and rapidly developing HPC infrastructure trigger the interest of converging these…

分布式、并行与集群计算 · 计算机科学 2021-09-14 Yuping Fan , Paul Rich , William Allcock , Michael Papka , Zhiling Lan

In this paper, a technology for massive data storage and computing named Hadoop is surveyed. Hadoop consists of heterogeneous computing devices like regular PCs abstracting away the details of parallel processing and developers can just…

网络与互联网体系结构 · 计算机科学 2022-03-01 Ameneh Zarei , Shahla Safari , Mahmood Ahmadi , Farhad Mardukhi

Diverse workloads such as interactive supercomputing, big data analysis, and large-scale AI algorithm development, requires a high-performance scheduler. This paper presents a novel node-based scheduling approach for large scale simulations…

As scientific applications extend to the simulation of more and more complex systems, they involve an increasing number of abstraction levels, at each of which errors can emerge and across which they can propagate; tools for correctness…

软件工程 · 计算机科学 2011-01-18 Eloisa Bentivegna , Gabrielle Allen , Oleg Korobkin , Erik Schnetter

Many embedded and real-time systems have a inherent probabilistic behaviour (sensors data, unreliable hardware,...). In that context, it is crucial to evaluate system properties such as "the probability that a particular hardware fails".…

软件工程 · 计算机科学 2015-09-22 Van Chan Ngo , Axel Legay , Jean Quilbeuf

This survey article reviews the challenges associated with deploying and optimizing big data applications and machine learning algorithms in cloud data centers and networks. The MapReduce programming model and its widely-used open-source…

网络与互联网体系结构 · 计算机科学 2019-10-03 Sanaa Hamid Mohamed , Taisir E. H. El-Gorashi , Jaafar M. H. Elmirghani

The evolution of Large Language Model (LLM) serving towards complex, distributed architectures--specifically the P/D-separated, large-scale DP+EP paradigm--introduces distinct scheduling challenges. Unlike traditional deployments where…

分布式、并行与集群计算 · 计算机科学 2025-12-19 Jian Tian , Shuailong Li , Yang Cao , Wenbo Cui , Minghan Zhu , Wenkang Wu , Jianming Zhang , Yanpeng Wang , Zhiwen Xiao , Zhenyu Hou , Dou Shen