中文
相关论文

相关论文: Hadoop Scheduling Base On Data Locality

200 篇论文

Multi-server jobs are imperative in modern computing clusters. A multi-server job has multiple task components and each of the task components is responsible for processing a specific size of workloads. Efficient online workload dispatching…

分布式、并行与集群计算 · 计算机科学 2022-06-14 Hailiang Zhao , Shuiguang Deng , Jianwei Yin , Schahram Dustdar , Albert Y. Zomaya

Task graphs provide a simple way to describe scientific workflows (sets of tasks with dependencies) that can be executed on both HPC clusters and in the cloud. An important aspect of executing such graphs is the used scheduling algorithm.…

分布式、并行与集群计算 · 计算机科学 2022-04-18 Jakub Beránek , Stanislav Böhm , Vojtěch Cima

We first consider the static problem of allocating resources to ( i.e. , scheduling) multiple distributed application framework s, possibly with different priorities and server preferences , in a private cloud with heterogeneous servers.…

Modern day continued demand for resource hungry services and applications in IT sector has led to development of Cloud computing. Cloud computing environment involves high cost infrastructure on one hand and need high scale computational…

分布式、并行与集群计算 · 计算机科学 2014-03-18 Mayanka Katyal , Atul Mishra

Real-time systems are intrinsic components of many pivotal applications, such as self-driving vehicles, aerospace and defense systems. The trend in these applications is to incorporate multiple tasks onto fewer, more powerful hardware…

操作系统 · 计算机科学 2024-10-03 V. Gabriel Moyano , Zain A. H. Hammadeh , Selma Saidi , Daniel Lüdtke

Cloud computing provides engineers or scientists a place to run complex computing tasks. Finding a workflow's deployment configuration in a cloud environment is not easy. Traditional workflow scheduling algorithms were based on some…

软件工程 · 计算机科学 2018-04-24 Jianfeng Chen , Tim Menzies

Our focus is on projects, i.e., business processes, which are emerging as the economic drivers of our times. Differently from day-to-day operational processes that do not require detailed planning, a project requires planning and…

人工智能 · 计算机科学 2024-04-09 Izack Cohen

We consider a computation offloading system where jobs are processed sequentially at a local server followed by a higher-capacity cloud server. The system offers two service modes, differing in how the processing is split between the…

系统与控制 · 电气工程与系统科学 2025-12-17 Darin Jeff , Eytan Modiano

The evolution in the design of modern parallel platforms leads to revisit the scheduling jobs on distributed heterogeneous resources. The goal of this survey is to present the main existing algorithms, to classify them based on their…

分布式、并行与集群计算 · 计算机科学 2020-07-31 Olivier Beaumont , Louis-claude Canon , Lionel Eyraud-Dubois , Giorgio Lucarelli , Loris Marchal , Clément Mommessin , Bertrand Simon , Denis Trystram

Ridesourcing platforms recently introduced the ``schedule a ride'' service where passengers may reserve (book-ahead) a ride in advance of their trip. Reservations give platforms precise information that describes the start time and location…

系统与控制 · 电气工程与系统科学 2021-06-17 Cesar N. Yahia , Gustavo de Veciana , Stephen D. Boyles , Jean Abou Rahal , Michael Stecklein

The rapid development of cloud-native architecture has promoted the widespread application of container technology, but the optimization problems in container scheduling and resource management still face many challenges. This paper…

分布式、并行与集群计算 · 计算机科学 2024-12-24 Xiaoye Wang

In data-intensive applications data transfer is a primary cause of job execution delay. Data access time depends on bandwidth. The major bottleneck to supporting fast data access in Grids is the high latencies of Wide Area Networks and…

分布式、并行与集群计算 · 计算机科学 2010-10-05 Somayeh Abdi , Hossein Pedram , Somayeh Mohamadi

Modern business models have enabled service systems to leverage a large pool of casual employees with flexible hours, paid based on piece rates, to fulfill on-demand work. These systems have been successfully implemented in sectors such as…

最优化与控制 · 数学 2025-04-09 Prakash Gawas , Antoine Legrain , Louis-Martin Rousseau

Modern platforms are using accelerators in conjunction with standard processing units in order to reduce the running time of specific operations, such as matrix operations, and improve their performance. Scheduling on such hybrid platforms…

数据结构与算法 · 计算机科学 2020-02-11 Vincent Fagnon , Imed Kacem , Giorgio Lucarelli , Bertrand Simon

In a multihop wireless network, it is crucial but challenging to schedule transmissions in an efficient and fair manner. In this paper, a novel distributed node scheduling algorithm, called Local Voting, is proposed. This algorithm tries to…

网络与互联网体系结构 · 计算机科学 2017-09-18 Dimitrios J. Vergados , Natalia Amelina , Yuming Jiang , Katina Kralevska , Oleg Granichin

Workload consolidation, sharing physical resources among multiple workloads, is a promising technique to save cost and energy in cluster computing systems. This paper highlights a few challenges of workload consolidation for Hadoop as one…

分布式、并行与集群计算 · 计算机科学 2016-11-15 Reza Moraveji , Javid Taheri , MohammadReza HosseinyFarahabady , Nikzad Babaii Rizvandi , Albert Y. Zomaya

Job schedulers are a key component of scalable computing infrastructures. They orchestrate all of the work executed on the computing infrastructure and directly impact the effectiveness of the system. Recently, job workloads have…

This work studies fixed priority (FP) scheduling of real-time jobs with end-to-end deadlines in a distributed system. Specifically, given a multi-stage pipeline with multiple heterogeneous resources of the same type at each stage, the…

分布式、并行与集群计算 · 计算机科学 2024-03-21 Niraj Kumar , Chuanchao Gao , Arvind Easwaran

An optimal solution to the problem of scheduling real-time tasks on a set of identical processors is derived. The described approach is based on solving an equivalent uniprocessor real-time scheduling problem. Although there are other…

操作系统 · 计算机科学 2011-04-19 Paul Regnier , George Lima , Ernesto Massa

High Performance Computing (HPC) systems are used across a wide range of disciplines for both large and complex computations. HPC systems often receive many thousands of computational tasks at a time, colloquially referred to as jobs. These…

分布式、并行与集群计算 · 计算机科学 2024-04-16 Elliot Kolker-Hicks , Di Zhang , Dong Dai