中文
相关论文

相关论文: Energy Efficient Scheduling of MapReduce Jobs

200 篇论文

Existing research on single-machine scheduling is largely focused on exact algorithms, which perform well on typical instances but can significantly deteriorate on certain regions of the problem space. In contrast, data-driven approaches…

机器学习 · 计算机科学 2025-10-08 Nikolai Antonov , Prěmysl Šůcha , Mikoláš Janota , Jan Hůla

A central issue of distributed computing systems is how to optimally allocate computing and storage resources and design data shuffling strategies such that the total execution time for computing and data shuffling is minimized. This is…

信息论 · 计算机科学 2021-02-03 Shu-Jie Cao , Lihui Yi , Haoning Chen , Youlong Wu

We tackle the problem of predicting the performance of MapReduce applications, designing accurate progress indicators that keep programmers informed on the percentage of completed computation time during the execution of a job. Through…

分布式、并行与集群计算 · 计算机科学 2015-04-03 Emilio Coppa , Irene Finocchi

We consider a problem of scheduling rigid parallel jobs on variable speed processors so as to minimize the total energy consumption. Each job is specified by its processing volume and the required number of processors. We propose new…

数据结构与算法 · 计算机科学 2018-11-29 Alexander Kononov , Yulia Kovalenko

We study the early work scheduling problem on identical parallel machines in order to maximize the total early work, i.e., the parts of non-preemptive jobs executed before a common due date. By preprocessing and constructing an auxiliary…

数据结构与算法 · 计算机科学 2020-07-27 Weidong Li

This work explores an extension of machine learning-optimized piecewise polynomial approximation by incorporating energy optimization as an additional objective. Traditional closed-form solutions enable continuity and approximation targets…

机器学习 · 计算机科学 2025-08-08 Hannes Waclawek , Stefan Huber

Motivated by issues of saving energy in data centers we define a collection of new problems referred to as "machine activation" problems. The central framework we introduce considers a collection of $m$ machines (unrelated or related) with…

数据结构与算法 · 计算机科学 2009-12-08 Samir Kuller , Jian Li , Barna Saha

This paper considers scheduling on identical machines. The scheduling objective considered in this paper generalizes most scheduling minimization problems. In the problem, there are $n$ jobs and each job $j$ is associated with a…

数据结构与算法 · 计算机科学 2019-04-23 Benjamin Moseley

Motivated by green manufacturing, this paper investigates a scheduling with rejection problem subject to an energy consumption constraint. Machines are associated with non-uniform energy consumption rates, defined as the energy consumed per…

数据结构与算法 · 计算机科学 2026-01-16 Mingyang Gong , Brendan Mumey

In this paper, we study the following batch scheduling model: find a schedule that minimizes total flow time for $n$ uniform length jobs, with release times and deadlines, where the machine is only actively processing jobs in at most $k$…

数据结构与算法 · 计算机科学 2022-06-06 Sami Davies , Samir Khuller , Shirley Zhang

Faced with continuously increasing scale of data, original back-propagation neural network based machine learning algorithm presents two non-trivial challenges: huge amount of data makes it difficult to maintain both efficiency and…

分布式、并行与集群计算 · 计算机科学 2015-10-12 Kairan Sun , Xu Wei , Gengtao Jia , Risheng Wang , Ruizhi Li

As large-scale data processing workloads continue to grow, their carbon footprint raises concerns. Prior research on carbon-aware schedulers has focused on shifting computation to align with availability of low-carbon energy, but these…

分布式、并行与集群计算 · 计算机科学 2025-02-17 Adam Lechowicz , Rohan Shenoy , Noman Bashir , Mohammad Hajiesmaili , Adam Wierman , Christina Delimitrou

Job scheduling for a MapReduce cluster has been an active research topic in recent years. However, measurement traces from real-world production environment show that the duration of tasks within a job vary widely. The overall elapsed time…

分布式、并行与集群计算 · 计算机科学 2015-01-13 Huanle Xu , Wing Cheong Lau

Budget Minimization is a scheduling problem with precedence constraints, i.e., a scheduling problem on a partially ordered set of jobs $(N, \unlhd)$. A job $j \in N$ is available for scheduling, if all jobs $i \in N$ with $i \unlhd j$ are…

离散数学 · 计算机科学 2019-06-27 Marinus Gottschau , Felix Happach , Marcus Kaiser , Clara Waldmann

Modern embedded computing platforms consist of a high amount of heterogeneous resources, which allows executing multiple applications on a single device. The number of running application on the system varies with time and so does the…

系统与控制 · 电气工程与系统科学 2020-02-19 Robert Khasanov , Jeronimo Castrillon

We introduce a parallel machine scheduling problem in which the processing times of jobs are not given in advance but are determined by a system of linear constraints. The objective is to minimize the makespan, i.e., the maximum job…

数据结构与算法 · 计算机科学 2015-10-30 Kameng Nip , Zhenbo Wang , Zizhuo Wang

In this paper we present efficient algorithmic solutions for several constrained resource allocation, management and discovery problems. We consider new types of resource allocation models and constraints, and we present new geometric…

数据结构与算法 · 计算机科学 2009-06-09 Mugurel Ionut Andreica , Madalina Ecaterina Andreica , Daniel Ardelean

We study the precedence-constrained resource scheduling problem [SICOMP'75]. There are $n$ jobs where each job takes a certain time to finish and has a resource requirement throughout the execution time. There are precedence among the jobs.…

数据结构与算法 · 计算机科学 2025-09-03 Rathish Das , Hao Sun

In this poster, we quantitatively measure the impacts of data movement on performance in MapReduce-based applications when executed on HPC systems. We leverage the PAPI 'powercap' component to identify ideal conditions for execution of our…

分布式、并行与集群计算 · 计算机科学 2019-03-29 Joshua Hoke Davis , Tao Gao , Sunita Chandresekaran , Michela Taufer

The manpower scheduling problem is a kind of critical combinational optimization problem. Researching solutions to scheduling problems can improve the efficiency of companies, hospitals, and other work units. This paper proposes a new model…

机器学习 · 计算机科学 2021-05-11 Tianyu Liu , Lingyu Zhang