English
Related papers

Related papers: Energy Efficient Scheduling of MapReduce Jobs

200 papers

Imprecise computations provide an avenue for scheduling algorithms developed for energy-constrained computing devices by trading off output quality with the utilization of system resources. This work proposes a method for scheduling task…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-14 Amirhossein Esmaili , Mahdi Nazemi , Massoud Pedram

A multiple server setting is considered, where each server has tunable speed, and increasing the speed incurs an energy cost. Jobs arrive to a single queue, and each job has two types of sub-tasks, map and reduce, and a {\bf precedence}…

Data Structures and Algorithms · Computer Science 2021-05-20 Rahul Vaze , Jayakrishnan Nair

The ever increasing adoption of mobile devices with limited energy storage capacity, on the one hand, and more awareness of the environmental impact of massive data centres and server pools, on the other hand, have both led to an increased…

Discrete Mathematics · Computer Science 2018-06-14 Rodrigo A. Carrasco , Garud Iyengar , Cliff Stein

The manpower scheduling problem is a critical research field in the resource management area. Based on the existing studies on scheduling problem solutions, this paper transforms the manpower scheduling problem into a combinational…

Artificial Intelligence · Computer Science 2021-05-12 Lingyu Zhang , Tianyu Liu , Yunhai Wang

We study the problem of scheduling a set of jobs with release dates, deadlines and processing requirements (or works), on parallel speed-scaled processors so as to minimize the total energy consumption. We consider that both preemption and…

Data Structures and Algorithms · Computer Science 2011-07-13 Eric Angel , Evripidis Bampis , Fadi Kacem , Dimitrios Letsios

In this paper, we study the MapReduce framework from an algorithmic standpoint and demonstrate the usefulness of our approach by designing and analyzing efficient MapReduce algorithms for fundamental sorting, searching, and simulation…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-01-11 Michael T. Goodrich , Nodari Sitchinava , Qin Zhang

In this paper we initiate the study of minimizing power consumption in the broadcast scheduling model. In this setting there is a wireless transmitter. Over time requests arrive at the transmitter for pages of information. Multiple requests…

Data Structures and Algorithms · Computer Science 2010-07-23 Benjamin Moseley

We consider the problem of scheduling a set of $n$ tasks on $m$ processors under precedence, communication, and global system energy constraints to minimize makespan. We extend existing scheduling models to account for energy usage and give…

Data Structures and Algorithms · Computer Science 2011-05-27 David Felber , Adam Meyerson

The power consumption of enormous network devices in data centers has emerged as a big concern to data center operators. Despite many traffic-engineering-based solutions, very little attention has been paid on performance-guaranteed energy…

Networking and Internet Architecture · Computer Science 2014-05-30 Lin Wang , Fa Zhang , Kai Zheng , Athanasios V. Vasilakos , Shaolei Ren , Zhiyong Liu

Particle filtering is a numerical Bayesian technique that has great potential for solving sequential estimation problems involving non-linear and non-Gaussian models. Since the estimation accuracy achieved by particle filters improves as…

Computation · Statistics 2017-11-22 Jeyarajan Thiyagalingam , Lykourgos Kekempanos , Simon Maskell

In this thesis report, we have a survey on state-of-the-art methods for modelling resource utilization of MapReduce applications regard to its configuration parameters. After implementation of one of the algorithms in literature, we tried…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-03-21 Hamidreza Barati , Nasrin Jaberi

We propose three novel mathematical optimization formulations that solve the same two-type heterogeneous multiprocessor scheduling problem for a real-time taskset with hard constraints. Our formulations are based on a global scheduling…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-10-13 Mason Thammawichai , Eric C. Kerrigan

Since its introduction in 2004, the MapReduce framework has become one of the standard approaches in massive distributed and parallel computation. In contrast to its intensive use in practise, theoretical footing is still limited and only…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-12-19 Gero Greiner , Riko Jacob

A MapReduce algorithm can be described by a mapping schema, which assigns inputs to a set of reducers, such that for each required output there exists a reducer that receives all the inputs that participate in the computation of this…

Databases · Computer Science 2015-01-28 Foto Afrati , Shlomi Dolev , Ephraim Korach , Shantanu Sharma , Jeffrey D. Ullman

A MapReduce algorithm can be described by a mapping schema, which assigns inputs to a set of reducers, such that for each required output there exists a reducer that receives all the inputs that participate in the computation of this…

Databases · Computer Science 2016-10-21 Foto Afrati , Shlomi Dolev , Ephraim Korach , Shantanu Sharma , Jeffrey D. Ullman

The aim of power management policies is to reduce the amount of energy consumed by computer systems while maintaining satisfactory level of performance. One common method for saving energy is to simply suspend the system during the idle…

Data Structures and Algorithms · Computer Science 2010-09-06 Philippe Baptiste , Marek Chrobak , Christoph Durr

We present a number of novel algorithms, based on mathematical optimization formulations, in order to solve a homogeneous multiprocessor scheduling problem, while minimizing the total energy consumption. In particular, for a system with a…

Operating Systems · Computer Science 2015-11-13 Mason Thammawichai , Eric C. Kerrigan

An important goal of modern scheduling systems is to efficiently manage power usage. In energy-efficient scheduling, the operating system controls the speed at which a machine is processing jobs with the dual objective of minimizing energy…

Data Structures and Algorithms · Computer Science 2024-02-28 Eric Balkanski , Noemie Perivier , Clifford Stein , Hao-Ting Wei

In this paper we address the speed planning problem for a vehicle over an assigned path with the aim of minimizing a weighted sum of travel time and energy consumption under suitable constraints (maximum allowed speed, maximum traction or…

Optimization and Control · Mathematics 2025-07-22 Stefano Ardizzoni , Luca Consolini , Mattia Laurini , Marco Locatelli

MapReduce is a widely used framework for distributed computing. Data shuffling between the Map phase and Reduce phase of a job involves a large amount of data transfer across servers, which in turn accounts for increase in job completion…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-06 Sneh Gupta , V. Lalitha