English
Related papers

Related papers: Energy Efficient Scheduling of MapReduce Jobs

200 papers

Existing research on single-machine scheduling is largely focused on exact algorithms, which perform well on typical instances but can significantly deteriorate on certain regions of the problem space. In contrast, data-driven approaches…

Machine Learning · Computer Science 2025-10-08 Nikolai Antonov , Prěmysl Šůcha , Mikoláš Janota , Jan Hůla

A central issue of distributed computing systems is how to optimally allocate computing and storage resources and design data shuffling strategies such that the total execution time for computing and data shuffling is minimized. This is…

Information Theory · Computer Science 2021-02-03 Shu-Jie Cao , Lihui Yi , Haoning Chen , Youlong Wu

We tackle the problem of predicting the performance of MapReduce applications, designing accurate progress indicators that keep programmers informed on the percentage of completed computation time during the execution of a job. Through…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-04-03 Emilio Coppa , Irene Finocchi

We consider a problem of scheduling rigid parallel jobs on variable speed processors so as to minimize the total energy consumption. Each job is specified by its processing volume and the required number of processors. We propose new…

Data Structures and Algorithms · Computer Science 2018-11-29 Alexander Kononov , Yulia Kovalenko

We study the early work scheduling problem on identical parallel machines in order to maximize the total early work, i.e., the parts of non-preemptive jobs executed before a common due date. By preprocessing and constructing an auxiliary…

Data Structures and Algorithms · Computer Science 2020-07-27 Weidong Li

This work explores an extension of machine learning-optimized piecewise polynomial approximation by incorporating energy optimization as an additional objective. Traditional closed-form solutions enable continuity and approximation targets…

Machine Learning · Computer Science 2025-08-08 Hannes Waclawek , Stefan Huber

Motivated by issues of saving energy in data centers we define a collection of new problems referred to as "machine activation" problems. The central framework we introduce considers a collection of $m$ machines (unrelated or related) with…

Data Structures and Algorithms · Computer Science 2009-12-08 Samir Kuller , Jian Li , Barna Saha

This paper considers scheduling on identical machines. The scheduling objective considered in this paper generalizes most scheduling minimization problems. In the problem, there are $n$ jobs and each job $j$ is associated with a…

Data Structures and Algorithms · Computer Science 2019-04-23 Benjamin Moseley

Motivated by green manufacturing, this paper investigates a scheduling with rejection problem subject to an energy consumption constraint. Machines are associated with non-uniform energy consumption rates, defined as the energy consumed per…

Data Structures and Algorithms · Computer Science 2026-01-16 Mingyang Gong , Brendan Mumey

In this paper, we study the following batch scheduling model: find a schedule that minimizes total flow time for $n$ uniform length jobs, with release times and deadlines, where the machine is only actively processing jobs in at most $k$…

Data Structures and Algorithms · Computer Science 2022-06-06 Sami Davies , Samir Khuller , Shirley Zhang

Faced with continuously increasing scale of data, original back-propagation neural network based machine learning algorithm presents two non-trivial challenges: huge amount of data makes it difficult to maintain both efficiency and…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-10-12 Kairan Sun , Xu Wei , Gengtao Jia , Risheng Wang , Ruizhi Li

As large-scale data processing workloads continue to grow, their carbon footprint raises concerns. Prior research on carbon-aware schedulers has focused on shifting computation to align with availability of low-carbon energy, but these…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-17 Adam Lechowicz , Rohan Shenoy , Noman Bashir , Mohammad Hajiesmaili , Adam Wierman , Christina Delimitrou

Job scheduling for a MapReduce cluster has been an active research topic in recent years. However, measurement traces from real-world production environment show that the duration of tasks within a job vary widely. The overall elapsed time…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-01-13 Huanle Xu , Wing Cheong Lau

Budget Minimization is a scheduling problem with precedence constraints, i.e., a scheduling problem on a partially ordered set of jobs $(N, \unlhd)$. A job $j \in N$ is available for scheduling, if all jobs $i \in N$ with $i \unlhd j$ are…

Discrete Mathematics · Computer Science 2019-06-27 Marinus Gottschau , Felix Happach , Marcus Kaiser , Clara Waldmann

Modern embedded computing platforms consist of a high amount of heterogeneous resources, which allows executing multiple applications on a single device. The number of running application on the system varies with time and so does the…

Systems and Control · Electrical Eng. & Systems 2020-02-19 Robert Khasanov , Jeronimo Castrillon

We introduce a parallel machine scheduling problem in which the processing times of jobs are not given in advance but are determined by a system of linear constraints. The objective is to minimize the makespan, i.e., the maximum job…

Data Structures and Algorithms · Computer Science 2015-10-30 Kameng Nip , Zhenbo Wang , Zizhuo Wang

In this paper we present efficient algorithmic solutions for several constrained resource allocation, management and discovery problems. We consider new types of resource allocation models and constraints, and we present new geometric…

Data Structures and Algorithms · Computer Science 2009-06-09 Mugurel Ionut Andreica , Madalina Ecaterina Andreica , Daniel Ardelean

We study the precedence-constrained resource scheduling problem [SICOMP'75]. There are $n$ jobs where each job takes a certain time to finish and has a resource requirement throughout the execution time. There are precedence among the jobs.…

Data Structures and Algorithms · Computer Science 2025-09-03 Rathish Das , Hao Sun

In this poster, we quantitatively measure the impacts of data movement on performance in MapReduce-based applications when executed on HPC systems. We leverage the PAPI 'powercap' component to identify ideal conditions for execution of our…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-03-29 Joshua Hoke Davis , Tao Gao , Sunita Chandresekaran , Michela Taufer

The manpower scheduling problem is a kind of critical combinational optimization problem. Researching solutions to scheduling problems can improve the efficiency of companies, hospitals, and other work units. This paper proposes a new model…

Machine Learning · Computer Science 2021-05-11 Tianyu Liu , Lingyu Zhang