English
Related papers

Related papers: Scheduling MapReduce Jobs and Data Shuffle on Unre…

200 papers

We consider non-preemptive scheduling of MapReduce jobs with multiple tasks in the practical scenario where each job requires several map-reduce rounds. We seek to minimize the average weighted completion time and consider scheduling on…

Data Structures and Algorithms · Computer Science 2016-02-18 Dimitris Fotakis , Ioannis Milis , Orestis Papadigenopoulos , Vasilis Vassalos , Georgios Zois

The Map-Reduce computing framework rose to prominence with datasets of such size that dozens of machines on a single cluster were needed for individual jobs. As datasets approach the exabyte scale, a single job may need distributed…

Data Structures and Algorithms · Computer Science 2016-10-31 Riley Murray , Samir Khuller , Megan Chao

We consider a problem of scheduling rigid parallel jobs on variable speed processors so as to minimize the total energy consumption. Each job is specified by its processing volume and the required number of processors. We propose new…

Data Structures and Algorithms · Computer Science 2018-11-29 Alexander Kononov , Yulia Kovalenko

Load balance is important for MapReduce to reduce job duration, increase parallel efficiency, etc. Previous work focuses on coarse-grained scheduling. This study concerns fine-grained scheduling on MapReduce operations. Each operation…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-04-15 Liya Fan , Bo Gao , Xi Sun , Fa Zhang , Zhiyong Liu

We consider a recently introduced fair repetitive scheduling problem involving a set of clients, each asking for their associated job to be daily scheduled on a single machine across a finite planning horizon. The goal is to determine a job…

Data Structures and Algorithms · Computer Science 2026-01-01 Danny Hermelin , Danny Segev , Dvir Shabtay

Scheduling a set of jobs over a collection of machines is a fundamental problem that needs to be solved millions of times a day in various computing platforms: in operating systems, in large data clusters, and in data centers. Along with…

Data Structures and Algorithms · Computer Science 2018-07-10 Janardhan Kulkarni , Shi Li

MapReduce is emerged as a prominent programming model for data-intensive computation. In this work, we study power-aware MapReduce scheduling in the speed scaling setting first introduced by Yao et al. [FOCS 1995]. We focus on the…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-02-13 Evripidis Bampis , Vincent Chau , Dimitrios Letsios , Giorgio Lucarelli , Ioannis Milis , Georgios Zois

Modern data centers face new scheduling challenges in optimizing job-level performance objectives, where a significant challenge is the scheduling of highly parallel data flows with a common performance goal (e.g., the shuffle operations in…

Networking and Internet Architecture · Computer Science 2016-03-28 Zhen Qiu , Cliff Stein , Yuan Zhong

We consider the problem of scheduling $n$ jobs on $m$ uniform machines while minimizing the makespan ($Q||C_{\max}$) and maximizing the minimum completion time ($Q||C_{\min}$) in an online setting with migration of jobs. In this online…

Data Structures and Algorithms · Computer Science 2025-08-13 Hauke Brinkop , David Fischer , Klaus Jansen

In this paper, we consider the problem of scheduling an application on a parallel computational platform. The application is a particular task graph, either a linear chain of tasks, or a set of independent tasks. The platform is made of…

Data Structures and Algorithms · Computer Science 2012-10-18 Guillaume Aupy , Anne Benoit

This paper first presents a parallel solution for the Flowshop Scheduling Problem in parallel environment, and then proposes a novel load balancing strategy. The proposed Proportional Fairness Strategy (PFS) takes computational performance…

Networking and Internet Architecture · Computer Science 2008-09-22 Zheng Sun , Xiaohong Huang , Yan Ma

Distributed computing frameworks such as MapReduce are often used to process large computational jobs. They operate by partitioning each job into smaller tasks executed on different servers. The servers also need to exchange intermediate…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-20 Konstantinos Konstantinidis , Aditya Ramamoorthy

The permutation flow shop scheduling (PFSS), aiming at finding the optimal permutation of jobs, is widely used in manufacturing systems. When solving large-scale PFSS problems, traditional optimization algorithms such as heuristics could…

Machine Learning · Computer Science 2023-12-15 Longkang Li , Siyuan Liang , Zihao Zhu , Chris Ding , Hongyuan Zha , Baoyuan Wu

For scheduling in flexible manufacturing system (FMS), many factors should be considered, it is difficult to solve the scheduling problem by satisfying different criteria (production cost, utilization of system, number of movements of part,…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-24 U Yongnam , Ri Taehyong

Parallel machine scheduling has been extensively studied in the past decades, with applications ranging from production planning to job processing in large computing clusters. In this work we study some of these fundamental optimization…

Data Structures and Algorithms · Computer Science 2015-09-08 Yael Mordechai

We consider a multi-organizational system in which each organization contributes processors to the global pool but also jobs to be processed on the common resources. The fairness of the scheduling algorithm is essential for the stability…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-04-23 Piotr Skowron , Krzysztof Rzadca

We study flow shop scheduling with stochastic reentry, where jobs must complete multiple passes through the entire shop, and the number of passes that a job requires for completion is drawn from a discrete probability distribution. The goal…

Data Structures and Algorithms · Computer Science 2026-04-21 Maximilian von Aspern , Felix Buld , Michael Pinedo

In generalized malleable scheduling, jobs can be allocated and processed simultaneously on multiple machines so as to reduce the overall makespan of the schedule. The required processing time for each job is determined by the joint…

Discrete Mathematics · Computer Science 2021-11-22 Dimitris Fotakis , Jannik Matuschke , Orestis Papadigenopoulos

We consider a natural generalization of scheduling $n$ jobs on $m$ parallel machines so as to minimize the makespan. In our extension the set of jobs is partitioned into several classes and a machine requires a setup whenever it switches…

Data Structures and Algorithms · Computer Science 2018-09-28 Klaus Jansen , Marten Maack , Alexander Mäcker

Malleable scheduling is a model that captures the possibility of parallelization to expedite the completion of time-critical tasks. A malleable job can be allocated and processed simultaneously on multiple machines, occupying the same time…

Discrete Mathematics · Computer Science 2022-03-29 Dimitris Fotakis , Jannik Matuschke , Orestis Papadigenopoulos
‹ Prev 1 2 3 10 Next ›