English
Related papers

Related papers: Improving the Load Balance of MapReduce Operations…

200 papers

The exponential growth of data in current times and the demand to gain information and knowledge from the data present new challenges for database researchers. Known database systems and algorithms are no longer capable of effectively…

Databases · Computer Science 2017-12-06 Yaron Gonen

Parallel machine scheduling has been extensively studied in the past decades, with applications ranging from production planning to job processing in large computing clusters. In this work we study some of these fundamental optimization…

Data Structures and Algorithms · Computer Science 2015-09-08 Yael Mordechai

Recently, MapReduce based spatial query systems have emerged as a cost effective and scalable solution to large scale spatial data processing and analytics. MapReduce based systems achieve massive scalability by partitioning the data and…

Databases · Computer Science 2015-09-04 Ablimit Aji , Vo Hoang , Fusheng Wang

The MapReduce framework has been generating a lot of interest in a wide range of areas. It has been widely adopted in industry and has been used to solve a number of non-trivial problems in academia. Putting MapReduce on strong theoretical…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-06-19 Matthew Felice Pace

It is cost-efficient for a tenant with a limited budget to establish a virtual MapReduce cluster by renting multiple virtual private servers (VPSs) from a VPS provider. To provide an appropriate scheduling scheme for this type of computing…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-09-12 Ming-Chang Lee , Jia-Chun Lin , Ramin Yahyapour

We consider a natural generalization of classical scheduling problems in which using a time unit for processing a job causes some time-dependent cost which must be paid in addition to the standard scheduling cost. We study the scheduling…

Data Structures and Algorithms · Computer Science 2018-12-03 Lin Chen , Nicole Megow , Roman Rischke , Leen Stougie , José Verschae

Several works related to spatial crowdsourcing have been proposed in the direction where the task executers are to perform the tasks within the stipulated deadlines. Though the deadlines are set, it may be a practical scenario that majority…

Computational Engineering, Finance, and Science · Computer Science 2024-02-08 Naren Debnath , Sajal Mukhopadhyay , Fatos Xhafa

In this paper, a joint task, spectrum, and transmit power allocation problem is investigated for a wireless network in which the base stations (BSs) are equipped with mobile edge computing (MEC) servers to jointly provide computational and…

Signal Processing · Electrical Eng. & Systems 2020-07-21 Sihua Wang , Mingzhe Chen , Xuanlin Liu , Changchuan Yin , Shuguang Cui , H. Vincent Poor

In this paper we present new algorithms and analysis for the linear inverse sensor placement and scheduling problems over multiple time instances with power and communications constraints. The proposed algorithms, which deal directly with…

Information Theory · Computer Science 2018-02-14 Cristian Rusu , John Thompson , Neil M. Robertson

Since its introduction in 2004, the MapReduce framework has become one of the standard approaches in massive distributed and parallel computation. In contrast to its intensive use in practise, theoretical footing is still limited and only…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-12-19 Gero Greiner , Riko Jacob

Machine scheduling problems involving conflict jobs can be seen as a constrained version of the classical scheduling problem, in which some jobs are conflict in the sense that they cannot be proceeded simultaneously on different machines.…

Data Structures and Algorithms · Computer Science 2021-02-12 Minh Hoàng Hà , Dinh Quy Ta , Trung Thanh Nguyen

Supercomputers getting ever larger and energy-efficient is at odds with the reliability of the used hardware. Thus, the time intervals between component failures are decreasing. Contrarily, the latencies for individual operations of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-26 Demian Hespe , Lukas Hübner , Charel Mercatoris , Peter Sanders

While previous work on energy-efficient algorithms focused on assumption that tasks can be assigned to any processor, we initially study the problem of task scheduling on restricted parallel processors. The objective is to minimize the…

Data Structures and Algorithms · Computer Science 2013-09-17 Xibo Jin , Fa Zhang , Ying Song , Liya Fan , Zhiyong Liu

We consider scheduling problems for unit jobs with release times, where the number or size of the gaps in the schedule is taken into consideration, either in the objective function or as a constraint. Except for a few papers on energy…

Data Structures and Algorithms · Computer Science 2020-07-21 Marek Chrobak , Mordecai Golin , Tak-Wah Lam , Dorian Nogneng

The research in parallel machine scheduling in combinatorial optimization suggests that the desirable parallel efficiency could be achieved when the jobs are sorted in the non-increasing order of processing times. In this paper, we find…

Numerical Analysis · Mathematics 2012-02-15 Lei Wang , Heng Liang , Fengshan Bai , Yan Huo

Parallel computing is the fundamental base for MapReduce framework in Hadoop. Each data chunk is replicated over 3 servers for increasing availability of data and decreasing probability of data loss. Hence, the 3 servers that have Map task…

Performance · Computer Science 2020-07-21 Amirali Daghighi , Jim Q. Chen

A multiple server setting is considered, where each server has tunable speed, and increasing the speed incurs an energy cost. Jobs arrive to a single queue, and each job has two types of sub-tasks, map and reduce, and a {\bf precedence}…

Data Structures and Algorithms · Computer Science 2021-05-20 Rahul Vaze , Jayakrishnan Nair

Large scale clusters leveraging distributed computing frameworks such as MapReduce routinely process data that are on the orders of petabytes or more. The sheer size of the data precludes the processing of the data on a single computer. The…

Information Theory · Computer Science 2018-02-12 Konstantinos Konstantinidis , Aditya Ramamoorthy

Computing workflows in heterogeneous multiprocessor systems are frequently modeled as directed acyclic graphs of tasks and data blocks, which represent computational modules and their dependencies in the form of data produced by a task and…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-14 Junwen Ding , Liangcai Song , Siyuan Li , Chen Wu , Ronghua He , Zhouxing Su , Zhipeng Lü

Speed-robust scheduling is the following two-stage problem of scheduling $n$ jobs on $m$ uniformly related machines. In the first stage, the algorithm receives the value of $m$ and the processing times of $n$ jobs; it has to partition the…

Data Structures and Algorithms · Computer Science 2024-07-17 Josef Minařík , Jiří Sgall