中文
相关论文

相关论文: Energy Efficient Scheduling of MapReduce Jobs

200 篇论文

With the rapid growth in computing power demand, cloud native networks have emerged as a promising solution to address the challenges of efficient resource coordination, particularly in coping with the dynamic fluctuations of network…

分布式、并行与集群计算 · 计算机科学 2026-02-11 Hao Jiang , Meng Qin , Ruijie Kuai , Dandan Liang , Yue Gao

Distributed cloud environments hosting data-intensive applications often experience slowdowns due to network congestion, asymmetric bandwidth, and inter-node data shuffling. These factors are typically not captured by traditional host-level…

分布式、并行与集群计算 · 计算机科学 2025-11-21 Sankalpa Timilsina , Susmit Shannigrahi

This article presents a novel scheduling approach to minimise the energy consumption of a machine during its idle periods. In the scheduling domain, it is common to model the behaviour of the machine by defining a small set of machine…

信号处理 · 电气工程与系统科学 2020-12-17 Ondrej Benedikt , Baran Alikoc , Premysl Sucha , Sergej Celikovsky , Zdenek Hanzalek

Given a system model where machines have distinct speeds and power ratings but are otherwise compatible, we consider various problems of scheduling under resource constraints on the system which place the restriction that not all machines…

数据结构与算法 · 计算机科学 2019-02-08 Mohammed Haroon Dupty , Pragati Agrawal , Shrisha Rao

There is a growing trend of performing analysis on large datasets using workflows composed of MapReduce jobs connected through producer-consumer relationships based on data. This trend has spurred the development of a number of…

数据库 · 计算机科学 2012-08-02 Harold Lim , Herodotos Herodotou , Shivnath Babu

In this paper, we study CPU utilization time patterns of several MapReduce applications. After extracting running patterns of several applications, they are saved in a reference database to be later used to tweak system parameters to…

分布式、并行与集群计算 · 计算机科学 2013-01-30 Nikzad Babaii Rizvandi , Javid Taheri , Albert Y. Zomaya

Large-scale systems, such as MapReduce and Hadoop, perform aggressive materialization of intermediate job results in order to support fault tolerance. When jobs correspond to exploratory queries submitted by data analysts, these…

The dramatic increase of network infrastructure comes at the cost of rapidly increasing energy consumption, which makes optimization of energy efficiency (EE) an important topic. Since EE is often modeled as the ratio of rate to power, we…

信息论 · 计算机科学 2015-03-19 Christian Isheden , Zhijiat Chong , Eduard Jorswieck , Gerhard Fettweis

MapReduce is becoming the de facto framework for storing and processing massive data, due to its excellent scalability, reliability, and elasticity. In many MapReduce applications, obtaining a compact accurate summary of data is essential.…

数据库 · 计算机科学 2011-11-01 Jeffrey Jestes , Ke Yi , Feifei Li

A new class of multi agent single machine scheduling problems is introduced, where each job is associated with a self interested agent with a utility function decreasing in completion time. We aim to achieve a fair solution by maximizing…

计算机科学与博弈论 · 计算机科学 2026-04-01 Gaia Nicosia , Andrea Pacifici , Ulrich Pferschy

Clustering analysis has received considerable attention in spatial data mining for several years. With the rapid development of the geospatial information technologies, the size of spatial information data is growing exponentially which…

分布式、并行与集群计算 · 计算机科学 2016-08-25 Xia Yue , Wang Man , Jun Yue , Guangcao Liu

Resource scheduling and allocation is a critical component of many high impact systems ranging from congestion control to cloud computing. Finding more optimal solutions to these problems often has significant impact on resource and time…

Scheduling jobs with precedence constraints on a set of identical machines to minimize the total processing time (makespan) is a fundamental problem in combinatorial optimization. In practical settings such as cloud computing, jobs are…

数据结构与算法 · 计算机科学 2014-04-29 Konstantin Makarychev , Debmalya Panigrahi

The explosion of Big Data was followed by the proliferation of numerous complex parallel software stacks whose aim is to tackle the challenges of data deluge. A drawback of a such multi-layered hierarchical deployment is the inability to…

分布式、并行与集群计算 · 计算机科学 2016-04-01 Colin Barrett , Christos Kotselidis , Mikel Luján

Temperature affects not only the reliability but also the performance, power, and cost of the embedded system. This paper proposes a thermal-aware task allocation and scheduling algorithm for embedded systems. The algorithm is used as a…

硬件体系结构 · 计算机科学 2011-11-09 W. -L. Hung , Y. Xie , N. Vijaykrishnan , M. Kandemir , M. J. Irwin

We consider scheduling problems for unit jobs with release times, where the number or size of the gaps in the schedule is taken into consideration, either in the objective function or as a constraint. Except for a few papers on energy…

数据结构与算法 · 计算机科学 2020-07-21 Marek Chrobak , Mordecai Golin , Tak-Wah Lam , Dorian Nogneng

In this paper, we propose an analytical method to model the dependency between configuration parameters and total execution time of Map-Reduce applications. Our approach has three key phases: profiling, modeling, and prediction. In…

分布式、并行与集群计算 · 计算机科学 2012-03-06 Nikzad Babaii Rizvandi , Albert Y. Zomaya , Ali Javadzadeh Boloori , Javid Taheri

In this work we study the problem of scheduling tasks with dependencies in multiprocessor architectures where processors have different speeds. We present the preemptive algorithm "Save-Energy" that given a schedule of tasks it post…

分布式、并行与集群计算 · 计算机科学 2008-06-09 Ioannis Chatzigiannakis , Georgios Giannoulis , Paul G. Spirakis

Today's data centers have an abundance of computing resources, hosting server clusters consisting of as many as tens or hundreds of thousands of machines. To execute a complex computing task over a data center, it is natural to distribute…

信息论 · 计算机科学 2017-02-24 Qian Yu , Songze Li , Mohammad Ali Maddah-Ali , A. Salman Avestimehr

CPU-GPU heterogeneous architectures are now commonly used in a wide variety of computing systems from mobile devices to supercomputers. Maximizing the throughput for multi-programmed workloads on such systems is indispensable as one single…

分布式、并行与集群计算 · 计算机科学 2024-05-08 Issa Saba , Eishi Arima , Dai Liu , Martin Schulz