English

Building and Installing a Hadoop/MapReduce Cluster from Commodity Components

Distributed, Parallel, and Cluster Computing 2009-12-01 v1
Authors: Jochen L. Leidner , Gary Berosik
View on arXiv ↗ PDF ↗

Abstract

This tutorial presents a recipe for the construction of a compute cluster for processing large volumes of data, using cheap, easily available personal computer hardware (Intel/AMD based PCs) and freely available open source software (Ubuntu Linux, Apache Hadoop).

Cite

@article{arxiv.0911.5438,
  title  = {Building and Installing a Hadoop/MapReduce Cluster from Commodity Components},
  author = {Jochen L. Leidner and Gary Berosik},
  journal= {arXiv preprint arXiv:0911.5438},
  year   = {2009}
}

Comments

Technical Report; 15 pages, 1 figure

Related papers

View all related →
Networking and Internet Architecture · Computer Science
Past, Present and Future of Hadoop: A Survey
Ameneh Zarei, Shahla Safari, Mahmood Ahmadi, Farhad Mardukhi
2022-03-01
Distributed, Parallel, and Cluster Computing · Computer Science
An Experimental Evaluation of Performance of A Hadoop Cluster on Replica Management
Muralikrishnan Ramane, Sharmila Krishnamoorthy, Sasikala Gowtham
2014-11-10
Distributed, Parallel, and Cluster Computing · Computer Science
An Alternative C++ based HPC system for Hadoop MapReduce
Vignesh S., Muthumanikandan V., Siddarth S., Sainath G
2020-06-29
Distributed, Parallel, and Cluster Computing · Computer Science
Management of Data Replication for PC Cluster-based Cloud Storage System
Julia Myint, Thinn Thu Naing
2011-12-30
Distributed, Parallel, and Cluster Computing · Computer Science
openPC : a toolkit for public cluster with full ownership
Z. Akbar, I. Firmansyah, B. Hermanto, L. T. Handoko
2013-06-18
Distributed, Parallel, and Cluster Computing · Computer Science
Mapping and Reducing the Brain on the Cloud
Esha Sahai, Tuhin Sahai
2012-08-14
Distributed, Parallel, and Cluster Computing · Computer Science
Performance Issues of Heterogeneous Hadoop Clusters in Cloud Computing
B. Thirumala Rao, N. V. Sridevi, V. Krishna Reddy, L. S. S. Reddy
2012-07-05
Distributed, Parallel, and Cluster Computing · Computer Science
Building a Virtual HPC Cluster with Auto Scaling by the Docker
Hsi-En Yu, Weicheng Huang
2015-09-29
Distributed, Parallel, and Cluster Computing · Computer Science
HPC as a Service: A naive model
Hamza Ali Imran, Saad Wazir, Ahmed Jamal Ikram, Ataul Aziz Ikram +2
2020-03-03
High Energy Physics - Lattice · Physics
Minimalist's Linux Cluster
Chang-Yeong Choi, Jeong-Hyun Kim, Seyong Kim
2009-11-10
Distributed, Parallel, and Cluster Computing · Computer Science
InstaCluster: Building A Big Data Cluster in Minutes
Giovanni Paolo Gibilisco, Srdan Krstic
2015-08-21
Hardware Architecture · Computer Science
Affordable HPC: Leveraging Small Clusters for Big Data and Graph Computing
Ruilong Wu, Yisu Wang, Dirk Kutscher
2024-08-29
Distributed, Parallel, and Cluster Computing · Computer Science
Simple and Effective Distributed Computing with a Scheduling Service
David M. Mackie
2007-05-23
Distributed, Parallel, and Cluster Computing · Computer Science
Integrating R and Hadoop for Big Data Analysis
Bogdan Oancea, Raluca Mariana Dragoescu
2018-02-09
Distributed, Parallel, and Cluster Computing · Computer Science
Testing MapReduce-Based Systems
João Eugenio Marynowski, Michel Albonico, Eduardo Cunha de Almeida, Gerson Sunyé
2013-02-11
Distributed, Parallel, and Cluster Computing · Computer Science
Affordable and Energy-Efficient Cloud Computing Clusters: The Bolzano Raspberry Pi Cloud Cluster Experiment
Pekka Abrahamsson, Sven Helmer, Nattakarn Phaphoom, Lorenzo Nicolodi +7
2017-09-21
Distributed, Parallel, and Cluster Computing · Computer Science
Optimizing MapReduce for Highly Distributed Environments
Benjamin Heintz, Abhishek Chandra, Ramesh K. Sitaraman
2012-07-31
Distributed, Parallel, and Cluster Computing · Computer Science
Experiences with task-based programming using cluster nodes as OpenMP devices
Ilias Keftakis, Vassilios V. Dimakopoulos
2022-05-24
Distributed, Parallel, and Cluster Computing · Computer Science
Performance Evaluation of Virtualized Hadoop Clusters
Todor Ivanov, Roberto V. Zicari, Sead Izberovic, Karsten Tolle
2014-11-17
High Energy Physics - Lattice · Physics
Cost-Effective Clustering
Steven Gottlieb
2009-11-07
Distributed, Parallel, and Cluster Computing · Computer Science
Get Your Memory Right: The Crispy Resource Allocation Assistant for Large-Scale Data Processing
Jonathan Will, Lauritz Thamsen, Jonathan Bader, Dominik Scheinert +1
2023-01-11
Distributed, Parallel, and Cluster Computing · Computer Science
On Energy Efficiency and Performance Evaluation of SBC based Clusters: A Hadoop case study
Basit Qureshi, Anis Koubaa
2019-03-18
Distributed, Parallel, and Cluster Computing · Computer Science
An Easy-to-Use-and-Deploy Grid Computing Framework
Gaurav Menghani, Anil Harwani, Yash Londhe, Kalpesh Kagresha
2020-10-07
High Energy Physics - Lattice · Physics
Parallel Computing for QCD on a Pentium Cluster
X. Q. Luo, E. B. Gregory, J. C. Yang, Y. L. Wang +2
2007-05-23
Distributed, Parallel, and Cluster Computing · Computer Science
Map / Reduce Deisgn and Implementation of Apriori Alogirthm for handling voluminous data-sets
Anjan K. Koundinya, Srinath N. K., K. A. K. Sharma, Kiran Kumar +2
2012-12-20
R2 v1 2026-06-21T14:17:17.868Z