Conducting a research in an efficient, repetitive, evaluable, but also convenient (in terms of development) way has always been a challenge. To satisfy those requirements in a long term and simultaneously minimize costs of the software engineering process, one has to follow a certain set of guidelines. This article describes such guidelines based on the research environment called Content Analysis System (CoAnSys) created in the Center for Open Science (CeON). Best practices and tools for working in the Apache Hadoop environment, as well as the process of establishing these rules are portrayed.
@article{arxiv.1303.5234,
title = {How to perform research in Hadoop environment not losing mental equilibrium - case study},
author = {Piotr Jan Dendek and Artur Czeczko and Mateusz Fedoryszak and Adam Kawa and Piotr Wendykier and Lukasz Bolikowski},
journal= {arXiv preprint arXiv:1303.5234},
year = {2014}
}
Comments
This paper (with changed content) appeared under the title "Chrum: The Tool for Convenient Generation of Apache Oozie Workflows" in "Intelligent Tools for Building a Scientific Information Platform: From Research to Implementation", "Studies in Computational Intelligence", Volume 541, 2014, http://link.springer.com/book/10.1007/978-3-319-04714-0