Creating A Galactic Plane Atlas With Amazon Web Services
Instrumentation and Methods for Astrophysics
2013-12-25 v1 Distributed, Parallel, and Cluster Computing
Abstract
This paper describes by example how astronomers can use cloud-computing resources offered by Amazon Web Services (AWS) to create new datasets at scale. We have created from existing surveys an atlas of the Galactic Plane at 16 wavelengths from 1 {\mu}m to 24 {\mu}m with pixels co-registered at spatial sampling of 1 arcsec. We explain how open source tools support management and operation of a virtual cluster on AWS platforms to process data at scale, and describe the technical issues that users will need to consider, such as optimization of resources, resource costs, and management of virtual machine instances.
Keywords
Cite
@article{arxiv.1312.6723,
title = {Creating A Galactic Plane Atlas With Amazon Web Services},
author = {G. Bruce Berriman and Ewa Deelman and John Good and Gideon Juve and Jamie Kinney and Ann Merrihew and Mats Rynge},
journal= {arXiv preprint arXiv:1312.6723},
year = {2013}
}
Comments
7 pages, 1 table, 2 figures. Submitted to IEEE Special Edition on Computing in Astronomy