The Dark Energy Survey Data Management (DESDM) system will process and archive the data from the Dark Energy Survey (DES) over the five year period of operation. This paper focuses on a new adaptable processing framework developed to perform highly automated, high performance data parallel processing. The new processing framework has been used to process 45 nights of simulated DECam supernova imaging data, and was extensively used in the DES Data Challenge 4, where it was used to process thousands of square degrees of simulated DES data.
Cite
@article{arxiv.0905.0659,
title = {The Dark Energy Survey Data Management System: The Processing Framework},
author = {Michelle Gower and Joseph J. Mohr and Darren Adams and Y. Dora Cai and Gregory E. Daues and Tony Darnell and Chow-Choong Ngeow and Shantanu Desai and Cristina Beldica and Mike Freemon and Huan Lin and Eric H. Neilsen and Douglas Tucker and Emmanuel Bertin and Luiz A. Nicolaci da Costa and Leandro Martelli and Ricardo L. C. Ogando and Michael Jarvis and Erin Sheldon},
journal= {arXiv preprint arXiv:0905.0659},
year = {2009}
}