MagAO-X is an extreme adaptive optics (ExAO) instrument for the Magellan Clay 6.5-meter telescope at Las Campanas Observatory in Chile. Its high spatial and temporal resolution can produce data rates of 1 TB/hr or more, including all AO system telemetry and science images. We describe the tools and architecture we use for commanding, telemetry, and science data transmission and storage. The high data volumes require a distributed approach to data processing, and we have developed a pipeline that can scale from a single laptop to dozens of HPC nodes. The same codebase can then be used for both quick-look functionality at the telescope and for post-processing. We present the software and infrastructure we have developed for ExAO data post-processing, and illustrate their use with recently acquired direct-imaging data.
@article{arxiv.2208.07354,
title = {XPipeline: Starlight subtraction at scale for MagAO-X},
author = {Joseph D. Long and Jared R. Males and Sebastiaan Y. Haffert and Laird M. Close and Katie M. Morzinski and Kyle Van Gorkom and Jennifer Lumbres and Warren Foster and Alexander Hedglen and Maggie Kautz and Alex Rodack and Lauren Schatz and Kelsey Miller and David Doelman and Steven Bos and Matthew A. Kenworthy and Frans Snik and Gilles P. P. L. Otten},
journal= {arXiv preprint arXiv:2208.07354},
year = {2022}
}
Comments
From work presented at the SPIE Astronomical Telescopes and Instrumentation 2022 meeting