Automated data processing architecture for the Gemini Planet Imager Exoplanet Survey
Abstract
The Gemini Planet Imager Exoplanet Survey (GPIES) is a multi-year direct imaging survey of 600 stars to discover and characterize young Jovian exoplanets and their environments. We have developed an automated data architecture to process and index all data related to the survey uniformly. An automated and flexible data processing framework, which we term the Data Cruncher, combines multiple data reduction pipelines together to process all spectroscopic, polarimetric, and calibration data taken with GPIES. With no human intervention, fully reduced and calibrated data products are available less than an hour after the data are taken to expedite follow-up on potential objects of interest. The Data Cruncher can run on a supercomputer to reprocess all GPIES data in a single day as improvements are made to our data reduction pipelines. A backend MySQL database indexes all files, which are synced to the cloud, and a front-end web server allows for easy browsing of all files associated with GPIES. To help observers, quicklook displays show reduced data as they are processed in real-time, and chatbots on Slack post observing information as well as reduced data products. Together, the GPIES automated data processing architecture reduces our workload, provides real-time data reduction, optimizes our observing strategy, and maintains a homogeneously reduced dataset to study planet occurrence and instrument performance.
Cite
@article{arxiv.1801.01902,
title = {Automated data processing architecture for the Gemini Planet Imager Exoplanet Survey},
author = {Jason Wang and Marshall Perrin and Dmitry Savransky and Pauline Arriaga and Jeffrey Chilcote and Robert De Rosa and Maxwell Millar-Blanchaer and Christian Marois and Julien Rameau and Schuyler Wolff and Jacob Shapiro and Jean-Baptiste Ruffio and Jérôme Maire and Franck Marchis and James Graham and Bruce Macintosh and S. Mark Ammons and Vanessa Bailey and Travis Barman and Sebastian Bruzzone and Joanna Bulger and Tara Cotten and René Doyon and Gaspard Duchêne and Michael Fitzgerald and Katherine Follette and Stephen Goodsell and Alexandra Greenbaum and Pascale Hibon and Li-Wei Hung and Patrick Ingraham and Paul Kalas and Quinn Konopacky and James Larkin and Mark Marley and Stanimir Metchev and Eric Nielsen and Rebecca Oppenheimer and David Palmer and Jennifer Patience and Lisa Poyneer and Laurent Pueyo and Abhijith Rajan and Fredrik Rantakyrö and Adam Schneider and Anand Sivaramakrishnan and Inseok Song and Remi Soummer and Sandrine Thomas and J. Kent Wallace and Kimberly Ward-Duong and Sloane Wiktorowicz},
journal= {arXiv preprint arXiv:1801.01902},
year = {2018}
}
Comments
21 pages, 3 figures, accepted in JATIS