面向天文大数据的实时处理系统：在HERA中的应用
天体物理仪器与方法
2021-10-04 v2
摘要
随着当前及下一代天文仪器投入使用，它们将产生前所未有的数据洪流。实时分析这些数据带来了独特的概念与计算挑战，而其长期存储与归档对于生成可靠、可复现的科学结果至关重要。我们在此介绍氢再电离时代阵列（HERA）——一台旨在通过干涉测量提供来自宇宙黎明与再电离时代的极高红移21 cm信号首次探测的射电干涉仪——的实时处理（RTP）系统。RTP系统由在原始数据获取后不久即运行的例程组成，例如校准与射频干扰（RFI）事件检测。RTP与Librarian紧密协作，后者是HERA的数据存储与传输管理器，可自动摄取数据并将副本传输至其他集群进行后处理分析。RTP系统与Librarian均为公开的开源软件，可被其他科学合作项目修改使用。HERA完全建成时预计每夜产生超过50太字节（TB）数据，而RTP系统使这些数据的成功科学分析成为可能。
引用
@article{arxiv.2104.03990,
title = {A Real Time Processing System for Big Data in Astronomy: Applications to HERA},
author = {Paul La Plante and Peter K. G. Williams and Matthew Kolopanis and Joshua S. Dillon and Adam P. Beardsley and Nicholas S. Kern and Michael Wilensky and Zaki S. Ali and Zara Abdurashidova and James E. Aguirre and Paul Alexander and Yanga Balfour and Gianni Bernardi and Tashalee S. Billings and Judd D. Bowman and Richard F. Bradley and Phil Bull and Jacob Burba and Steve Carey and Chris L. Carilli and Carina Cheng and David R. DeBoer and Matt Dexter and Eloy de Lera Acedo and John Ely and Aaron Ewall-Wice and Nicolas Fagnoni and Randall Fritz and Steven R. Furlanetto and Kingsley Gale-Sides and Brian Glendenning and Deepthi Gorthi and Bradley Greig and Jaspar Grobbelaar and Ziyaad Halday and Bryna J. Hazelton and Jacqueline N. Hewitt and Jack Hickish and Daniel C. Jacobs and Austin Julius and Joshua Kerrigan and Piyanat Kittiwisit and Saul A. Kohn and Adam Lanman and Telalo Lekalake and David Lewis and Adrian Liu and David MacMahon and Lourence Malan and Cresshim Malgas and Matthys Maree and Zachary E. Martinot and Eunice Matsetela and Andrei Mesinger and Mathakane Molewa and Miguel F. Morales and Tshegofalang Mosiane and Steven Murray and Abraham R. Neben and Bojan Nikolic and Aaron R. Parsons and Robert Pascua and Nipanjana Patra and Samantha Pieterse and Jonathan C. Pober and Nima Razavi-Ghods and Jon Ringuette and James Robnett and Kathryn Rosie and Mario G. Santos and Peter Sims and Craig Smith and Angelo Syce and Nithyanandan Thyagarajan and Haoxuan Zheng},
journal= {arXiv preprint arXiv:2104.03990},
year = {2021}
}
备注
15 pages, 3 figures, published in Astronomy and Computing