Optimizing Sparse RFI Prediction using Deep Learning
Abstract
Radio Frequency Interference (RFI) is an ever-present limiting factor among radio telescopes even in the most remote observing locations. When looking to retain the maximum amount of sensitivity and reduce contamination for Epoch of Reionization studies, the identification and removal of RFI is especially important. In addition to improved RFI identification, we must also take into account computational efficiency of the RFI-Identification algorithm as radio interferometer arrays such as the Hydrogen Epoch of Reionization Array grow larger in number of receivers. To address this, we present a Deep Fully Convolutional Neural Network (DFCN) that is comprehensive in its use of interferometric data, where both amplitude and phase information are used jointly for identifying RFI. We train the network using simulated HERA visibilities containing mock RFI, yielding a known "ground truth" dataset for evaluating the accuracy of various RFI algorithms. Evaluation of the DFCN model is performed on observations from the 67 dish build-out, HERA-67, and achieves a data throughput of 1.6 HERA time-ordered 1024 channeled visibilities per hour per GPU. We determine that relative to an amplitude only network including visibility phase adds important adjacent time-frequency context which increases discrimination between RFI and Non-RFI. The inclusion of phase when predicting achieves a Recall of 0.81, Precision of 0.58, and score of 0.75 as applied to our HERA-67 observations.
Keywords
Cite
@article{arxiv.1902.08244,
title = {Optimizing Sparse RFI Prediction using Deep Learning},
author = {Joshua Kerrigan and Paul La Plante and Saul Kohn and Jonathan C. Pober and James Aguirre and Zara Abdurashidova and Paul Alexander and Zaki S. Ali and Yanga Balfour and Adam P. Beardsley and Gianni Bernardi and Judd D. Bowman and Richard F. Bradley and Jacob Burba and Chris L. Carilli and Carina Cheng and David R. DeBoer and Matt Dexter and Eloy de Lera Acedo and Joshua S. Dillon and Julia Estrada and Aaron Ewall-Wice and Nicolas Fagnoni and Randall Fritz and Steve R. Furlanetto and Brian Glendenning and Bradley Greig and Jasper Grobbelaar and Deepthi Gorthi and Ziyaad Halday and Bryna J. Hazelton and Jack Hickish and Daniel C. Jacobs and Austin Julius and Nicholas Kern and Piyanat Kittiwisit and Matthew Kolopanis and Adam Lanman and Telalo Lekalake and Adrian Liu and David MacMahon and Lourence Malan and Cresshim Malgas and Matthys Maree and Zachary E. Martinot and Eunice Matsetela and Andrei Mesinger and Mathakane Molewa and Miguel F. Morales and Tshegofalang Mosiane and Abraham R. Neben and Aaron R. Parsons and Nipanjana Patra and Samantha Pieterse and Nima Razavi-Ghods and Jon Ringuette and James Robnett and Kathryn Rosie and Peter Sims and Craig Smith and Angelo Syce and Nithyanandan Thyagarajan and Peter K. G. Williams and Haoxuan Zheng},
journal= {arXiv preprint arXiv:1902.08244},
year = {2019}
}
Comments
11 pages, 7 figures