Related papers: A description of the radio astronomy data processi…
Modern astronomical data processing requires complex software pipelines to process ever growing datasets. For radio astronomy, these pipelines have become so large that they need to be distributed across a computational cluster. This makes…
One of the science drivers of the new Low Frequency Array (LOFAR) is large-area surveys of the low-frequency radio sky. Realizing this goal requires automated processing of the interferometric data, such that fully calibrated images are…
The Square Kilometre Array (SKA) will be both the largest radio telescope ever constructed and the largest Big Data project in the known Universe. The first phase of the project will generate on the order of 5 zettabytes of data per year. A…
The Low Frequency Array (LOFAR) radio telescope is an international aperture synthesis radio telescope used to study the Universe at low frequencies. One of the goals of the LOFAR telescope is to conduct deep wide-field surveys. Here we…
Radio astronomy is entering a new era with new and future radio observatories such as the Low Frequency Array and the Square Kilometer Array. We describe in detail an automated flagging pipeline and evaluate its performance. With only a…
Although several existing and upcoming telescopes have imaging as their primary mode, they also have a sensitive phased-array mode with a multiple-beam forming capability enabling high time resolution studies of several types of objects,…
Radio science data collected from NASA's Deep Space Networks (DSNs) are made available in various formats through NASA's Planetary Data System (PDS). The majority of these data are packed in complex formats, making them inaccessible to…
The domain of radio astronomy is currently facing significant computational challenges, foremost amongst which are those posed by the development of the world's largest radio telescope, the Square Kilometre Array (SKA). Preliminary…
Optimizing data-intensive workflow execution is essential to many modern scientific projects such as the Square Kilometre Array (SKA), which will be the largest radio telescope in the world, collecting terabytes of data per second for the…
We summarise the properties of the Sloan Digital Sky Survey (SDSS) project, discuss our software infrastructure, and outline the architecture of the SDSS image processing pipelines. We then discuss two of the algorithms used in the SDSS…
Transient radio phenomena and pulsars are one of six LOFAR Key Science Projects (KSPs). As part of the Transients KSP, the Pulsar Working Group (PWG) has been developing the LOFAR Pulsar Data Pipelines to both study known pulsars as well as…
The Square Kilometre Array (SKA) is a planned large radio interferometer designed to operate over a wide range of frequencies, and with an order of magnitude greater sensitivity and survey speed than any current radio telescope. The SKA…
Pulsar data analysis pipelines have historically been comprised of bespoke software systems, supporting the off-line analysis of data. However modern data acquisition systems are making off-line analyses impractical. They often output…
LOFAR, the "low-frequency array", will be one of the first in a new generation of radio telescopes and Square Kilometer Array (SKA) pathfinders that are highly flexible in capability because they are largely software driven. LOFAR will not…
The signal processing firmware that has been developed for the Low Frequency Aperture Array component of the Square Kilometre Array is described. The firmware is implemented on a dual FPGA board, that is capable of processing the streams…
We present Pipe3D, an analysis pipeline based on the FIT3D fitting tool, devel- oped to explore the properties of the stellar populations and ionized gas of Integral Field Spectroscopy data. Pipe3D was created to provide with coherent,…
Densely-packed, all-digital aperture arrays form a key area of technology development required for the Square Kilometre Array (SKA) radio telescope. The design of real-time signal processing systems for digital aperture arrays is currently…
We present the end-to-end data reduction pipeline for SCALES (Slicer Combined with Array of Lenslets for Exoplanet Spectroscopy), the upcoming thermal-infrared, diffraction-limited imager, and low and medium-resolution integral field…
The Square Kilometre Array (SKA) is the next generation radio telescope distinguished by a superb sensitivity due to its large aperture (about one square kilometre) and advanced instrumentation. It will cover a broad range of observing…
DSPSR is a high-performance, open-source, object-oriented, digital signal processing software library and application suite for use in radio pulsar astronomy. Written primarily in C++, the library implements an extensive range of modular…