Related papers: Pipeline Collector: gathering performance data for…
We describe the software requirement and design specifications for all-sky panoramic astronomical pipelines. The described software aims to meet the specific needs of super-wide angle optics, and includes cosmic-ray hit rejection, image…
International LOFAR stations are powerful radio telescopes, however they are delivered without the tooling necessary to convert their raw data stream into standard data formats that can be used by common processing pipelines, or…
A number of hardware upgrades for the Low-Frequency Array (LOFAR) are currently under development. These upgrades are collectively referred to as the LOFAR 2.0 upgrade. The first stage of LOFAR 2.0 will introduce a distributed clock signal…
Astronomical photometry is the science of measuring the flux of a celestial object. Since its introduction, the CCD has been the principle method of measuring flux to calculate the apparent magnitude of an object. Each CCD image taken must…
Processing of raw data from modern astronomical instruments is nowadays often carried out using dedicated software, so-called "pipelines" which are largely run in automated operation. In this paper we describe the data reduction pipeline of…
The LOw-Frequency ARray is a low-frequency radio interferometer composed by observational stations spread across Europe and it is the largest precursor of SKA in terms of effective area and generated data rates. In 2018, the Italian…
The LOw Frequency ARray (LOFAR) is capable of imaging spectroscopy of the Sun in the 10-240 MHz frequency range, with high spectral, temporal, and spatial resolution. However, the complex and rapidly varying nature of solar radio emission -…
The new generation of high-resolution broad-band radio telescopes, like the Low Frequency Array (LOFAR), produces, depending on the level of compression, between 1 to 10 TB of data per hour after correlation. Such a large amount of…
The LOw Frequency Array, LOFAR, is a next generation radio telescope with its core in the Netherlands and elements distributed throughout Europe. It has exceptional collecting area and wide bandwidths at frequencies from 10 MHz up to 250…
SOFIA presents a number of interesting challenges for the development of a data reduction environment which, at its initial phase, will have to incorporate pipelines from seven different instruments. Therefore, the SOFIA data reduction…
To reduce and analyze astronomical images, astronomers can rely on a wide range of libraries providing low-level implementations of legacy algorithms. However, combining these routines into robust and functional pipelines requires a major…
We present a remote sensing pipeline that processes LiDAR (Light Detection And Ranging) data through machine & deep learning for the application of archeological feature detection on big geo-spatial data platforms such as e.g. IBM PAIRS…
For decades now, scientific data volumes have experienced relentless, exponential growth. As a result, legacy astronomical data formats are straining under a burden not conceived when these formats were first introduced. With future…
Written in Python and utilising ParselTongue to interface with the Astronomical Image Processing System (AIPS), the e-MERLIN data reduction pipeline is intended to automate the procedures required in processing and calibrating radio…
The LOFAR radio telescope creates Petabytes of data per year. This data is important for many scientific projects. The data needs to be efficiently processed within the timespan of these projects in order to maximize the scientific impact.…
Access to astronomical data through archives and VO is essential but does not solve all problems. Availability of appropriate software for analyzing the data is often equally important for the efficiency with which a researcher can publish…
We have constructed a new, fast, robust and reliable pipeline to detect variable stars from the ROTSE-IIId archival data. Turkish share of ROTSE-III archive contains approximately one million objects from a large field of view (1.85\dgr)…
Low frequency radio waves, while challenging to observe, are a rich source of information about pulsars. The LOw Frequency ARray (LOFAR) is a new radio interferometer operating in the lowest 4 octaves of the ionospheric "radio window":…
LOFAR, the Low Frequency Array, is a next-generation radio telescope that is being built in Northern Europe and expected to be fully operational at the end of this decade. It will operate at frequencies from 15 to 240 MHz (corresponding to…
A major challenge in modern radio astronomy is dealing with the massive data volumes generated by wide-bandwidth receivers. Such massive data rates are often too great for a single device to cope, and so processing must be split across…