Related papers: The Challenge of Data Reduction for Multiple Instr…
We report on the measurements of telluric water vapor made with the instrument FIFI-LS on SOFIA. Since November 2018, FIFI-LS has measured the water vapor overburden with the same measurement setup on each science flight with about 10 data…
An object detection pipeline comprises a camera that captures the scene and an object detector that processes these images. The quality of the images directly affects the performance of the object detector. Many works nowadays focus either…
Heliophysics image data largely relies on a forty-year-old ecosystem built on the venerable Flexible Image Transport System (FITS) data standard. While many in situ measurements use newer standards, they are difficult to integrate with…
The stellar occultation technique provides competitive accuracy in determining the sizes, shapes, astrometry, etc., of the occulting body, comparable to in-situ observations by spacecraft. With the increase in the number of known Solar…
Development of scientific and engineering software is usually different and could be more challenging than the development of conventional enterprise software. The authors were involved in a technology-transfer project between academia and…
The latest generation of radio surveys are now producing sky survey images containing many millions of radio sources. In this context it is highly desirable to understand the performance of radio image source finder (SF) software and to…
In the Earth's magnetosphere, there are fewer than a dozen dedicated probes beyond low-Earth orbit making in-situ observations at any given time. As a result, we poorly understand its global structure and evolution, the mechanisms of its…
We present a project to implement a national common strategy for the mitigation of the steadily deteriorating Radio Frequency Interference (RFI) situation at the Italian radio telescopes. The project involves the Medicina, Noto, and…
In this work we present an integrated computational pipeline involving several model order reduction techniques for industrial and applied mathematics, as emerging technology for product and/or process design procedures. Its data-driven…
Astronomic line mapping with single-pixel instruments is usually performed in an on-the-fly (OTF) or a raster-mapping mode depending on the capabilities of the telescope and the instrument. The observing efficiency can be increased by…
Data science requires time-consuming iterative manual activities. In particular, activities such as data selection, preprocessing, transformation, and mining, highly depend on iterative trial-and-error processes that could be sped-up…
Next generation radio interferometric telescopes are entering an era of big data with extremely large data sets. While these telescopes can observe the sky in higher sensitivity and resolution than before, computational challenges in image…
We present the data reduction software and the distribution of Level 1 and Level 2 products of the Stratospheric Terahertz Observatory 2 (STO2). STO2, a balloon-borne Terahertz telescope, surveyed star-forming regions and the Galactic plane…
We present the current status of two new fully automated reduction and analysis pipelines, built for the Euler telescope and the CORALIE spectrograph. Both pipelines have been designed and built independently at the Universidad de Chile and…
Image subtraction is essential for transient detection in time-domain astronomy. The point spread function (PSF), photometric scaling, and sky background generally vary with time and across the field-of-view for imaging data taken with…
We present a technique to automatically minimise the re-computation when a data processing program is iteratively changed, or added to, as is often the case in exploratory data analysis in radio astronomy. A typical example is flagging and…
Prior to the EU Horizon 2020 and FP7 SOLARNET projects, metadata descriptions of Solar observations were only standardized for space-based observations, but the standards have been mostly within a single space mission at a time, at times…
Radio astronomy observational facilities are under constant upgradation and development to achieve better capabilities including increasing the time and frequency resolutions of the recorded data, and increasing the receiving and recording…
As software has become an integral part of scientific workflows, reproducible research practices must take it into account. In what way? Archiving source code is a necessary but insufficient condition. The ability to redeploy software…
We present a final description of the data-processing pipeline for the Planck, Low Frequency Instrument (LFI), implemented for the 2018 data release. Several improvements have been made with respect to the previous release, especially in…