Related papers: The ALMA Interferometric Pipeline Heuristics
In this paper we describe an unmanned aerial system equipped with a thermal-infrared camera and software pipeline that we have developed to monitor animal populations for conservation purposes. Taking a multi-disciplinary approach to tackle…
We explore how astronomers take observational data from telescopes, process them into usable scientific data products, curate them for later use, and reuse data for further inquiry. Astronomers have invested heavily in knowledge…
The CALMA (Computer Assisted Library for MAmmography) project is a five years plan developed in a physics research frame in collaboration between INFN (Istituto Nazionale di Fisica Nucleare) and many Italian hospitals. At present a large…
The HERMES Technologic and Scientific Pathfinder project is a constellation of six CubeSats aiming to observe transient high-energy events such as the Gamma Ray Bursts (GRBs). HERMES will be the first space telescope to include a siswich…
The digital revolution is transforming astronomy from a data-starved to a data-submerged science. Instruments such as the Atacama Large Millimeter Array (ALMA), the Large Synoptic Survey Telescope (LSST), and the Square Kilometer Array…
ALMA products are stored in the Science Archive in the form of FITS images. It is a common idea that the FITS image headers should collect in their keywords all the information that an archive User might want to search for in order to…
The present document outlines a roadmap for future developments that will significantly expand ALMA's capabilities and enable it to produce even more exciting science in the coming decades. The proposed developments are motivated by the…
Network log data analysis plays a critical role in detecting security threats and operational anomalies. Traditional log analysis methods for anomaly detection and root cause analysis rely heavily on expert knowledge or fully supervised…
New and upgraded radio interferometers produce data at massive rates and will require significant improvements in analysis techniques to reach their promised levels of performance in a routine manner. Until these techniques are fully…
During more than 17 years of operation in space INTEGRAL telescope has accumulated large data set that contains records of hard X-ray and soft gamma-ray astronomical sources. These data can be re-used in the context of multi-wavelength or…
The production of science-ready data from major solar telescopes requires expertise beyond that of the typical observer. This is a consequence of the increasing complexity of instruments and observing sequences, which require calibrations…
The development of the Atacama Large Millimeter/submillimeter Array (ALMA) phasing system (APS) has allowed ALMA to function as an extraordinarily sensitive station for very long baseline interferometry (VLBI) at frequencies of up to 230…
ObsMode is a yearly process which aims at preparing capabilities for future ALMA Observing cycles. The process has been running for a number of years tied to each ALMA observing cycle, with various leaderships. This document specifically…
Traditional data processing pipelines are typically static and handcrafted for specific tasks, limiting their adaptability to evolving requirements. While general-purpose agents and coding assistants can generate code for well-understood…
We introduce a novel way to extract information from turbulent datasets by applying an ARMA statistical analysis. Such analysis goes well beyond the analysis of the mean flow and of the fluctuations and links the behavior of the recorded…
Heterodyne receivers register the sky signal on either a circular polarization basis (where it is split into left-hand and right-hand circular polarization) or a linear polarization basis (where it is split into horizontal and vertical…
Implementation details and test cases of a newly developed hydrodynamic code, AMRA, are presented. The numerical scheme exploits the adaptive mesh refinement technique coupled to modern high-resolution schemes which are suitable for…
I present the Automated Line Fitting Algorithm, ALFA, a new code which can fit emission line spectra of arbitrary wavelength coverage and resolution, fully automatically. In contrast to traditional emission line fitting methods which…
Modern telescopes generate increasingly large and diverse datasets, often consisting of complex and morphologically rich structures. To efficiently explore such data requires automated methods that can extract and organize physically…
Hyperparameter tuning of multi-stage pipelines introduces a significant computational burden. Motivated by the observation that work can be reused across pipelines if the intermediate computations are the same, we propose a pipeline-aware…