Related papers: Adaptive Data Reduction Workflows for Astronomy --…
Due to the Internet of Everything (IoE), data generated in our life become larger. As a result, we need more effort to analyze the data and extract valuable information. In the cloud computing environment, all data analysis is done in the…
SOFIA presents a number of interesting challenges for the development of a data reduction environment which, at its initial phase, will have to incorporate pipelines from seven different instruments. Therefore, the SOFIA data reduction…
Atmospheric spectroscopy of extrasolar planets is an intricate business. Atmospheric signatures typically require a photometric precision of $1 \times 10^{-4}$ in flux over several hours. Such precision demands high instrument stability as…
Data reduction procedures are aimed to minimize the impact of data acquisition imperfections on the measurement of data properties with a scientific meaning for the astronomer. To achieve this purpose, appropriate arithmetic manipulations…
Data processing pipelines represent an important slice of the astronomical software library that include chains of processes that transform raw data into valuable information via data reduction and analysis. In this work we present Corral,…
The Argus Optical Array is a synoptic survey observatory, currently in development, that will have a total collecting area equivalent to a 5-meter monolithic telescope and an all-sky field of view, multiplexed from 900 commercial…
In this paper we present the Data Processor (DP) of EUSO-SPB2 (Extreme Universe Space Observatory on a Super Pressure Balloon, mission two) telescopes . The EUSO-SPB2 is the continuation of the JEM-EUSO science program on ultra-long…
SpectraPy is an Astropy affiliated package for spectroscopic data reduction. It collects algorithms and methods for data reduction of astronomical spectra obtained by through-slits spectrographs. It has been created to fill the gap in…
The CHaracterizing ExOPlanet Satellite (CHEOPS), to be launched in December 2019, will detect and characterize small size exoplanets via ultra high precision photometry during transits. CHEOPS is designed as a follow-up telescope and…
The intelligent Distributed Dispatch and Scheduling (iDDS) service is a versatile workflow orchestration system designed for large-scale, distributed scientific computing. iDDS extends traditional workload and data management by integrating…
Earth observation satellites (EOSs) play a pivotal role in capturing and analyzing planetary phenomena, ranging from natural disasters to societal development. The EOS scheduling problem (EOSSP), which optimizes the schedule of EOSs, is…
Leadership computing facilities around the world support cutting-edge scientific research across a broad spectrum of disciplines including understanding climate change, combating opioid addiction, or simulating the decay of a neutron. While…
The Cosmology Data Management system (CosmoDM) is an automated and flexible data management system for the processing and calibration of data from optical photometric surveys. It is designed to run on supercomputers and to minimize disk I/O…
One of the most important changes in observational astronomy of the 21st Century is a rapid shift from classical object-by-object observations to extensive automatic surveys. As CCD detectors are getting better and their prices are getting…
As part of an on-going effort to simplify the data analysis path for VLBI experiments, a pipeline procedure has been developed at JIVE to carry out much of the data reduction required for EVN experiments in an automated fashion. This…
The JEM-EUSO Collaboration aims at studying Ultra High Energy Cosmic Rays (UHECR) from space. To reach this goal, a series of pathfinder missions has been developed to prove the observation principle and to raise the technological readiness…
Within the ESPRESSO project a new flexible data reduction library is being built. ESPRESSO, the Echelle SPectrograph for Rocky Exoplanets and Stable Spectral Observations is a fiber-fed, high-resolution, cross-dispersed echelle…
We explore how astronomers take observational data from telescopes, process them into usable scientific data products, curate them for later use, and reuse data for further inquiry. Astronomers have invested heavily in knowledge…
We present a technique to automatically minimise the re-computation when a data processing program is iteratively changed, or added to, as is often the case in exploratory data analysis in radio astronomy. A typical example is flagging and…
Major advancements in fields as diverse as biology and quantum computing have relied on a multitude of microscopic techniques. All optical, electron and scanning probe microscopy advanced with new detector technologies and integration of…