Related papers: Adaptive Data Reduction Workflows for Astronomy --…
Data from complex modern astronomical instruments often consist of a large number of different science and calibration files, and their reduction requires a variety of software tools. The execution chain of the tools represents a complex…
We extend the data-driven approach for astronomical pipelines to the METIS instrument and integrate the ESO Data Processing System (EDPS) by adapting it to support backward chaining.
Written in Python and utilising ParselTongue to interface with the Astronomical Image Processing System (AIPS), the e-MERLIN data reduction pipeline is intended to automate the procedures required in processing and calibrating radio…
The recently released Reflex scientific workflow environment supports the interactive execution of ESO VLT data reduction pipelines. Reflex is based upon the Kepler workflow engine, and provides components for organising the data, executing…
This paper provides a case study on satellite data processing, storage, and distribution in the space weather domain by introducing the Satellite Data Downloading System (SDDS). The approach proposed in this paper was evaluated through…
Processing of raw data from modern astronomical instruments is nowadays often carried out using dedicated software, so-called "pipelines" which are largely run in automated operation. In this paper we describe the data reduction pipeline of…
To reduce and analyze astronomical images, astronomers can rely on a wide range of libraries providing low-level implementations of legacy algorithms. However, combining these routines into robust and functional pipelines requires a major…
The Stratospheric Observatory for Infrared Astronomy (SOFIA) is an airborne astronomical observatory comprised of a 2.5-meter telescope mounted in the aft section of a Boeing 747SP aircraft. During routine operations, several instruments…
The amdlib AMBER data reduction software is meant to produce AMBER data products from the raw data files that are sent to the PIs of different proposals or that can be found in the ESO data archive. The way defined by ESO to calibrate the…
High-resolution spectrographs open a detailed window onto the atmospheres of stars and planets. As the number of systems observed with different instruments grows, it is crucial to develop a standard in analyzing spectral time series of…
The VISIONS public survey provides large-scale, multiepoch imaging of five nearby star-forming regions at subarcsecond resolution in the near-infrared. All data collected within the program and provided by the European Southern Observatory…
The Pan-STARRS Data Processing System is responsible for the steps needed to downloaded, archive, and process all images obtained by the Pan-STARRS telescopes, including real-time detection of transient sources such as supernovae and moving…
The Galactic O-Star Spectroscopic Survey (GOSSS) is an ambitious project that is observing all known Galactic O stars with B < 13 in the blue-violet part of the spectrum with R-2500. It is based on version 2 of the most complete catalog to…
PyCPL provides full access to ESO's Common Pipeline Library ( CPL) for astronomical data reduction within a Python environment. Not only does it offer a Python interface to the robust CPL library, but it also lets users and developers fully…
Data processing pipelines need to be executed at scales ranging from small runs up through large production data release runs resulting in millions of data products. As part of the Rubin Observatory's pipeline execution system, BPS is the…
Here, I present the community with exoTEDRF (EXOplanet Transit and Eclipse Data Reduction Framework; formerly known as supreme-SPOON), an end-to-end pipeline for data reduction and light curve analysis of time series observations (TSOs) of…
We have written an automatic image processing pipeline for the Advanced Camera for Surveys (ACS) Guaranteed Time Observation (GTO) program. The pipeline, known as Apsis, supports the different cameras available on the ACS instrument and is…
We present PyWiFeS, a new Python-based data reduction pipeline for the Wide Field Spectrograph (WiFeS). PyWiFeS consists of a series of core data processing routines built on standard scientific Python packages commonly used in astronomical…
Spectroscopic surveys are undergoing a rapid expansion in their data collecting capabilities, reaching the level of hundreds of spectra per pointing. An efficient use of such huge amounts of information requires a high degree of…
The SINFONI data reduction pipeline, as part of the ESO-VLT Data Flow System, provides recipes for Paranal Science Operations, and for Data Flow Operations at Garching headquarters. At Paranal, it is used for the quick-look data evaluation.…