Related papers: The Data Processing Pipeline for the MUSE Instrume…

The newly installed Silmaril beam combiner at the CHARA array is designed to observe previously inaccessible faint targets, including Active Galactic Nuclei and T-Tauri Young Stellar Objects. Silmaril leverages cutting-edge optical design,…

The primary task of the 1.26-m telescope jointly operated by the National Astronomical Observatory and Guangzhou University is photometric observations of the g, r, and i bands. A data processing pipeline system was set up with mature…

This paper describes the general characteristics of raw data from fiber-fed spectrographs in general and fiber-fed IFUs in particular. The different steps of the data reduction are presented, and the techniques used to address the unusual…

We present an overview of the 'ICE' hardware and software framework that implements large arrays of interconnected FPGA-based data acquisition, signal processing and networking nodes economically. The system was conceived for application to…

In this paper, we describe the optical imaging data processing pipeline developed for the Subaru Telescope's Hyper Suprime-Cam (HSC) instrument. The HSC Pipeline builds on the prototype pipeline being developed by the Large Synoptic Survey…

The World Space Observatory - Ultraviolet (WSO-UV) space telescope is equipped with high dispersion (55,000) spectrographs working in the 1150-3100 {\AA} spectral range. To evaluate the impact of the design on the scientific objectives of…

A fast-turnaround pipeline for realtime data reduction plays an essential role in discovering and permitting follow-up observations to young supernovae and fast-evolving transients in modern time-domain surveys. In this paper, we present…

This work brings together some of the most common machine learning (ML) algorithms, and the objective is to make a comparison at the level of obtained results from a set of unbalanced data. This dataset is composed of almost 17 thousand…

Time domain astronomy has both increased the data volume and the urgency of data reduction in recent years. Spectra provide key insights into astrophysical phenomena but require complex reductions. Las Cumbres Observatory has six…

Data processing pipelines represent an important slice of the astronomical software library that include chains of processes that transform raw data into valuable information via data reduction and analysis. In this work we present Corral,…

Optimizing one's observing strategy while at the telescope relies on knowing the current observing conditions and the obtained data quality. In particular the latter is not straight forward with current wide-field imagers, such as the WIYN…

We describe the data reduction algorithms for the Multiband Imaging Photometer for Spitzer (MIPS) instrument. These algorithms were based on extensive preflight testing and modeling of the Si:As (24 micron) and Ge:Ga (70 and 160 micron)…

Optimizing data-intensive workflow execution is essential to many modern scientific projects such as the Square Kilometre Array (SKA), which will be the largest radio telescope in the world, collecting terabytes of data per second for the…

The input data pipeline is an essential component of each machine learning (ML) training job. It is responsible for reading massive amounts of training data, processing batches of samples using complex transformations, and loading them onto…

Orchestrating parametric fitting of multicomponent spectra at scale is an essential yet underappreciated task in high-throughput quantification of materials and chemical composition. To automate the annotation process for spectroscopic and…

TOU is an extremely high resolution optical spectrograph (R=$100,000$, 380-900~nm), which is designed to detect low mass exoplanets using the radial velocity technique.We describe an IDL-based radial velocity (RV) data reduction pipeline…

We present a convenient, all-in-one framework for the scientific analysis of fully reduced, (integral-field) spectroscopic data. The GIST pipeline (Galaxy IFU Spectroscopy Tool) is entirely written in Python3 and conducts all steps from the…

In this decade astronomy is undergoing a paradigm shift to handle data from next generation observatories such as the Square Kilometre Array (SKA) or the Vera C. Rubin Observatory (LSST). Producing real time data streams of up to 10 TB/s…

In entomology and ecology research, biologists often need to collect a large number of insects, among which beetles are the most common species. A common practice for biologists to organize beetles is to place them on trays and take a…

The FORS1 instrument on the ESO Very Large Telescope was used to obtain low-resolution circular polarised spectra of nearly a thousand different stars, with the aim of measuring their mean longitudinal magnetic fields. A catalogue of FORS1…