Related papers: The human pipeline: distributed data reduction for…

The Atacama Large Millimeter/sub-millimeter Array (ALMA) is already revolutionising our understanding of the Universe. However, ALMA is not yet equipped with all of its originally planned receiver bands, which will allow it to observe over…

CASA, the Common Astronomy Software Applications, is the primary data processing software for the Atacama Large Millimeter/submillimeter Array (ALMA) and the Karl G. Jansky Very Large Array (VLA), and is frequently used also for other radio…

CCAT will be a large sub-millimeter telescope to be built near the ALMA site in northern Chile. The telescope must support a varied set of instrumentation including large format KID cameras, a large heterodyne array and a KID-based direct…

We describe the design, construction, and characterization of the Band 9 heterodyne receivers (600-720 GHz) for the Atacama Large Millimeter / submillimeter Array (ALMA). The ALMA Band 9 receiver units ("cartridges"), which are installed in…

Experimental life sciences like biology or chemistry have seen in the recent decades an explosion of the data available from experiments. Laboratory instruments become more and more complex and report hundreds or thousands measurements for…

Radio telescope arrays are interferometers and thus require coherent capture and processing of the signal from the astronomical source being observed. In ALMA this is accomplished by using a clock at each antenna for down-conversion and…

We introduce a data reduction package written in Interactive Data Language (IDL) for the Magellan Echellete Spectrograph (MAGE). MAGE is a medium-resolution (R ~4100), cross-dispersed, optical spectrograph, with coverage from ~3000-10000…

We present GRAPHIC, a new angular differential imaging (ADI) reduction pipeline where all geometric image operations are based on Fourier transforms. To achieve this goal the entire pipeline is parallelised making it possible to reduce…

One of the science drivers of the new Low Frequency Array (LOFAR) is large-area surveys of the low-frequency radio sky. Realizing this goal requires automated processing of the interferometric data, such that fully calibrated images are…

High-resolution observations of the solar chromosphere at millimeter wavelengths are now possible with the Atacama Large Millimeter Array (ALMA), promising to tackle many open problems in solar physics. Observations from other ground and…

Machine learning (ML) offers powerful methods for detecting and modeling associations often in data with large feature spaces and complex associations. Many useful tools/packages (e.g. scikit-learn) have been developed to make the various…

We describe principal components of the new spectroscopic data pipeline for the multi-object MMT/Magellan Infrared Spectrograph (MMIRS). The pipeline is implemented in IDL and C++. The performance of the data processing algorithms is…

The production of science-ready data from major solar telescopes requires expertise beyond that of the typical observer. This is a consequence of the increasing complexity of instruments and observing sequences, which require calibrations…

The availability of both structured and unstructured databases, such as electronic health data, social media data, patent data, and surveys that are often updated in real time, among others, has grown rapidly over the past decade. With this…

The ASTRA Cassegrain Spectrophotometer and its automated 0.5-m telescope at Fairborn Observatory in Arizona will produce a large quantity of high precision stellar flux distributions. A separate paper (Adelman et al. 2007) presented a…

Atacama Large Millimeter/Submillimeter Array (ALMA) is promising to be a powerful tool for precision astrometry of the area around Sagittarius A$^\ast$ (Sgr A$^\ast$) because it has the high angular resolution, high sensitivity, and wide…

SIPGI is a spectroscopic pipeline for the data reduction of optical/near-infrared data acquired by slit-based spectrographs. SIPGI is a complete spectroscopic data reduction environment retaining the high level of flexibility and accuracy…

KMOS is a multi-object near-infrared integral field spectrometer with 24 deployable pick-off arms. Data processing is inevitably complex. We discuss specific issues and requirements that must be addressed in the data reduction pipeline, the…

We investigate the role of asymmetries in the line spread function of the 2-degree field spectrograph and the variations in these asymmetries with the CCD, the plate, the time of observation and the fibre. A data-reduction pipeline is…

We present VIPGI, an automatized human supervised reduction environment, developed within the VIRMOS project to handle VIMOS guaranteed time data. VIPGI is now offered to the international community to be used on site in Milano and…