Related papers: The ALMA Interferometric Pipeline Heuristics

Calibrating large volumes of Very Long Baseline Interferometry (VLBI) data traditionally requires significant human intervention at every stage. While the Common Astronomy Software Applications (CASA) package is the standard data reduction…

The analyst effort in data cleaning is gradually shifting away from the design of hand-written scripts to building and tuning complex pipelines of automated data cleaning libraries. Hyper-parameter tuning for data cleaning is very different…

We introduce an Analyze-Revise-Finetune (ARF) pipeline that enables smaller open-source language models (LLMs) to surpass substantially larger proprietary models in customer service summarization tasks. The pipeline first analyzes and…

The Herschel Common Science System (HCSS) (Ott et al. 2006) (Ott & Science Ground Segment Consortium 2010) is a substantial Java software package, accompanying the development of the Herschel Mission (Pilbratt et al. 2010), supporting all…

Atacama Large Millimeter/submillimeter Array (ALMA) will be the world largest mm/submm interferometer, and currently the Early Science is ongoing, together with the commissioning and science verification (CSV). Here we present a study of…

Modern astronomical data processing requires complex software pipelines to process ever growing datasets. For radio astronomy, these pipelines have become so large that they need to be distributed across a computational cluster. This makes…

We describe the software requirement and design specifications for all-sky panoramic astronomical pipelines. The described software aims to meet the specific needs of super-wide angle optics, and includes cosmic-ray hit rejection, image…

In the past decade, transcriptome data have become an important component of many phylogenetic studies. Phylogenetic studies now regularly include genes from newly sequenced transcriptomes, as well as publicly available transcriptomes and…

We have designed and implemented a novel way to process wide-field astronomical data within a distributed environment of hardware resources and humanpower. The system is characterized by integration of archiving, calibration, and…

IOP4 is a pipeline to perform photometry and polarimetry analysis of optical data from Calar Alto (CAHA) and Sierra Nevada (OSN) observatories. IOP4 implements Object Relational Mapping (ORM) to seamlessly integrate all information about…

The Atacama Large Millimeter/submillimeter Array (ALMA), presently under construction, is a revolutionary astronomical interferometer, that will operate at (sub)millimeter wavelengths. With unprecedented sensitivity, resolution, and imaging…

We present the data reduction procedures being used by the GALAH survey, carried out with the HERMES fibre-fed, multi-object spectrograph on the 3.9~m Anglo-Australian Telescope. GALAH is a unique survey, targeting 1 million stars brighter…

CASA, the Common Astronomy Software Applications, is the primary data processing software for the Atacama Large Millimeter/submillimeter Array (ALMA) and the Karl G. Jansky Very Large Array (VLA), and is often used also for other radio…

We are reporting the updates in version 0.2.0 of the Automated SpectroPhotometric REDuction (ASPIRED) pipeline, designed for common use on different instruments. The default settings support many typical long-slit spectrometer…

In this paper, we describe the optical imaging data processing pipeline developed for the Subaru Telescope's Hyper Suprime-Cam (HSC) instrument. The HSC Pipeline builds on the prototype pipeline being developed by the Large Synoptic Survey…

Currently, HOPS and AIPS are the primary choices for the time-consuming process of (millimeter) Very Long Baseline Interferometry (VLBI) data calibration. However, for a full end-to-end pipeline, they either lack the ability to perform…

The scientific impact of a facility is the most important measure of its success. Monitoring and analysing the scientific return can help to modify and optimise operations and adapt to the changing needs of scientific research. The…

Building on the "drPACS" contribution at ADASS XX of a simple Unix pipeline infrastructure, we implemented a pipeline toolkit using the package MIRIAD to combine Interferometric and Single Dish data (MIS). This was prompted by our…

Tropical algebra, including max-plus, min-plus, and related idempotent semirings, provides a unifying framework in which many optimization problems that are nonlinear in classical algebra become linear. This property makes tropical methods…

ALMA is estimated to generate TB scale data during only one observation; astronomers manage to identify which part of the data they are really interested in. Now we have been developing new GUI software for this purpose utilizing the VO…