Related papers: Automated data reduction workflows for astronomy
The SINFONI data reduction pipeline, as part of the ESO-VLT Data Flow System, provides recipes for Paranal Science Operations, and for Data Flow Operations at Garching headquarters. At Paranal, it is used for the quick-look data evaluation.…
Modern scientific simulations, observations, and large-scale experiments generate data at volumes that often exceed the limits of storage, processing, and analysis. This challenge drives the development of data reduction methods that…
Scientific workflows process extensive data sets over clusters of independent nodes, which requires a complex stack of infrastructure components, especially a resource manager (RM) for task-to-node assignment, a distributed file system…
As the demand for software to support the processing and analysis of massive radio astronomy datasets increases in the era of the SKA, we demonstrate the interactive workflow building, data mining, processing, and visualisation capabilities…
We present PyWiFeS, a new Python-based data reduction pipeline for the Wide Field Spectrograph (WiFeS). PyWiFeS consists of a series of core data processing routines built on standard scientific Python packages commonly used in astronomical…
Modern robotic manipulation systems fall short of human manipulation skills partly because they rely on closing feedback loops exclusively around vision data, which reduces system bandwidth and speed. By developing autonomous grasping…
OSIRIS is a near-infrared (1.0--2.4 $\mu$m) integral field spectrograph operating behind the adaptive optics system at Keck Observatory, and is one of the first lenslet-based integral field spectrographs. Since its commissioning in 2005, it…
In this work, we present LensingFlow. This is an implementation of an automated workflow to search for evidence of gravitational lensing in a large series of gravitational wave events. This workflow conducts searches for evidence in all…
We present VIPGI, an automatized human supervised reduction environment, developed within the VIRMOS project to handle VIMOS guaranteed time data. VIPGI is now offered to the international community to be used on site in Milano and…
Modern astronomical experiments are designed to achieve multiple scientific goals, from studies of galaxy evolution to cosmic acceleration. These goals require data of many different classes of night-sky objects, each of which has a…
We have used an existing, robotic, multi-lens, all-sky camera system, coupled to a dedicated data reduction pipeline, to automatically determine orbital parameters of satellites in Low Earth Orbit (LEO). Each of the fixed cameras has a…
A concept of the ground-based optical astronomical observations efficiency is considered in this paper. We believe that a telescope efficiency can be increased by properly allocating observation tasks with respect to the current environment…
Not only source catalogs are extracted from astronomy observations. Their sky coverage is always carefully recorded and used in statistical analyses, such as correlation and luminosity function studies. Here we present a novel method for…
The intelligent Distributed Dispatch and Scheduling (iDDS) service is a versatile workflow orchestration system designed for large-scale, distributed scientific computing. iDDS extends traditional workload and data management by integrating…
The shear volumes of data generated from earth observation and remote sensing technologies continue to make major impact; leaping key geospatial applications into the dual data and compute intensive era. As a consequence, this rapid…
Reactive trajectory optimization for robotics presents formidable challenges, demanding the rapid generation of purposeful robot motion in complex and swiftly changing dynamic environments. While much existing research predominantly…
In this paper, we present a novel method for synthesising an optimal distributed spatial regret controller using experimentally obtained frequency-response data. Spatial regret provides a measure of the performance gap between a structured…
Autonomous robots operating in dynamic environments must maintain beliefs over a hypothesis space that is rich enough to represent the activities of interest at different scales. This is important both in order to accommodate the…
Within the ESPRESSO project a new flexible data reduction library is being built. ESPRESSO, the Echelle SPectrograph for Rocky Exoplanets and Stable Spectral Observations is a fiber-fed, high-resolution, cross-dispersed echelle…
SpectraPy is an Astropy affiliated package for spectroscopic data reduction. It collects algorithms and methods for data reduction of astronomical spectra obtained by through-slits spectrographs. It has been created to fill the gap in…