Related papers: Spectroscopic surveys:a different approach to data…

We present the design and implementation of an automated data calibration and reduction pipeline for very-long-baseline interferometric (VLBI) observations taken at millimeter wavelengths. These short radio-wavelengths provide the best…

We present in this paper the general formalism and data processing steps used in the MATISSE data reduction software, as it has been developed by the MATISSE consortium. The MATISSE instrument is the mid-infrared new generation…

This paper describes the general characteristics of raw data from fiber-fed spectrographs in general and fiber-fed IFUs in particular. The different steps of the data reduction are presented, and the techniques used to address the unusual…

The main scientific characteristic of VIMOS (VIsible Multi Object Spectrograph, to be placed on ESO Very Large Telescope) is its high multiplexing capability, allowing astronomers to obtain up to 800 spectra per exposure. To fully exploit…

Statistical models are central to machine learning with broad applicability across a range of downstream tasks. The models are controlled by free parameters that are typically estimated from data by maximum-likelihood estimation or…

The interferometric data processing methods that we describe in this paper use a number of innovative techniques. In particular, the implementation of the wavelet transform allows us to obtain a good immunity of the fringe processing to…

In order to increase the effectiveness of model training, data reduction is essential to data-centric Artificial Intelligence (AI). It achieves this by locating the most instructive examples in massive datasets. To increase data quality and…

We present SPIFFI, the integral field spectrometer for the VLT. This instrument allows simultaneous observation of infrared spectra in more than 1000 image points of a two dimensional field. With its set of four gratings and a pixel scale…

High-dimensional multimodal data arises in many scientific fields. The integration of multimodal data becomes challenging when there is no known correspondence between the samples and the features of different datasets. To tackle this…

We present a description of the design and usage of a new synoptic pipeline and database model for time series photometry in the VISTA Data Flow System (VDFS). All UKIRT-WFCAM data and most of the VISTA main survey data will be processed…

The effectiveness of scaling up training data in robotic manipulation is still limited. A primary challenge in manipulation is the tasks are diverse, and the trained policy would be confused if the task targets are not specified clearly.…

The rapid growth of solar data is driving changes in the typical workflow and algorithmic approach to solar data analysis. We present recently deployed tools to aid this evolution and layout the path for future development. The majority of…

We introduce a learning-based depth map fusion framework that accepts a set of depth and confidence maps generated by a Multi-View Stereo (MVS) algorithm as input and improves them. This is accomplished by integrating volumetric visibility…

The scientific goals of the AMIGA project are based on the analysis of a significant amount of spectroscopic 3D data. In order to perform this work we present an initiative to develop a new VO compliant package, including present core…

The US National Gemini Office (US NGO), part of the Community Science and Data Center (CSDC) at NSF's NOIRLab, has completed a project to upgrade the IRAF-based Gemini reduction software to provide a fully supported system capable of…

The Gemini Planet Imager Exoplanet Survey (GPIES) is a multi-year direct imaging survey of 600 stars to discover and characterize young Jovian exoplanets and their environments. We have developed an automated data architecture to process…

Today, huge amounts of data are being collected with spatial and temporal components from sources such as meteorological, satellite imagery etc. Efficient visualisation as well as discovery of useful knowledge from these datasets is…

In an era where big and high-dimensional data is readily available, data scientists are inevitably faced with the challenge of reducing this data for expensive downstream computation or analysis. To this end, we present here a new method…

We release the spectra for the more than 57000 objects presented in the First VIPERS Data Release. For each object we distribute the observed, wavelength and flux calibrated spectrum, as well as cleaned spectra, where artifacts due to…

ScopeSim is a flexible multipurpose instrument data simulation framework built in Python. It enables both raw and reduced observation data to be simulated for a wide range of telescopes and instruments quickly and efficiently on a personal…