English
Related papers

Related papers: A data model to connect the ESO Data Processing Sy…

200 papers

We explore the crucial interplay between climate change and power system planning, highlighting the urgent need to systematically integrate climate information into energy system studies. Climate change impacts the energy sector on multiple…

Atmospheric and Oceanic Physics · Physics 2026-05-05 Laurent Dubus , Alberto Troccoli , Aron zuiker , Laurens Stoop

ESPRESSO is an extremely stable high-resolution spectrograph which is currently being developed for the ESO VLT. With its groundbreaking characteristics it is aimed to be a "science machine", i.e. a fully-integrated instrument to directly…

We present EPT-2, the latest iteration in our Earth Physics Transformer (EPT) family of foundation AI models for Earth system forecasting. EPT-2 delivers substantial improvements over its predecessor, EPT-1.5, and sets a new state of the…

We present the design and implementation of an automated data calibration and reduction pipeline for very-long-baseline interferometric (VLBI) observations taken at millimeter wavelengths. These short radio-wavelengths provide the best…

The SINFONI data reduction pipeline, as part of the ESO-VLT Data Flow System, provides recipes for Paranal Science Operations, and for Data Flow Operations at Garching headquarters. At Paranal, it is used for the quick-look data evaluation.…

Advances in technology and computing hardware are enabling scientists from all areas of science to produce massive amounts of data using large-scale simulations or observational facilities. In this era of data deluge, effective coordination…

Databases · Computer Science 2015-03-31 Spyros Blanas , Surendra Byna

Achieving a percentage-level precision measurement of the Coherent Elastic Neutrino Nucleus Scattering (CE{\nu}NS) spectrum requires a robust data processing pipeline which can be characterised with great precision. To fulfil this goal we…

Instrumentation and Detectors · Physics 2022-12-14 J. Colas , J. Billard , S. Ferriol , J. Gascon , T. Salagnac

The preparation of the long-term telescope schedule follows the submission and scientific review of new proposals. At the European Southern Observatory (ESO) this process entails scheduling the scientific proposals according to their…

Instrumentation and Methods for Astrophysics · Physics 2024-07-23 M. Rejkuba , O. R. Hainaut , T. Bierwirth , M. Pruemm , A. Weiss

The Internet of Things (IoT) is offering unprecedented observational data that are used for managing Smart City utilities. Edge and Fog gateway devices are an integral part of IoT deployments to acquire real-time data and enact controls.…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-10 Pushkara Ravindra , Aakash Khochare , Siva Prakash Reddy , Sarthak Sharma , Prateeksha Varshney , Yogesh Simmhan

The HIFI data processing pipeline was developed to systematically process diagnostic, calibration and astronomical observations taken with the HIFI science instrumentas part of the Herschel mission. The HIFI pipeline processed data from all…

Instrumentation and Methods for Astrophysics · Physics 2019-05-13 K. Edwards , R. F. Shipman , D. Kester , A. Lorenzani , M. Melchior

In this short paper we propose to extend the ETAS model to micro-seismic events. For that we interpret the triggered events in an ETAS model as individual local clock advances of an independent background process. The solution of the ETAS…

Geophysics · Physics 2025-01-07 Matthias Holschneider

PyCPL provides full access to ESO's Common Pipeline Library ( CPL) for astronomical data reduction within a Python environment. Not only does it offer a Python interface to the robust CPL library, but it also lets users and developers fully…

Instrumentation and Methods for Astrophysics · Physics 2024-04-03 Mrunmayi S. Deshpande , Nuria P. F. Lorente , Anthony Horton , Brent Miszalski , Ralf Palsa , Lars Lundin , Anthony Heng , Aidan Farrell

Remote sensing satellites capture the cyclic dynamics of our Planet in regular time intervals recorded in satellite time series data. End-to-end trained deep learning models use this time series data to make predictions at a large scale,…

Machine Learning · Computer Science 2022-12-23 Marc Rußwurm , Nicolas Courty , Rémi Emonet , Sébastien Lefèvre , Devis Tuia , Romain Tavenard

We present the Rubin Observatory system for data storage/retrieval and pipelined code execution. The layer for data storage and retrieval is named the Butler. It consists of a relational database, known as the registry, to keep track of…

The MIMIC-IV dataset is a large, publicly available electronic health record (EHR) resource widely used for clinical machine learning research. It comprises multiple modalities, including structured data, clinical notes, waveforms, and…

Machine Learning · Computer Science 2026-01-21 Farzana Islam Adiba , Varsha Danduri , Fahmida Liza Piya , Ali Abbasi , Mehak Gupta , Rahmatollah Beheshti

Data processing pipelines represent an important slice of the astronomical software library that include chains of processes that transform raw data into valuable information via data reduction and analysis. In this work we present Corral,…

Instrumentation and Methods for Astrophysics · Physics 2017-08-09 Juan B. Cabral , Bruno Sánchez , Martín Beroiz , Mariano Domínguez , Marcelo Lares , Sebastián Gurovich , Pablo Granitto

Advances in Earth observation (EO) foundation models have unlocked the potential of big satellite data to learn generic representations from space, benefiting a wide range of downstream applications crucial to our planet. However, most…

The increasing adoption of low-cost environmental sensors and AI-enabled applications has accelerated the demand for scalable and resilient data infrastructures, particularly in data-scarce and resource-constrained regions. This paper…

Conventional power system reliability suffers from the long run time of Monte Carlo simulation and the dimension-curse of analytic enumeration methods. This paper proposes a preliminary investigation on end-to-end machine learning for…

Machine Learning · Computer Science 2022-05-31 Yongli Zhu , Chanan Singh

We present results of performance modelling for METIS, the Mid-infrared European Extremely Large Telescope (E-ELT) Imager and Spectrograph. Designed by a consortium of NOVA (Netherlands), UK Astronomy Technology Centre (UK), MPIA Heidelberg…

Instrumentation and Methods for Astrophysics · Physics 2015-05-19 Sarah Kendrew , Laurent Jolissaint , Bernhard Brandl , Rainer Lenzen , Eric Pantin , Alistair Glasse , Joris Blommaert , Lars Venema , Ralf Siebenmorgen , Frank Molster