Related papers: A data model to connect the ESO Data Processing Sy…

This paper presents a multi-stage expansion model for the co-planning of transmission lines, battery energy storage (ES), and wind power plants (WPP). High penetration of renewable energy sources (RES) is integrated into the proposed model…

Edge Computing (EC) offers an infrastructure that acts as the mediator between the Cloud and the Internet of Things (IoT). The goal is to reduce the latency that we enjoy when relying on Cloud. IoT devices interact with their environment to…

We have designed and implemented a novel way to process wide-field astronomical data within a distributed environment of hardware resources and humanpower. The system is characterized by integration of archiving, calibration, and…

CHARIS is an IFS designed for imaging and spectroscopy of disks and sub-stellar companions. To improve ease of use and efficiency of science production, we present progress on a fully-automated backend for CHARIS. This Automated Data…

DREAMS (Dust Characterisation, Risk Assessment, and Environment Analyser on the Martian Surface) is a payload accommodated on the Schiaparelli Entry and Descent Module (EDM) of ExoMars 2016, the ESA and Roscosmos mission to Mars (Esposito…

We implemented a real-time data processor (rta-dp) framework that can be used to develop real-time analysis pipelines and data handling systems to manage high-throughput data streams with distributed applications in the context of ground…

The CEDAR collaboration is extending and combining the JetWeb and HepData systems to provide a single service for tuning and validating models of high-energy physics processes. The centrepiece of this activity is the fitting by JetWeb of…

To address the challenges associated with data processing at scale, we propose Dataverse, a unified open-source Extract-Transform-Load (ETL) pipeline for large language models (LLMs) with a user-friendly design at its core. Easy addition of…

Data from complex modern astronomical instruments often consist of a large number of different science and calibration files, and their reduction requires a variety of software tools. The execution chain of the tools represents a complex…

We present our numerical simulation approach for the End-to-End (E2E) model applied to various astronomical spectrographs, such as SOXS (ESO-NTT), CUBES (ESO-VLT), and ANDES (ESO-ELT), covering multiple wavelength regions. The E2E model aim…

The marine environment is one of the most important sources for microbial biodiversity on the planet. These microbes are drivers for many biogeochemical processes, and their enormous genetic potential is still not fully explored or…

I present spherical (https://github.com/m-samland/spherical), a software package and database designed for the ESO VLT/SPHERE high-contrast imager. SPHERE has produced the world's largest archive of direct imaging observations of exoplanets…

Advanced imitation learning with structures like the transformer is increasingly demonstrating its advantages in robotics. However, deploying these large-scale models on embedded platforms remains a major challenge. In this paper, we…

The Data Handling Pipeline ("Pipeline") has been developed for the Fermi Gamma-Ray Space Telescope (Fermi) Large Area Telescope (LAT) which launched in June 2008. Since then it has been in use to completely automate the production of data…

Users of the La Silla Paranal Observatory have to rely on the ESO Exposure Time Calculator (ETC) to prepare their observations. A project has been started at ESO to modernise the ETC, based on a python backend and an angular-based…

The Herschel Space Observatory is the fourth cornerstone mission in the ESA science programme and performs photometry and spectroscopy in the 55 - 672 micron range. The development of the Herschel Data Processing System started in 2002 to…

ESPRESSO is an extremely stable high-resolution spectrograph which is currently being developed for the ESO VLT. With its groundbreaking characteristics it is aimed to be a "science machine", i.e., a fully-integrated instrument to directly…

We seek to enable classic processing of continuous ultra-sparse spatiotemporal data generated by event-based sensors with dense machine learning models. We propose a novel hybrid pipeline composed of asynchronous sensing and synchronous…

The Data Access System (DAS) is a metadata and data management software system, providing a reusable solution for the storage of data acquired both from telescopes and auxiliary data sources during the instrument development phases and…

Data processing pipelines need to be executed at scales ranging from small runs up through large production data release runs resulting in millions of data products. As part of the Rubin Observatory's pipeline execution system, BPS is the…