English

A data model to connect the ESO Data Processing System (EDPS) to ELT data archives

Instrumentation and Methods for Astrophysics 2025-06-03 v1
Authors: Hugo Buddelmeijer , Gijs Verdoes Kleijn
View on arXiv ↗ PDF ↗

Abstract

We extend the data-driven approach for astronomical pipelines to the METIS instrument and integrate the ESO Data Processing System (EDPS) by adapting it to support backward chaining.

Cite

@article{arxiv.2506.00899,
  title  = {A data model to connect the ESO Data Processing System (EDPS) to ELT data archives},
  author = {Hugo Buddelmeijer and Gijs Verdoes Kleijn},
  journal= {arXiv preprint arXiv:2506.00899},
  year   = {2025}
}

Comments

ADASS 2024 proceedings, 4 pages, 1 figure

Related papers

View all related →
Instrumentation and Methods for Astrophysics · Physics
Adaptive Data Reduction Workflows for Astronomy -- The ESO Data Processing System (EDPS)
Wolfram Freudling, Stefano Zampieri, Lodovico Coccato, Stanislaw Podgorski +3
2024-01-26
Instrumentation and Methods for Astrophysics · Physics
Reflex: Scientific Workflows for the ESO Pipelines
Pascal Ballester, Daniel Bramich, Vincenzo Forchi, Wolfram Freudling +4
2011-02-11
Instrumentation and Methods for Astrophysics · Physics
Simulating METIS SCAO System
Markus Feldt, Horst Steuer, Carlos Correia, Andreas Obereder +4
2023-11-23
Instrumentation and Methods for Astrophysics · Physics
The e-MERLIN Data Reduction Pipeline
Megan Argo
2015-02-18
Databases · Computer Science
ETL for the integration of remote sensing data
Paula V. Romero Jure, Juan Bautista Cabral, Sergio Masuelli
2023-06-21
Instrumentation and Methods for Astrophysics · Physics
The Data Processing Pipeline for the MUSE Instrument
Peter M. Weilbacher, Ralf Palsa, Ole Streicher, Roland Bacon +11
2020-09-02
Astrophysics · Physics
METIS - the Mid-infrared E-ELT Imager and Spectrograph
Bernhard R. Brandl, Rainer Lenzen, Eric Pantin, Alistair Glasse +18
2009-11-13
Machine Learning · Computer Science
A Survey of Pipeline Tools for Data Engineering
Anthony Mbata, Yaji Sripada, Mingjun Zhong
2024-06-21
Instrumentation and Methods for Astrophysics · Physics
A Scientific Workflow System for Satellite Data Processing with Real-Time Monitoring
Minh Duc Nguyen
2018-12-10
Distributed, Parallel, and Cluster Computing · Computer Science
METL: a modern ETL pipeline with a dynamic mapping matrix
Christian Haase, Timo Röseler, Mattias Seidel
2022-04-01
Software Engineering · Computer Science
From Ad-Hoc Scripts to Orchestrated Pipelines: Architecting a Resilient ELT Framework for Developer Productivity Metrics
Yuvraj Agrawal, Pallav Jain
2026-02-26
Machine Learning · Computer Science
Expectation Programming: Adapting Probabilistic Programming Systems to Estimate Expectations Efficiently
Tim Reichelt, Adam Goliński, Luke Ong, Tom Rainforth
2022-06-22
Instrumentation and Methods for Astrophysics · Physics
High strehl and high contrast for the ELT instrument METIS -- Final design, implementation, and predicted performance of the single-conjugate adaptive optics system
Markus Feldt, Thomas Bertram, Carlos Correia, Olivier Absil +7
2024-11-27
Astrophysics · Physics
"Advanced" data reduction for the AMBER instrument
Florentin Millour, Bruno Valat, Romain Petrov, Martin Vannier
2009-11-13
Instrumentation and Methods for Astrophysics · Physics
From ESPRESSO to the future -- Analysis of QSO spectra with the Astrocook package
Guido Cupani, Giorgio Calderone, Stefano Cristiani, Valentina D'Odorico +1
2018-08-14
Astrophysics · Physics
ESO for GOODS' sake
A. Renzini, C. Cesarsky, S. Cristiani, L. da Costa +5
2009-11-07
Instrumentation and Methods for Astrophysics · Physics
ESO's new generation of Exposure Time Calculators
Henri M. J. Boffin, Jakob Vinther, Gurvan Bazin, David Huerta +3
2024-07-04
Distributed, Parallel, and Cluster Computing · Computer Science
Edge-assisted Parallel Uncertain Skyline Processing for Low-latency IoE Analysis
Chuan-Chi Lai, Yan-Lin Chen, Bo-Xin Liu, Chuan-Ming Liu
2026-01-27
Distributed, Parallel, and Cluster Computing · Computer Science
Towards an Intelligent Data Delivery Service
Wen Guan, Tadashi Maeno, Gancho Dimitrov, Brian Paul Bockelman +3
2021-02-03
Software Engineering · Computer Science
FlowETL: An Autonomous Example-Driven Pipeline for Data Engineering
Mattia Di Profio, Mingjun Zhong, Yaji Sripada, Marcel Jaspars
2025-08-01
Systems and Control · Electrical Eng. & Systems
Secure Expansion of Energy Storage and Transmission Lines Considering Bundling Option Under Renewable Penetration
Mojtaba Moradi-Sepahvand, Turaj Amraee
2023-10-10
Distributed, Parallel, and Cluster Computing · Computer Science
A Data Imputation Model based on an Ensemble Scheme
Panagiotis Fountas, Kostas Kolomvatsos
2020-07-28
Instrumentation and Methods for Astrophysics · Physics
The Astro-WISE Optical Image Pipeline: Development and Implementation
J. P. McFarland, G. Verdoes-Kleijn, G. Sikkema, E. M. Helmich +2
2011-10-17
Instrumentation and Methods for Astrophysics · Physics
The Automated Data Extraction, Processing, and Tracking System for CHARIS
Taylor L. Tobin, Jeffery Chilcote, Timothy Brandt, Thayne Currie +3
2020-12-21
Instrumentation and Methods for Astrophysics · Physics
The pipeline for the ExoMars DREAMS scientific data archiving
P. Schipani, L. Marty, M. Mannetta, F. Esposito +14
2017-03-17
R2 v1 2026-07-01T02:52:56.851Z