Related papers: Astronomical Pipeline Provenance: A Use Case Evalu…

Scientists today collect, analyze, and generate TeraBytes and PetaBytes of data. These data are often shared and further processed and analyzed among collaborators. In order to facilitate sharing and data interpretations, data need to carry…

The time domain has been identified as one of the most important areas of astronomical research for the next decade. The Virtual Observatory is in the vanguard with dedicated tools and services that enable and facilitate the discovery,…

We highlight here several solutions developed to make high-level Cherenkov data FAIR: Findable, Accessible, Interoperable and Reusable. The first three FAIR principles may be ensured by properly indexing the data and using community…

The Cherenkov Telescope Array (CTA) is the next generation of ground-based gamma-ray astronomy observatory that will improve the sensitivity of current generation instruments by one order of magnitude. The LST-1 is the first telescope…

The knowledge discovery potential of the new large astronomical databases is vast. When these are used in conjunction with the rich legacy data archives, the opportunities for scientific discovery multiply rapidly. A Virtual Observatory…

Science archives are cornerstones of modern astronomical facilities. In this paper we describe the version 1.0 milestone of the Atacama Large Millimeter/submillimeter Array Science Archive. This version features a comprehensive query…

The Cherenkov Telescope Array (CTA) observatory will be one of the largest ground-based very high-energy gamma-ray observatories. The On-Site Analysis will be the first CTA scientific analysis of data acquired from the array of telescopes,…

The Cherenkov Telescope Array (CTA) will operate several types of telescopes and cameras. The individual camera trigger rates will vary much - from 0.6 to 15 kHz - while the content of the raw data will be heterogeneous. Raw data streams of…

This paper presents the DDF Pipeline, a radio astronomy data processing tool initially designed for the LOw-Frequency ARray (LO- FAR) radio-telescope and a candidate for processing data from the Square Kilometre Array (SKA). This work…

Survey telescopes such as the Vera C. Rubin Observatory and the Square Kilometre Array will discover billions of static and dynamic astronomical sources. Properly mined, these enormous datasets will likely be wellsprings of rare or unknown…

The extremely high sensitivity and resolution of the Square Kilometre Array (SKA) will be useful for addressing a wide set of themes relevant for cosmology, in synergy with current and future cosmic microwave background (CMB) projects. Many…

The Large Synoptic Survey Telescope is designed to provide an unprecedented optical imaging dataset that will support investigations of our Solar System, Galaxy and Universe, across half the sky and over ten years of repeated observation.…

Scientific datasets and analysis pipelines are increasingly being shared publicly in the interest of open science. However, mechanisms are lacking to reliably identify which pipelines and datasets can appropriately be used together. Given…

At regime, SKAO is expected to provide the researchers with an annual amount of more than 700 hundred PB of data. The advanced analysis of all those data will take place within a network (SRCnet) of so-called SKA Regional Centres, which,…

The Square Kilometre Array (SKA), currently under design, will be a transformational facility for studying the Universe at centimetre and metre wavelengths in the next decade and beyond. This paper provides the current best estimate of the…

We have constructed a new, fast, robust and reliable pipeline to detect variable stars from the ROTSE-IIId archival data. Turkish share of ROTSE-III archive contains approximately one million objects from a large field of view (1.85\dgr)…

With SKA precursor and pathfinder operations in full swing, radio and (sub-)mm astronomy is entering the era of super big data. The big questions is how to make (sub-)mm and radio data available to the astronomical community, preferably…

A new cosmic shear analysis pipeline SUNGLASS (Simulated UNiverses for Gravitational Lensing Analysis and Shear Surveys) is introduced. SUNGLASS is a pipeline that rapidly generates simulated universes for weak lensing and cosmic shear…

Modern epidemiological analyses to understand and combat the spread of disease depend critically on access to, and use of, data. Rapidly evolving data, such as data streams changing during a disease outbreak, are particularly challenging.…

Data volumes from multiple sky surveys have grown from gigabytes into terabytes during the past decade, and will grow from terabytes into tens (or hundreds) of petabytes in the next decade. This exponential growth of new data both enables…