Related papers: Astronomical Pipeline Provenance: A Use Case Evalu…
The landscape of ground-based gamma-ray astronomy is drastically changing with the perspective of the Cherenkov Telescope Array (CTA) composed of more than 100 Cherenkov telescopes. For the first time in this energy domain, CTA will be…
The Vera C. Rubin Observatory will produce an unprecedented astronomical data set for studies of the deep and dynamic universe. Its Legacy Survey of Space and Time (LSST) will image the entire southern sky every three to four days and…
One of the five key science projects for the Square Kilometre Array (SKA) is "The Origin and Evolution of Cosmic Magnetism", in which radio polarimetry will be used to reveal what cosmic magnets look like and what role they have played in…
High precision astrometry provides the foundation to resolve many fundamental problems in astrophysics. The application of astrometric studies spans a wide range of fields, and has undergone enormous growth in recent years. This is as a…
The possibility of using the SKA for occasional support of scientific space missions should be considered, along with all other science goals, in the design of the array. The benefits of higher data rates from distant spacecraft during high…
The present-day Universe is seemingly dominated by dark energy and dark matter, but mapping the normal (baryonic) content remains vital for both astrophysics - understanding how galaxies form - and astro-particle physics - inferring…
In the past several decades, the standard cosmological model has been established and its parameters have been measured to a high precision, while there are still many of the fundamental questions in cosmology; such as the physics in the…
The data volumes stored in telescope archives is constantly increasing due to the development and improvements in the instrumentation. Often the archives need to be stored over a distributed storage architecture, provided by independent…
We describe the application of data mining algorithms to research problems in astronomy. We posit that data mining has always been fundamental to astronomical research, since data mining is the basis of evidence-based discovery, including…
The Cherenkov Telescope Array (CTA) is a ground-based $\gamma$-ray observatory that will observe the full sky in the energy range from 20 GeV to 100 TeV from facilities in both hemispheres. It is proposed to consist of more than 100…
The Australian Square Kilometre Array Pathfinder (ASKAP) collects images of the sky at radio wavelengths with an unprecedented field of view, combined with a high angular resolution and sub-millijansky sensitivities. The large quantity of…
Astronomy is entering a new era as multiple, large area, digital sky surveys are in production. The resulting datasets are truly remarkable in their own right; however, a revolutionary step arises in the aggregation of complimentary…
Modern astronomical data processing requires complex software pipelines to process ever growing datasets. For radio astronomy, these pipelines have become so large that they need to be distributed across a computational cluster. This makes…
Optimizing data-intensive workflow execution is essential to many modern scientific projects such as the Square Kilometre Array (SKA), which will be the largest radio telescope in the world, collecting terabytes of data per second for the…
The Vera C. Rubin Observatory is preparing to execute the most ambitious astronomical survey ever attempted, the Legacy Survey of Space and Time (LSST). Currently the final phase of construction is under way in the Chilean Andes, with the…
We review some aspects of the current state of data-intensive astronomy, its methods, and some outstanding data analysis challenges. Astronomy is at the forefront of "big data" science, with exponentially growing data volumes and data…
The Square Kilometer Array (SKA) has the potential to produce galaxy redshift surveys which will be competitive with other state of the art cosmological experiments in the next decade. In this chapter we summarise what capabilities the…
Recently, a full-scale data processing workflow of the Square Kilometre Array (SKA) Phase 1 was successfully executed on the world's fastest supercomputer Summit, proving that scientists have the expertise, software tools and computing…
The unprecedented volume of data from the Square Kilometre Array (SKA) telescopes will require the implementation of robust and solid strategies for efficient data processing and management. In this context, the SKA Regional Centre Network…
Karabo is a versatile Python-based software framework simplifying research with radio astronomy data. It bundles existing software packages into a coherent whole to improve the ease of use of its components. Karabo includes useful…