Related papers: Delivering SKA Science
We present the launch of the Hyper Suprime-Cam Legacy Archive (HSCLA), a public archive of processed, science-ready data from Hyper Suprime-Cam (HSC). HSC is an optical wide-field imager installed at the prime focus of the Subaru Telescope…
Function-as-a-Service (FaaS) is a type of serverless computing that allows developers to write and deploy code as individual functions, which can be triggered by specific events or requests. FaaS platforms automatically manage the…
This vision paper introduces a pioneering data lake architecture designed to meet Life \& Earth sciences' burgeoning data management needs. As the data landscape evolves, the imperative to navigate and maximize scientific opportunities has…
This paper describes the use of a distributed cloud computing system for high-throughput computing (HTC) scientific applications. The distributed cloud computing system is composed of a number of separate Infrastructure-as-a-Service (IaaS)…
As the Square Kilometre Array (SKA) approaches operational status, its complex digital architecture introduces new instrumental challenges. To explore relevant observational and data processing strategies, we have upgraded the 21CMA…
Generation of science-ready data from processed data products is one of the major challenges in next-generation radio continuum surveys with the Square Kilometre Array (SKA) and its precursors, due to the expected data volume and the need…
Similar to Open Data initiatives, data science as a community has launched initiatives for sharing not only data but entire pipelines, derivatives, artifacts, etc. (Open Data Science). However, the few efforts that exist focus on the…
SKA is a new technology radio-telescope array, about two orders of magnitude more sensitive and rapid in sky surveys than present instruments. It will probe the dark age of the universe, just afer recombination, and during the epoch of…
Cloud computing systems promise to offer subscription-oriented, enterprise-quality computing services to users worldwide. With the increased demand for delivering services to a large number of users, they need to offer differentiated…
This chapter describes the assumed specifications and sensitivities for HI galaxy surveys with SKA1 and SKA2. It addresses the expected galaxy number densities based on available simulations as well as the clustering bias over the…
Recently, we have been witnessing huge advancements in the scale of data we routinely generate and collect in pretty much everything we do, as well as our ability to exploit modern technologies to process, analyze and understand this data.…
The previous generation of astronomical instruments tended to consist of single receivers in the focal point of one or more physical reflectors. Because of this, most astronomical data sets were small enough that the raw data could easily…
The Square Kilometre Array (SKA) is a planned large radio interferometer designed to operate over a wide range of frequencies, and with an order of magnitude greater sensitivity and survey speed than any current radio telescope. The SKA…
We present a detailed overview of the cosmological surveys that will be carried out with Phase 1 of the Square Kilometre Array (SKA1), and the science that they will enable. We highlight three main surveys: a medium-deep continuum weak…
Distributed communities of researchers rely increasingly on valuable, proprietary, or sensitive datasets. Given the growth of such data, especially in fields new to data-driven, computationally intensive research like the social sciences…
Cloud computing recently developed into a viable alternative to on-premises systems for executing high-performance computing (HPC) applications. With the emergence of new vendors and hardware options, there is now a growing need to…
High performance computing (HPC) has driven collaborative science discovery for decades. Exascale computing platforms, currently in the design stage, will be deployed around 2022. The next generation of supercomputers is expected to utilize…
Science is becoming very data intensive1. Today's astronomy datasets with tens of millions of galaxies already present substantial challenges for data mining. In less than 10 years the catalogs are expected to grow to billions of objects,…
The Square Kilometre Array (SKA) is expected to start science operations in 2030 and by that time there could be up to 10$^5$ artificial satellites in Earth's orbit, comprising an increase of an order of magnitude compared to 2024. Most of…
The Square Kilometre Array will be a revolutionary instrument for the study of gas in the distant Universe. SKA1 will have sufficient sensitivity to detect and image atomic 21 cm HI in individual galaxies at significant cosmological…