Related papers: Delivering SKA Science
Data management, which encompasses activities and strategies related to the storage, organization, and description of data and other research materials, helps ensure the usability of datasets -- both for the original research team and for…
A common task in scientific computing is the derivation of data. This workflow extracts the most important information from large input data and stores it in smaller derived data objects. The derived data objects can then be used for…
Cloud data lakes provide a modern solution for managing large volumes of data. The fundamental principle behind these systems is the separation of compute and storage layers. In this architecture, inexpensive cloud storage is utilized for…
We investigate the capabilities of various stages of the SKA to perform world-leading weak gravitational lensing surveys. We outline a way forward to develop the tools needed for pursuing weak lensing in the radio band. We identify the key…
As software systems increase in complexity, conventional monitoring methods struggle to provide a comprehensive overview or identify performance issues, often missing unexpected problems. Observability, however, offers a holistic approach,…
SKA would have distinct capabilities for studies associated with extra-solar planets, their formation and properties.
Scientific analyses commonly compose multiple single-process programs into a dataflow. An end-to-end dataflow of single-process programs is known as a many-task application. Typically, tools from the HPC software stack are used to…
The Square Kilometre Array (SKA) is the radio telescope of the next generation, providing an increase in sensitivity and angular resolution of two orders of magnitude over existing telescopes. Currently, the SKA is expected to span the…
The Square Kilometre Array Telescope Manager (SKA TM) will be responsible for assisting the SKA Operations and Observation Management, carrying out System diagnosis and collecting Monitoring & Control data from the SKA sub-systems and…
The large instantaneous sensitivity, a wide frequency coverage and flexible observation modes with large number of beams in the sky are the main features of the SKA observatory's two telescopes, the SKA-Low and the SKA-Mid, which are…
Powerful detectors at modern experimental facilities routinely collect data at multiple GB/s. Online analysis methods are needed to enable the collection of only interesting subsets of such massive data streams, such as by explicitly…
One of the key science drivers for the development of the SKA is to observe the neutral hydrogen, HI, in galaxies as a means to probe galaxy evolution across a range of environments over cosmic time. Over the past decade, much progress has…
Climate science produces a wealth of complex, high-dimensional, multivariate data from observations and numerical models. These data are critical for understanding climate changes and their socioeconomic impacts. Climate scientists are…
The Square Kilometre Array (SKA) is a radio telescope designed to operate between 70MHz and 10GHz. Due to this large bandwidth, the SKA will be built out of different collectors, namely antennas and dishes to cover the frequency range…
The Atacama Large mm and sub-mm Array (ALMA) radio observatory is one of the world's largest astronomical projects. After the very successful conclusion of the first observation cycles Early Science Cycles 0 and 1, the ALMA project can…
The beginning of the 21st century has seen many projects on distributed hash tables, both research and commercial. One of their aims has been to replace the first generation of file sharing software with scalable peer-to-peer architectures.…
Data access is key to science driven by distributed high-throughput computing (DHTC), an essential technology for many major research projects such as High Energy Physics (HEP) experiments. However, achieving efficient data access becomes…
SKA will be a major step forward not only in astrophysics, but also in precision cosmology. We show how the neutral hydrogen intensity map can be combined with the Planck measurements of the CMB power spectrum, to provide a precision test…
One of the five key science projects for the Square Kilometre Array (SKA) is "The Origin and Evolution of Cosmic Magnetism", in which radio polarimetry will be used to reveal what cosmic magnets look like and what role they have played in…
The importance of archival science increases significantly for astrophysical observatories as they mature and their archive holdings grow in size and complexity. Further enhancing the science return of archival data requires engaging a…