English
Related papers

Related papers: Formal Definition and Implementation of Reproducib…

200 papers

The Square Kilometre Array (SKA) is a planned radio interferometer of unprecedented scale that will revolutionize low-frequency radio astronomy when completed. In particular, one of its core science drivers is the systematic mapping of the…

Cosmology and Nongalactic Astrophysics · Physics 2022-01-11 Nichole Barry , Gianni Bernardi , Bradley Greig , Nicholas Kern , Florent Mertens

When completed the Square Kilometre Array (SKA) will feature an unprecedented rate of image generation. While previous generations of telescopes have relied on human expertise to extract scientifically interesting information from the…

Instrumentation and Methods for Astrophysics · Physics 2016-01-19 C. Hollitt , M. Johnston-Hollitt , S. Dehghan , M. Frean , T. Bulter-Yeoman

Recently, a full-scale data processing workflow of the Square Kilometre Array (SKA) Phase 1 was successfully executed on the world's fastest supercomputer Summit, proving that scientists have the expertise, software tools and computing…

Instrumentation and Methods for Astrophysics · Physics 2020-04-13 Ruonan Wang , Andreas Wicenec , Tao An

The Square Kilometre Array (SKA) is intended as the next-generation radio telescope and will address fundamental questions in astrophysics, physics, and astrobiology. The international science community has developed a set of Key Science…

Instrumentation and Methods for Astrophysics · Physics 2009-10-06 Joseph Lazio

Scientific workflows are a cornerstone of modern scientific computing. They are used to describe complex computational applications that require efficient and robust management of large volumes of data, which are typically stored/processed…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-03 Rafael Ferreira da Silva , Loïc Pottier , Tainã Coleman , Ewa Deelman , Henri Casanova

Scientists rely on simulations to study natural phenomena. Trusting the simulation results is vital to develop sciences in any field. One approach to build trust is to ensure the reproducibility and traceability of the simulations through…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-09-21 Paula Olaya , Jay Lofstead , Michela Taufer

The Square Kilometre Array (SKA) infrastructure will consist of two radio telescopes that will be the most sensitive telescopes on Earth. The SKA community will have to process and manage near exascale data, which will be a technical…

Reproducibility remains a central challenge in machine learning (ML), especially in collaborative eScience projects where teams iterate over data, features, and models. Current ML workflows are often dynamic yet fragmented, relying on…

Machine Learning · Computer Science 2025-06-23 Zhiwei Li , Carl Kesselman , Tran Huy Nguyen , Benjamin Yixing Xu , Kyle Bolo , Kimberley Yu

Large language models (LLMs) are increasingly used to automate data analysis through executable code generation. Yet, data science tasks often admit multiple statistically valid solutions, e.g. different modeling strategies, making it…

Machine Learning · Computer Science 2025-11-10 Qiuhai Zeng , Claire Jin , Xinyue Wang , Yuhan Zheng , Qunhua Li

Scientific workflow has become essential in software engineering because it provides a structured approach to designing, executing, and analyzing scientific experiments. Software developers and researchers have developed hundreds of…

Software Engineering · Computer Science 2023-09-15 Khairul Alam , Banani Roy , Alexander Serebrenik

Scientific workflows are critical to scientific data analysis and often involve computationally intensive processing of large datasets on compute clusters. As such, their execution tends to be long-running and resource-intensive, resulting…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-09 Kathleen West , Youssef Moawad , Fabian Lehmann , Vasilis Bountris , Ulf Leser , Yehia Elkhatib , Lauritz Thamsen

The Square Kilometre Array is conceived as a telescope which will both test fundamental physical laws and transform our current picture of the Universe. However, the scientific challenges outlined in this book are today's problems--will…

Astrophysics · Physics 2009-11-10 P. N. Wilkinson , K. I. Kellermann , R. D. Ekers , J. M. Cordes , T. Joseph W. Lazio

Laboratory workflows in pharmaceutical and biomedical research encode substantial tacit knowledge -- expert judgment about failure conditions, decision branching logic, and contextual dependencies -- that remains inaccessible to protocol…

Scientific workflows have become essential for orchestrating complex computational processes across distributed resources, managing large datasets, and ensuring reproducibility in modern research. The Workflows Community Summit 2025, held…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-06 Irene Bonati , Silvina Caino-Lores , Tainã Coleman , Sagar Dolas , Sandro Fiore , Venkatesh Kannan , Marco Verdicchio , Sean R. Wilkinson , Rafael Ferreira da Silva

In recent years, the research community has raised serious questions about the reproducibility of scientific work. In particular, since many studies include some kind of computing work, reproducibility is also a technological challenge, not…

Software Engineering · Computer Science 2023-08-03 Lázaro Costa , Susana Barbosa , Jácome Cunha

The Square Kilometre Array (SKA) will be both the largest radio telescope ever constructed and the largest Big Data project in the known Universe. The first phase of the project will generate on the order of 5 zettabytes of data per year. A…

Instrumentation and Methods for Astrophysics · Physics 2018-11-21 Jamie Farnes , Ben Mort , Fred Dulwich , Stef Salvini , Wes Armour

Square Kilometer Array is expected to generate hundreds of petabytes of data per year, two orders of magnitude more than current radio interferometers. Data processing at this scale necessitates advanced High Performance Computing (HPC)…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-02 Giovanni Lacopo , Claudio Gheller , Emanuele De Rubeis , Pascal Jahan Elahi , Maciej Cytowski , Luca Tornatore , Giuliano Taffoni , Ugo Varetto

Future Square Kilometre Array (SKA) surveys are expected to generate huge datasets of 21cm maps on cosmological scales from the Epoch of Reionization (EoR). We assess the viability of exploiting machine learning techniques, namely,…

Cosmology and Nongalactic Astrophysics · Physics 2020-05-13 Sultan Hassan , Sambatra Andrianomena , Caitlin Doughty

The cosmological case for a next generation radio observatory, the Square Kilometer Array, is discussed and reviewed. An instrument like the SKA would be able to measure galaxy redshifts of normal late-type galaxies, via the 21 cm line of…

Astrophysics · Physics 2007-05-23 Rien van de Weygaert , Tjeerd S. van Albada

In a new effort to make our research transparent and reproducible by others, we developed a workflow to run and share computational studies on the public cloud Microsoft Azure. It uses Docker containers to create an image of the application…

Computational Engineering, Finance, and Science · Computer Science 2020-07-24 Olivier Mesnard , Lorena A. Barba