English
Related papers

Related papers: Reproducing Scientific Experiment with Cloud DevOp…

200 papers

Oftentimes, there is a need to experiment with different programming languages and technologies when designing software applications. Such experiments must be reproducible and share-able within a team workplace, and manual effort should be…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-05 Ayaz Hafiz , Kevin Jin

A common concern in experimental research is the auditability and reproducibility of experiments. Experiments are usually designed, provisioned, managed, and analyzed by diverse teams of specialists (e.g., researchers, technicians and…

Building Performance Simulation (BPS) uses advanced computational and data science methods. Reproducibility, the ability to obtain the same results by using the same data and methods, is essential in BPS research to ensure the reliability…

Digital Libraries · Computer Science 2025-03-19 Christian Ghiaus

The transformations, analyses and interpretations of data in scientific workflows are vital for the repeatability and reliability of scientific workflows. This provenance of scientific workflows has been effectively carried out in Grid…

Databases · Computer Science 2016-11-18 Khawar Hasham , Kamran Munir , Jetendr Shamdasani , Richard McClatchey

Science is conducted collaboratively, often requiring knowledge sharing about computational experiments. When experiments include only datasets, they can be shared using Uniform Resource Identifiers (URIs) or Digital Object Identifiers…

Digital Libraries · Computer Science 2017-09-12 Dai Hai Ton That , Gabriel Fils , Zhihao Yuan , Tanu Malik

Over the recent years the importance of numerical experiments has gradually been more recognized. Nonetheless, sufficient documentation of how computational results have been obtained is often not available. Especially in the scientific…

Mathematical Software · Computer Science 2021-05-10 Jörg Fehr , Jan Heiland , Christian Himpe , Jens Saak

Many research groups aspire to make data and code FAIR and reproducible, yet struggle because the data and code life cycles are disconnected, executable environments are often missing from published work, and technical skill requirements…

Recent reproducibility case studies have raised concerns showing that much of the deposited research has not been reproducible. One of their conclusions was that the way data repositories store research data and code cannot fully facilitate…

Digital Libraries · Computer Science 2020-06-18 Ana Trisovic , Philip Durbin , Tania Schlatter , Gustavo Durand , Sonia Barbosa , Danny Brooke , Mercè Crosas

There is a gap in scientific information systems development concerning modern software engineering and scientific computing. Historically, software engineering methodologies have been perceived as an unwanted accidental complexity to…

The increasing availability of cloud computing services for science has changed the way scientific code can be developed, deployed, and run. Many modern scientific workflows are capable of running on cloud computing resources. Consequently,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-11 Peter Vaillancourt , Bennett Wineholt , Brandon Barker , Plato Deliyannis , Jackie Zheng , Akshay Suresh , Adam Brazier , Rich Knepper , Rich Wolski

In the era of data-driven science, conducting computational experiments that involve analysing large datasets using heterogeneous computational clusters, is part of the everyday routine for many scientists. Moreover, to ensure the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-23 Thanasis Vergoulis , Konstantinos Zagganas , Loukas Kavouras , Martin Reczko , Stelios Sartzetakis , Theodore Dalamagas

The enabling of scientific experiments that are embarrassingly parallel, long running and data-intensive into a cloud-based execution environment is a desirable, though complex undertaking for many researchers. The management of such…

Environmental science is often fragmented: data is collected using mismatched formats and conventions, and models are misaligned and run in isolation. Cloud computing offers a lot of potential in the way of resolving such issues by…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-08-08 Yehia Elkhatib , Gordon S. Blair , Bholanathsingh Surajbali

Scientific computing applications usually need huge amounts of computational power. The cloud provides interesting high-performance computing solutions, with its promise of virtually infinite resources on demand. However, migrating…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-26 Satish Narayana Srirama , Pelle Jakovits , Vladislav Ivaništšev

Computational reproducibility is a growing problem that has been extensively studied among computational researchers and within the signal processing and machine learning research community. However, with the changing landscape of signal…

Signal Processing · Electrical Eng. & Systems 2022-02-16 Joseph Shenouda , Waheed U. Bajwa

Cloud computing has become a major approach to help reproduce computational experiments. Yet there are still two main difficulties in reproducing batch based big data analytics (including descriptive and predictive analytics) in the cloud.…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-13 Xin Wang , Pei Guo , Xingyan Li , Aryya Gangopadhyay , Carl E. Busart , Jade Freeman , Jianwu Wang

Scientific workflow has become essential in software engineering because it provides a structured approach to designing, executing, and analyzing scientific experiments. Software developers and researchers have developed hundreds of…

Software Engineering · Computer Science 2023-09-15 Khairul Alam , Banani Roy , Alexander Serebrenik

Modern data science research can involve massive computational experimentation; an ambitious PhD in computational fields may do experiments consuming several million CPU hours. Traditional computing practices, in which researchers use…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-28 Hatef Monajemi , Riccardo Murri , Eric Jonas , Percy Liang , Victoria Stodden , David L. Donoho

At present moment, there is a great interest in development of information systems operating in cloud infrastructures. Generally, many of tasks remain unresolved such as tasks of optimization of large databases in a hybrid cloud…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-09-17 Evgeniy Pluzhnik , Evgeny Nikulchev , Simon Payain

Recent developments in the commercial open source community have catalysed the use of Linux containers for scalable deployment of web-based applications to the cloud. Scientific software can be containerized with dependencies, configuration…

Software Engineering · Computer Science 2015-09-30 Robert Nagler , David Bruhwiler , Paul Moeller , Stephen Webb