English
Related papers

Related papers: A Backend Platform for Supporting the Reproducibil…

200 papers

Those seeking to reproduce a computational experiment often need to manually look at the code to see how to build necessary libraries, configure parameters, find data, and invoke the experiment; it is not automatic. Automatic…

Software Engineering · Computer Science 2023-07-24 Samuel Grayson , Reed Milewicz , Joshua Teves , Daniel S. Katz , Darko Marinov

Reproducibility is one of the core dimensions that concur to deliver Trustworthy Artificial Intelligence. Broadly speaking, reproducibility can be defined as the possibility to reproduce the same or a similar experiment or method, thereby…

Artificial Intelligence · Computer Science 2023-02-27 Riccardo Albertoni , Sara Colantonio , Piotr Skrzypczyński , Jerzy Stefanowski

Reproducibility is a crucial aspect of scientific research that involves the ability to independently replicate experimental results by analysing the same data or repeating the same experiment. Over the years, many works have been proposed…

Digital Libraries · Computer Science 2024-07-16 Andrea Bianchi , Giordano d'Aloisio , Francesca Marzi , Antinisca Di Marco

This work introduces a companion reproducible paper with the aim of allowing the exact replication of the methods, experiments, and results discussed in a previous work [5]. In that parent paper, we proposed many and varied techniques for…

Data Structures and Algorithms · Computer Science 2019-12-30 Antonio Fariña , Miguel A. Martínez-Prieto , Francisco Claude , Gonzalo Navarro , Juan J. Lastra-Díaz , Nicola Prezza , Diego Seco

Recent studies have shown that the majority of published computational models in systems biology and physiology are not repeatable or reproducible. There are a variety of reasons for this. One of the most likely reasons is that given how…

Other Quantitative Biology · Quantitative Biology 2021-07-13 Herbert M. Sauro

A complete declarative description of the computational environment is often missing when researchers share their materials. Without such description, software obsolescence and missing system components can jeopardize computational…

Computation · Statistics 2023-07-19 Chung-hong Chan , David Schoch

Open-source scientific software is a major driver of scientific progress, yet its development and reuse remain difficult in collaborative settings. Researchers repeatedly face four recurring challenges: discovering and reproducing existing…

Digital Libraries · Computer Science 2026-04-22 Jan Philipp Albrecht , Deborah Schmidt , Lucas Rieckert , Maximilian Otto , Kyle Harrington

Computational reproducibility is fundamental to trustworthy science, yet remains difficult to achieve in practice across various research workflows, including Jupyter notebooks published alongside scholarly articles. Environment drift,…

Software Engineering · Computer Science 2026-04-02 Sheeba Samuel , Daniel Mietchen , Hemanta Lo , Martin Gaedke

Why are some research studies easy to reproduce while others are difficult? Casting doubt on the accuracy of scientific work is not fruitful, especially when an individual researcher cannot reproduce the claims made in the paper. There…

Digital Libraries · Computer Science 2023-08-25 Akhil Pandey Akella , David Koop , Hamed Alhoori

AI agents have the potential to aid users on a variety of consequential tasks, including conducting scientific research. To spur the development of useful agents, we need benchmarks that are challenging, but more crucially, directly…

Computation and Language · Computer Science 2024-09-18 Zachary S. Siegel , Sayash Kapoor , Nitya Nagdir , Benedikt Stroebl , Arvind Narayanan

Results of simulation studies evaluating the performance of statistical methods are often considered actionable and thus can have a major impact on the way empirical research is implemented. However, so far there is limited evidence about…

Like other engineering disciplines, software engineering should also have principles to guide the construction of sustainable computer applications. Tangible properties include a) unlimited scalability, b) maximal reproducibility, and c)…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-07-23 Justin Shi

Like other types of computational research, modeling and simulation of biological processes (biomodels) is still largely communicated without sufficient detail to allow independent reproduction of results. But reproducibility in this area…

Other Quantitative Biology · Quantitative Biology 2023-04-19 Pedro Mendes

Reproducibility in the computational sciences has been stymied because of the complex and rapidly changing computational environments in which modern research takes place. While many will espouse reproducibility as a value, the challenge of…

Software Engineering · Computer Science 2018-08-07 Remi Rampin , Fernando Chirigati , Vicky Steeves , Juliana Freire

Laboratory research is a complex, collaborative process that involves several stages, including hypothesis formulation, experimental design, data generation and analysis, and manuscript writing. Although reproducibility and data sharing are…

Other Quantitative Biology · Quantitative Biology 2025-02-12 Katharine Y. Chen , Maria Toro-Moreno , Arvind Rasi Subramaniam

Replicability and reproducibility of experimental results are primary concerns in all the areas of science and IR is not an exception. Besides the problem of moving the field towards more reproducible experimental practices and protocols,…

Information Retrieval · Computer Science 2020-10-27 Timo Breuer , Nicola Ferro , Norbert Fuhr , Maria Maistro , Tetsuya Sakai , Philipp Schaer , Ian Soboroff

The reproduction and replication of reported scientific results is a hot topic within the academic community. The retraction of numerous studies from a wide range of disciplines, from climate science to bioscience, has drawn the focus of…

Computational Engineering, Finance, and Science · Computer Science 2014-10-15 Tom Crick , Benjamin A. Hall , Samin Ishtiaq , Kenji Takeda

Scientific knowledge increasingly depends on complex computational processes where both hardware and software layers can influence research outcomes. As computational complexity grows, classical-quantum integration provides a lens for…

Emerging Technologies · Computer Science 2026-03-06 Anna Vrtiak , Duuk Baten , Ariana Torres-Knoop

The need for computational resources grows as computational algorithms gain popularity in different sectors of the scientific community. This search has stimulated the development of several cloud platforms that abstract the complexity of…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-18 Henrique C. T. Santos , Luciano S. de Souza , Jonathan H. A. de Carvalho , Tiago A. E. Ferreira

Reproducibility is a core requirement of modern scientific research. For computational research, reproducibility means that code should produce the same results, even when run on different systems. A standard approach to ensuring…

Other Computer Science · Computer Science 2023-10-03 Paxton C. Fitzpatrick , Jeremy R. Manning