English
Related papers

Related papers: Interactive Tools for Reproducible Science -- Unde…

200 papers

Challenges to reproducibility and replicability have gained widespread attention, driven by large replication projects with lukewarm success rates. A nascent work has emerged developing algorithms to estimate the replicability of published…

Digital Libraries · Computer Science 2024-05-06 Chuhao Wu , Tatiana Chakravorti , John Carroll , Sarah Rajtmajer

This paper introduces reproducible research, and explains its importance, benefits and challenges. Some important tools for conducting reproducible research in Transportation Research are also introduced. Moreover, the source code for…

Digital Libraries · Computer Science 2021-05-17 Zuduo Zheng

Reproducible computational research (RCR) is the keystone of the scientific method for in silico analyses, packaging the transformation of raw data to published results. In addition to its role in research integrity, RCR has the capacity to…

Digital Libraries · Computer Science 2021-04-20 Jeremy Leipzig , Daniel Nüst , Charles Tapley Hoyt , Stian Soiland-Reyes , Karthik Ram , Jane Greenberg

Reproducibility has been consistently identified as an important component of scientific research. Although there is a general consensus on the importance of reproducibility along with the other commonly used 'R' terminology (i.e.,…

Information Theory · Computer Science 2020-12-29 Anirudh Prabhu , Peter Fox

The high incidence of irreproducible research has led to urgent appeals for transparency and equitable practices in open science. For the scientific disciplines that rely on computationally intensive analyses of large data sets, a granular…

The field of deep learning has witnessed significant breakthroughs, spanning various applications, and fundamentally transforming current software capabilities. However, alongside these advancements, there have been increasing concerns…

Machine Learning · Computer Science 2025-05-07 Nikita Ravi , Abhinav Goel , James C. Davis , George K. Thiruvathukal

Achieving complete reproducibility in science, particularly in research fields such as biodiversity, is challenging due to analytical choices, bias and interpretation. Here, we examine examples of reproducibility in biological systematics,…

Other Quantitative Biology · Quantitative Biology 2025-08-01 Charles Morphy D. Santos , Luciana Campos Paulino , Michaella P. Andrade , Gabriel Tognella-Poccia , João Paulo Gois

Scientific data governance should prioritize maximizing the utility of data throughout the research lifecycle. Research software systems that enable analysis reproducibility inform data governance policies and assist administrators in…

This is the second part of a small-scale explorative study in an effort to assess reproducibility issues specific to scientometrics research. This effort is motivated by the desire to generate empirical data to inform debates about…

Digital Libraries · Computer Science 2018-04-16 Theresa Velden , Sybille Hinze , Andrea Scharnhorst , Jesper Wiborg Schneider , Ludo Waltman

In the rapidly evolving fields of Artificial Intelligence (AI) and Machine Learning (ML), the reproducibility crisis underscores the urgent need for clear validation methodologies to maintain scientific integrity and encourage advancement.…

Computers and Society · Computer Science 2025-04-01 Abhyuday Desai , Mohamed Abdelhamid , Nakul R. Padalkar

In biomedical research, validation of a new scientific discovery is tied to the reproducibility of its experimental results. However, in genomics, the definition and implementation of reproducibility still remain imprecise. Here, we argue…

The aim of this article is to introduce a reporting framework for reproducible, interactive research applied to Big Clinical Data, based on open source technologies. The framework is constituted by the following three axes: (i) data, (ii)…

The drive for reproducibility in the computational sciences has provoked discussion and effort across a broad range of perspectives: technological, legislative/policy, education, and publishing. Discussion on these topics is not new, but…

Quantitative Methods · Quantitative Biology 2018-10-10 Daniel G. Hurley , Joseph Cursons , Matthew Faria , David M. Budden , Vijay Rajagopal , Edmund J. Crampin

Scientific knowledge increasingly depends on complex computational processes where both hardware and software layers can influence research outcomes. As computational complexity grows, classical-quantum integration provides a lens for…

Emerging Technologies · Computer Science 2026-03-06 Anna Vrtiak , Duuk Baten , Ariana Torres-Knoop

Modern technologies are enabling scientists to collect extraordinary amounts of complex and sophisticated data across a huge range of scales like never before. With this onslaught of data, we can allow the focal point to shift towards…

This is the first part of a small-scale explorative study in an effort to start assessing reproducibility issues specific to scientometrics research. This effort is motivated by the desire to generate empirical data to inform debates about…

Digital Libraries · Computer Science 2018-04-16 Ludo Waltman , Sybille Hinze , Andrea Scharnhorst , Jesper Wiborg Schneider , Theresa Velden

Replication crises have shaken the scientific landscape during the last decade. As potential solutions, open science practices were heavily discussed and have been implemented with varying success in different disciplines. We argue that…

Computers and Society · Computer Science 2023-10-05 David Schoch , Chung-hong Chan , Claudia Wagner , Arnim Bleier

It is recommended that teacher-scholars of data science adopt reproducible workflows in their research as scholars and teach reproducible workflows to their students. In this paper, we propose a third dimension to reproducibility practices…

Other Statistics · Statistics 2024-07-23 Mine Dogucu , Mine Cetinkaya-Rundel

In the past decade, open science and science of science communities have initiated innovative efforts to address concerns about the reproducibility and replicability of published scientific research. In some respects, these efforts have…

Human-Computer Interaction · Computer Science 2024-02-15 Tatiana Chakravorti , Sai Dileep Koneru , Sarah Rajtmajer

Reproducibility remains a central challenge in computational social science, where complex workflows, evolving software ecosystems, and inconsistent documentation hinder researchers ability to re-execute published methods. This study…

Human-Computer Interaction · Computer Science 2026-03-04 Fakhri Momeni , Sarah Sajid , Johannes Kiesel