English
Related papers

Related papers: A Decision Tree to Shepherd Scientists through Dat…

200 papers

A reproducibility crisis has been reported in science, but the extent to which it affects AI research is not yet fully understood. Therefore, we performed a systematic replication study including 30 highly cited AI studies relying on…

Artificial Intelligence · Computer Science 2024-12-25 Odd Erik Gundersen , Odd Cappelen , Martin Mølnå , Nicklas Grimstad Nilsen

The use of machine learning algorithms in finance, medicine, and criminal justice can deeply impact human lives. As a consequence, research into interpretable machine learning has rapidly grown in an attempt to better control and fix…

Machine Learning · Computer Science 2021-02-02 Thibaut Vidal , Toni Pacheco , Maximilian Schiffer

Empirical science needs to be based on facts and claims that can be reproduced. This calls for replicating the studies that proclaim the claims, but practice in most fields still fails to implement this idea. When such studies emerged in…

Other Statistics · Statistics 2025-08-27 Werner A. Stahel

What makes a paper independently reproducible? Debates on reproducibility center around intuition or assumptions but lack empirical results. Our field focuses on releasing code, which is important, but is not sufficient for determining…

Machine Learning · Computer Science 2019-09-17 Edward Raff

Recently, much attention has been focused on the replicability of scientific results, causing scientists, statisticians, and journal editors to examine closely their methodologies and publishing criteria. Experimental particle physicists…

Data Analysis, Statistics and Probability · Physics 2021-05-07 Thomas R. Junk , Louis Lyons

Many research directions in machine learning, particularly in deep learning, involve complex, multi-stage experiments, commonly involving state-mutating operations acting on models along multiple paths of execution. Although machine…

Software Engineering · Computer Science 2020-06-16 Michela Paganini , Jessica Zosa Forde

Difficulties in replication and reproducibility of empirical evidences in machine learning research have become a prominent topic in recent years. Ensuring that machine learning research results are sound and reliable requires…

Machine Learning · Computer Science 2024-03-20 Tobias Hille , Maximilian Stubbemann , Tom Hanika

In cancer research, clustering techniques are widely used for exploratory analyses and dimensionality reduction, playing a critical role in the identification of novel cancer subtypes, often with direct implications for patient management.…

In this article I propose an approach for defining replicability for prediction rules. Motivated by a recent NAS report, I start from the perspective that replicability is obtaining consistent results across studies suitable to address the…

Methodology · Statistics 2023-05-03 Giovanni Parmigiani

In this paper, we investigate the retrievability of datasets and publications in a real-life Digital Library (DL). The measure of retrievability was originally developed to quantify the influence that a retrieval system has on the access to…

Information Retrieval · Computer Science 2022-07-22 Dwaipayan Roy , Zeljko Carevic , Philipp Mayr

Over the recent years the importance of numerical experiments has gradually been more recognized. Nonetheless, sufficient documentation of how computational results have been obtained is often not available. Especially in the scientific…

Mathematical Software · Computer Science 2021-05-10 Jörg Fehr , Jan Heiland , Christian Himpe , Jens Saak

Decision trees are a popular family of models due to their attractive properties such as interpretability and ability to handle heterogeneous data. Concurrently, missing data is a prevalent occurrence that hinders performance of machine…

Machine Learning · Computer Science 2020-07-01 Pasha Khosravi , Antonio Vergari , YooJung Choi , Yitao Liang , Guy Van den Broeck

Open science initiatives seek to make research outputs more transparent, accessible, and reusable, but ensuring that published findings can be independently reproduced remains a persistent challenge. In this paper we describe an AI-driven…

Artificial Intelligence · Computer Science 2025-12-16 Adrien Bibal , Steven N. Minton , Deborah Khider , Yolanda Gil

As research increasingly relies on computational methods, the reliability of scientific results depends on the quality, reproducibility, and transparency of research software. Ensuring these qualities is critical for scientific integrity…

Software Engineering · Computer Science 2025-10-14 Evan Eisinger , Michael A. Heroux

Dynamic regression trees are an attractive option for automatic regression and classification with complicated response surfaces in on-line application settings. We create a sequential tree model whose state changes in time with the…

Methodology · Statistics 2010-11-23 Matthew A. Taddy , Robert B. Gramacy , Nicholas G. Polson

Citations are the cornerstone of knowledge propagation and the primary means of assessing the quality of research, as well as directing investments in science. Science is increasingly becoming "data-intensive", where large volumes of data…

Digital Libraries · Computer Science 2017-09-28 Gianmaria Silvello

Computational methods have reshaped the landscape of modern biology. While the biomedical community is increasingly dependent on computational tools, the mechanisms ensuring open data, open software, and reproducibility are variably…

Other Quantitative Biology · Quantitative Biology 2020-07-28 Jaqueline J. Brito , Jun Li , Jason H. Moore , Casey S. Greene , Nicole A. Nogoy , Lana X. Garmire , Serghei Mangul

The increasing ease of data capture and storage has led to a corresponding increase in the choice of data, the type of analysis performed on that data, and the complexity of the analysis performed. The main contribution of this paper is to…

Applications · Statistics 2018-03-14 David Kohn , Nick Glozier , Ian B. Hickie , Hugh Durrant-Whyte , Sally Cripps

Making data compliant with the FAIR Data principles (Findable, Accessible, Interoperable, Reusable) is still a challenge for many researchers, who are not sure which criteria should be met first and how. Illustrated from experimental data…

Other Quantitative Biology · Quantitative Biology 2020-12-18 Daniel Jacob , Romain David , Sophie Aubin , Yves Gibon

Deep learning (DL) techniques have gained significant popularity among software engineering (SE) researchers in recent years. This is because they can often solve many SE challenges without enormous manual feature engineering effort and…

Software Engineering · Computer Science 2024-12-10 Chao Liu , Cuiyun Gao , Xin Xia , David Lo , John Grundy , Xiaohu Yang