English
Related papers

Related papers: Defining Replicability of Prediction Rules

200 papers

Interpretability is becoming increasingly important for predictive model analysis. Unfortunately, as remarked by many authors, there is still no consensus regarding this notion. The goal of this paper is to propose the definition of a score…

Machine Learning · Statistics 2021-11-24 Vincent Margot , George Luta

The high incidence of irreproducible research has led to urgent appeals for transparency and equitable practices in open science. For the scientific disciplines that rely on computationally intensive analyses of large data sets, a granular…

The reproducibility of scientific articles is central to the advancement of science. Despite this importance, evaluating reproducibility remains challenging due to the scarcity of ground truth data. Predictive models can address this…

Digital Libraries · Computer Science 2024-10-25 Akhil Pandey Akella , Sagnik Ray Choudhury , David Koop , Hamed Alhoori

Reproducibility of modeling is a problem that exists for any machine learning practitioner, whether in industry or academia. The consequences of an irreproducible model can include significant financial costs, lost time, and even loss of…

Machine Learning · Computer Science 2018-10-11 Peter Sugimura , Florian Hartl

Reproducibility, the ability to recompute results, and replicability, the chances other experimenters will achieve a consistent result, are two foundational characteristics of successful scientific research. Consistent findings from…

Applications · Statistics 2015-06-23 Jeffrey T. Leek , Roger D. Peng

A hypothesis testing algorithm is replicable if, when run on two different samples from the same distribution, it produces the same output with high probability. This notion, defined by by Impagliazzo, Lei, Pitassi, and Sorell [STOC'22],…

Data Structures and Algorithms · Computer Science 2025-09-05 Anders Aamand , Maryam Aliakbarpour , Justin Y. Chen , Shyam Narayanan , Sandeep Silwal

Background: Many published machine learning studies are irreproducible. Issues with methodology and not properly accounting for variation introduced by the algorithm themselves or their implementations are attributed as the main…

Machine Learning · Computer Science 2023-04-17 Odd Erik Gundersen , Kevin Coakley , Christine Kirkpatrick , Yolanda Gil

Background. Reproducibility is essential to the scientific method, but reproduction is often a laborious task. Recent works have attempted to automate this process and relieve researchers of this workload. However, due to varying…

Computers and Society · Computer Science 2026-01-09 Thijs Snelleman , Peter Lundestad Lawrence , Holger H. Hoos , Odd Erik Gundersen

The notion of replicable algorithms was introduced in Impagliazzo et al. [STOC '22] to describe randomized algorithms that are stable under the resampling of their inputs. More precisely, a replicable algorithm gives the same output with…

Machine Learning · Computer Science 2023-03-28 Mark Bun , Marco Gaboardi , Max Hopkins , Russell Impagliazzo , Rex Lei , Toniann Pitassi , Satchit Sivakumar , Jessica Sorrell

Two goals - improving replicability and accountability of Machine Learning research respectively, have accrued much attention from the AI ethics and the Machine Learning community. Despite sharing the measures of improving transparency, the…

Computers and Society · Computer Science 2025-08-14 Tianqi Kou

The study of complex systems has attracted widespread attention from researchers in the fields of natural sciences, social sciences, and engineering. Prediction is one of the central issues in this field. Although most related studies have…

Physics and Society · Physics 2025-10-21 En Xu , Yilin Bi , Hongwei Hu , Xin Chen , Zhiwen Yu , Yong Li , Yanqing Hu , Tao Zhou

We investigate replicable learning algorithms. Ideally, we would like to design algorithms that output the same canonical model over multiple runs, even when different runs observe a different set of samples from the unknown data…

Machine Learning · Computer Science 2023-04-06 Peter Dixon , A. Pavan , Jason Vander Woude , N. V. Vinodchandran

In biomedical research, validation of a new scientific discovery is tied to the reproducibility of its experimental results. However, in genomics, the definition and implementation of reproducibility still remain imprecise. Here, we argue…

To encourage the development of methods with reproducible and robust training behavior, we propose a challenge paradigm where competitors are evaluated directly on the performance of their learning procedures rather than pre-trained agents.…

Conformal prediction has been a very popular method of distribution-free predictive inference in recent years in machine learning and statistics. Its popularity stems from the fact that it works as a wrapper around any prediction algorithm…

Methodology · Statistics 2021-06-07 Arun Kumar Kuchibhotla

Replicability is essential in science as it allows us to validate and verify research findings. Impagliazzo, Lei, Pitassi and Sorrell (`22) recently initiated the study of replicability in machine learning. A learning algorithm is…

Machine Learning · Computer Science 2023-04-13 Zachary Chase , Shay Moran , Amir Yehudayoff

One of the challenges in machine learning research is to ensure that presented and published results are sound and reliable. Reproducibility, that is obtaining similar results as presented in a paper or talk, using the same code and data…

In this work, we investigate an intriguing and prevalent phenomenon of diffusion models which we term as "consistent model reproducibility": given the same starting noise input and a deterministic sampler, different diffusion models often…

Machine Learning · Computer Science 2024-06-11 Huijie Zhang , Jinfan Zhou , Yifu Lu , Minzhe Guo , Peng Wang , Liyue Shen , Qing Qu

Users of program analyses expect that results change predictably in response to changes in their programs, but many analyses fail to provide such robustness. This paper introduces a theoretical framework that provides a unified language to…

Programming Languages · Computer Science 2026-04-14 Zachary Kincaid , Shaowei Zhu

Replication studies estimate the replicability rate of scientific results by aggregating binary verdicts of experiments. Exact replications are rarely attainable, so most replication sequences are non-exact. Experiments differ in ways that…

Applications · Statistics 2026-04-30 Berna Devezer , Erkan O. Buzbas