English
Related papers

Related papers: Power Calculations for Replication Studies

200 papers

In many scientific experiments, the data annotating cost constraints the pace for testing novel hypotheses. Yet, modern machine learning pipelines offer a promising solution, provided their predictions yield correct conclusions. We focus on…

The increasing multiplicity of data sources offers exciting possibilities in estimating the effects of a treatment, intervention, or exposure, particularly if observational and experimental sources could be used simultaneously. Borrowing…

Methodology · Statistics 2020-03-24 Jeffrey A. Boatman , David M. Vock , Joseph S. Koopmeiners

When designing experimental studies with human participants, experimenters must decide how many trials each participant will complete, as well as how many participants to test. Most discussion of statistical power (the ability of a study…

Neurons and Cognition · Quantitative Biology 2021-08-30 Daniel H. Baker , Greta Vilidaite , Freya A. Lygo , Anika K. Smith , Tessa R. Flack , Andre D. Gouws , Timothy J. Andrews

We study a statistical framework for replicability based on a recently proposed quantitative measure of replication success, the sceptical $p$-value. A recalibration is proposed to obtain exact overall Type-I error control if the effect is…

Methodology · Statistics 2023-11-10 Charlotte Micheloud , Fadoua Balabdaoui , Leonhard Held

Replicability analysis aims to identify the findings that replicated across independent studies that examine the same features. We provide powerful novel replicability analysis procedures for two studies for FWER and for FDR control on the…

Methodology · Statistics 2019-03-01 Marina Bogomolov , Ruth Heller

Decision making is often based on Bayesian networks. The building blocks for Bayesian networks are its conditional probability tables (CPTs). These tables are obtained by parameter estimation methods, or they are elicited from subject…

Artificial Intelligence · Computer Science 2015-12-31 Wolfgang Garn , Panos Louvieris

Clinicians and scientists have traditionally focussed on whether their findings will be replicated and are very familiar with the concept. The probability that a replication study yields an effect with the same sign, or the same statistical…

Applications · Statistics 2025-12-17 Huw Llewelyn

The statistical evidence (or marginal likelihood) is a key quantity in Bayesian statistics, allowing one to assess the probability of the data given the model under investigation. This paper focuses on refining the power posterior approach…

Computation · Statistics 2013-06-14 Nial Friel , Merrilee Hurn , Jason Wyse

Recent decades have seen an interest in prediction problems for which Bayesian methodology has been used ubiquitously. Sampling from or approximating the posterior predictive distribution in a Bayesian model allows one to make inferential…

Machine Learning · Statistics 2017-09-12 Giri Gopalan

The power prior and its variations have been proven to be a useful class of informative priors in Bayesian inference due to their flexibility in incorporating the historical information by raising the likelihood of the historical data to a…

Methodology · Statistics 2022-04-14 Zifei Han , Keying Ye , Min Wang

This paper explores an approach to Bayesian sample size determination in clinical trials. The approach falls into the category of what is often called "proper Bayesian", in that it does not mix frequentist concepts with Bayesian ones. A…

Methodology · Statistics 2012-04-23 Robb J. Muirhead , Adina I. Soaita

Before embarking on data collection, researchers typically compute how many individual observations they should do. This is vital for doing studies with sufficient statistical power, and often a cornerstone in study pre-registrations and…

Methodology · Statistics 2023-09-06 Edwin S Dalmaijer

Statistical significance of both the original and the replication study is a commonly used criterion to assess replication attempts, also known as the two-trials rule in drug development. However, replication studies are sometimes conducted…

Applications · Statistics 2024-05-31 Leonhard Held , Samuel Pawel , Charlotte Micheloud

Hybrid studies allow investigators to simultaneously study an intervention effectiveness outcome and an implementation research outcome. In particular, type 2 hybrid studies support research that places equal importance on both outcomes…

Most statistical tests for treatment effects used in randomized clinical trials with survival outcomes are based on the proportional hazards assumption, which often fails in practice. Data from early exploratory studies may provide evidence…

Statistics Theory · Mathematics 2020-05-28 Andrea Arfé , Brian Alexander , Lorenzo Trippa

Surrogate markers are often employed in clinical trials to replace primary outcomes that may be difficult, expensive, or time-consuming to measure directly. These markers can accelerate the evaluation of new treatments, provided they…

Methodology · Statistics 2026-03-17 Pietro Carlotti , Layla Parast

Increased availability of data and accessibility of computational tools in recent years have created unprecedented opportunities for scientific research driven by statistical analysis. Inherent limitations of statistics impose constrains on…

Genomics · Quantitative Biology 2016-09-13 Olga A. Vsevolozhskaya , Gabriel Ruiz , Dmitri V. Zaykin

We consider large-scale studies in which it is of interest to test a very large number of hypotheses, and then to estimate the effect sizes corresponding to the rejected hypotheses. For instance, this setting arises in the analysis of gene…

Methodology · Statistics 2015-03-31 Kean Ming Tan , Noah Simon , Daniela Witten

Field experiments are often difficult and expensive to make. To bypass these issues, industrial companies have developed computational codes. These codes intend to be representative of the physical system, but come with a certain amount of…

Computation · Statistics 2019-03-26 Mathieu Carmassi , Pierre Barbillon , Merlin Keller , Eric Parent , Matthieu Chiodetti

Design of experiments has traditionally relied on the frequentist hypothesis testing framework where the optimal size of the experiment is specified as the minimum sample size that guarantees a required level of power. Sample size…

Methodology · Statistics 2025-08-07 Shirin Golchi , Luke Hagar