English
Related papers

Related papers: Beyond Arbitrary Replications: A Principled Approa…

200 papers

Clustering and dependence are common in trials. For example, in some cluster randomized trials (CRTs), pre-existing clusters are enrolled, randomized, and serve as the basis of intervention delivery. Such CRTs are "fully clustered":…

Causal discovery can be a powerful tool for investigating causality when a system can be observed but is inaccessible to experiments in practice. Despite this, it is rarely used in any scientific or medical fields. One of the major hurdles…

Machine Learning · Statistics 2019-10-07 Erich Kummerfeld , Alexander Rix

Unmeasured confounding presents a significant challenge in causal inference from observational studies. Classical approaches often rely on collecting proxy variables, such as instrumental variables. However, in applications where the…

Methodology · Statistics 2025-01-16 Xiaochuan Shi , Dehan Kong , Linbo Wang

Calibration of expensive simulation models involves an emulator based on simulation outputs generated across various parameter settings to replace the actual model. Noisy outputs of stochastic simulation models require many simulation…

Methodology · Statistics 2025-05-08 Özge Sürer

Computational models of complex systems are usually elaborate and sensitive to implementation details, characteristics which often affect their verification and validation. Model replication is a possible solution to this issue. It avoids…

Other Computer Science · Computer Science 2017-01-09 Nuno Fachada , Vitor V. Lopes , Rui C. Martins , Agostinho C. Rosa

Treatment effect estimation involves assessing the impact of different treatments on individual outcomes. Current methods estimate Conditional Average Treatment Effect (CATE) using observational datasets where covariates are collected…

Machine Learning · Computer Science 2025-02-10 Lokesh Nagalapatti , Pranava Singhal , Avishek Ghosh , Sunita Sarawagi

Generalized linear mixed models are useful in studying hierarchical data with possibly non-Gaussian responses. However, the intractability of likelihood functions poses challenges for estimation. We develop a new method suitable for this…

Methodology · Statistics 2022-01-26 Zexi Song , Zhiqiang Tan

How should researchers analyze randomized experiments in which the main outcome is latent and measured in multiple ways but each measure contains some degree of error? We first identify a critical study-specific noncomparability problem in…

Econometrics · Economics 2026-01-13 Jiawei Fu , Donald P. Green

Synthetic control (SC) methods are commonly used to estimate the treatment effect on a single treated unit in panel data settings. An SC is a weighted average of control units built to match the treated unit, with weights typically…

Methodology · Statistics 2023-02-21 Xu Shi , Kendrick Li , Wang Miao , Mengtong Hu , Eric Tchetgen Tchetgen

We investigate the merits of replication, and provide methods for optimal design (including replicates), with the goal of obtaining globally accurate emulation of noisy computer simulation experiments. We first show that replication can be…

Methodology · Statistics 2019-01-28 Mickael Binois , Jiangeng Huang , Robert B Gramacy , Mike Ludkovski

Multivariate outcomes are common in pragmatic cluster randomized trials. While sample size calculation procedures for multivariate outcomes exist under parallel assignment, none have been developed for a stepped wedge design. In this…

Methodology · Statistics 2022-12-05 Kendra Davis-Plourde , Monica Taljaard , Fan Li

Simulations are valuable tools for empirically evaluating the properties of statistical methods and are primarily employed in methodological research to draw general conclusions about methods. In addition, they can often be useful to…

Other Statistics · Statistics 2025-10-08 Anne-Laure Boulesteix , Patrick Callahan , Luzia Hanssum , Vincent Gaertner , Eva Hoster

Consider the problem of determining the effect of a compound on a specific cell type. To answer this question, researchers traditionally need to run an experiment applying the drug of interest to that cell type. This approach is not…

Methodology · Statistics 2023-06-13 Chandler Squires , Dennis Shen , Anish Agarwal , Devavrat Shah , Caroline Uhler

Scientific knowledge expands by observing the world, hypothesizing some theories about it, and testing them against collected data. When those theories take the form of statistical models, statistical analyses are involved in the process of…

Machine Learning · Statistics 2026-03-11 Arnaud Delaunoy

Simulation has emerged as a popular method to study the long-term societal consequences of recommender systems. This approach allows researchers to specify their theoretical model explicitly and observe the evolution of system-level…

Computers and Society · Computer Science 2021-07-29 Eli Lucherini , Matthew Sun , Amy Winecoff , Arvind Narayanan

We develop new methods to integrate experimental and observational data in causal inference. While randomized controlled trials offer strong internal validity, they are often costly and therefore limited in sample size. Observational data,…

Econometrics · Economics 2025-11-04 Xuelin Yang , Licong Lin , Susan Athey , Michael I. Jordan , Guido W. Imbens

Causal inference from observational data provides strong evidence for the best action in decision-making without performing expensive randomized trials. The effect of an action is usually not identifiable under unobserved confounding, even…

Machine Learning · Computer Science 2026-02-02 Md Musfiqur Rahman , Ziwei Jiang , Hilaf Hasson , Murat Kocaoglu

Training data attribution (TDA) methods offer to trace a model's prediction on any given example back to specific influential training examples. Existing approaches do so by assigning a scalar influence score to each training example, under…

Machine Learning · Computer Science 2023-03-15 Kelvin Guu , Albert Webson , Ellie Pavlick , Lucas Dixon , Ian Tenney , Tolga Bolukbasi

We study Federated Causal Inference, an approach to estimate treatment effects from decentralized data across centers. We compare three classes of Average Treatment Effect (ATE) estimators derived from the Plug-in G-Formula, ranging from…

Machine Learning · Statistics 2025-03-26 Rémi Khellaf , Aurélien Bellet , Julie Josse

Results of simulation studies evaluating the performance of statistical methods are often considered actionable and thus can have a major impact on the way empirical research is implemented. However, so far there is limited evidence about…