English
Related papers

Related papers: Beyond Arbitrary Replications: A Principled Approa…

200 papers

Non-adherence to assigned treatment is common in randomised controlled trials (RCTs). Recently, there has been an increased interest in estimating causal effects of treatment received, for example the so-called local average treatment…

Methodology · Statistics 2018-12-05 Karla DiazOrdaz , James Carpenter

Estimating heterogeneous treatment effects with machine learning has attracted substantial attention in both academic research and industrial practice. However, the two communities often evaluate models under markedly different conditions.…

Machine Learning · Computer Science 2026-05-26 George Panagopoulos

Machine learning (ML) models are increasingly used as decision-support tools in high-risk domains. Evaluating the causal impact of deploying such models can be done with a randomized controlled trial (RCT) that randomizes users to ML vs.…

Methodology · Statistics 2025-07-17 Jacob M. Chen , Michael Oberst

Generating synthetic datasets that accurately reflect real-world observational data is critical for evaluating causal estimators, but it remains a challenging task. Existing generative methods offer a solution by producing synthetic…

Machine Learning · Computer Science 2026-04-07 Pracheta Amaranath , Vinitra Muralikrishnan , Amit Sharma , David Jensen

Reproducibility is a fundamental requirement for validating scientific claims in computational research. Stochastic computational models are widely used in fields such as systems biology, financial modeling and environmental sciences.…

Bayesian parameter inference for complex stochastic simulators is challenging due to intractable likelihood functions. Existing simulation-based inference methods often require large number of simulations and become costly to use in…

Machine Learning · Computer Science 2026-04-06 Vasilis Gkolemis , Christos Diou , Michael U. Gutmann

Evidence syntheses and meta-analyses are used to inform clinical practice guidelines and health economic evaluations. However, heterogeneity of treatment effects poses a significant challenge. Conventional meta-analysis addresses…

In this work, we consider causal inference in various high-dimensional treatment settings, including for single multi-valued treatments and vector treatments with binary or continuous components, when the number of treatments can be…

Statistics Theory · Mathematics 2026-02-26 Patrick Kramer , Edward H. Kennedy , Isaac M. Opper

Nested simulation is a natural approach to tackle nested estimation problems in operations research and financial engineering. The outer-level simulation generates outer scenarios and the inner-level simulations are run in each outer…

Risk Management · Quantitative Finance 2022-03-31 Kun Zhang , Ben Mingbin Feng , Guangwu Liu , Shiyu Wang

Causal inference problems often involve continuous treatments, such as dose, duration, or frequency. However, identifying and estimating standard dose-response estimands requires that everyone has some chance of receiving any level of the…

Methodology · Statistics 2026-01-28 Kyle Schindl , Shuying Shen , Edward H. Kennedy

In the absence of randomized controlled and natural experiments, it is necessary to balance the distributions of (observable) covariates of the treated and control groups in order to obtain an unbiased estimate of a causal effect of…

Methodology · Statistics 2022-03-02 Martin Cousineau , Vedat Verter , Susan A. Murphy , Joelle Pineau

CONTEXT: There is growing interest in establishing software engineering as an evidence-based discipline. To that end, replication is often used to gain confidence in empirical findings, as opposed to reproduction where the goal is showing…

Software Engineering · Computer Science 2018-02-14 Martin Shepperd

Causal inference methods are widely applied in various decision-making domains such as precision medicine, optimal policy and economics. Central to causal inference is the treatment effect estimation of intervention strategies, such as…

Artificial Intelligence · Computer Science 2021-05-31 Tri Dung Duong , Qian Li , Guandong Xu

Randomized A/B tests within online learning platforms represent an exciting direction in learning sciences. With minimal assumptions, they allow causal effect estimation without confounding bias and exact statistical inference even in small…

Methodology · Statistics 2023-06-13 Adam C. Sales , Ethan B. Prihar , Johann A. Gagnon-Bartsch , Neil T. Heffernan

In this paper, we introduce a unified estimator to analyze various treatment effects in causal inference, including but not limited to the average treatment effect (ATE) and the quantile treatment effect (QTE). The proposed estimator is…

Methodology · Statistics 2025-03-31 Kuan-Hsun Wu , Li-Pang Chen

Dose-finding trials are a key component of the drug development process and rely on a statistical design to help inform dosing decisions. Triallists wishing to choose a design require knowledge of operating characteristics of competing…

Computation · Statistics 2025-03-11 Michael Sweeting , Daniel Slade , Dan Jackson , Kristian Brock

Method validation and study design in causal inference rely on synthetic data with known counterfactuals. Existing simulators trade off distributional realism, the ability to capture mixed-type and multimodal tabular data, against causal…

Methodology · Statistics 2026-03-05 Qi Zhang , Harsh Parikh , Ashley Naimi , Razieh Nabi , Christopher Kim , Timothy Lash

Applied researchers in biomedicine and related fields are often interested in estimating the causal effect of a treatment or intervention. Although randomized clinical trials are considered the gold standard for establishing causal effects,…

Randomized clinical trials (RCTs) are ideal for estimating causal effects, because the distributions of background covariates are similar in expectation across treatment groups. When estimating causal effects using observational data,…

Methodology · Statistics 2019-02-27 Anthony D. Scotina , Roee Gutman

The past decade has seen an increasing body of literature devoted to the estimation of causal effects in network-dependent data. However, the validity of many classical statistical methods in such data is often questioned. There is an…

Computation · Statistics 2017-05-31 Oleg Sofrygin , Romain Neugebauer , Mark J. van der Laan