English
Related papers

Related papers: Sensitivity Analysis when Generalizing Causal Effe…

200 papers

Unobserved confounding is common in many applications, making causal inference from observational data challenging. As a remedy, causal sensitivity analysis is an important tool to draw causal conclusions under unobserved confounding with…

Machine Learning · Computer Science 2024-04-10 Dennis Frauen , Fergus Imrie , Alicia Curth , Valentyn Melnychuk , Stefan Feuerriegel , Mihaela van der Schaar

We consider the estimation of measures of model performance in a target population when covariate and outcome data are available on a sample from some source population and covariate data, but not outcome data, are available on a simple…

Methodology · Statistics 2023-06-16 Jon A. Steingrimsson , Sarah E. Robertson , Issa J. Dahabreh

Uncertainty quantification is central to many applications of causal machine learning, yet principled Bayesian inference for causal effects remains challenging. Standard Bayesian approaches typically require specifying a probabilistic model…

Machine Learning · Statistics 2026-03-04 Emil Javurek , Dennis Frauen , Yuxin Wang , Stefan Feuerriegel

Ensuring robust model performance in diverse real-world scenarios requires addressing generalizability across domains with covariate shifts. However, no formal procedure exists for statistically evaluating generalizability in machine…

Machine Learning · Computer Science 2025-06-13 Daniel de Vassimon Manela , Linying Yang , Robin J. Evans

Many existing approaches to generalizing statistical inference amidst distribution shift operate under the covariate shift assumption, which posits that the conditional distribution of unobserved variables given observable ones is invariant…

Applications · Statistics 2024-12-13 Ying Jin , Naoki Egami , Dominik Rothenhäusler

In the absence of a randomized experiment, a key assumption for drawing causal inference about treatment effects is the ignorable treatment assignment. Violations of the ignorability assumption may lead to biased treatment effect estimates.…

Methodology · Statistics 2021-08-17 Liangyuan Hu , Jungang Zou , Chenyang Gu , Jiayi Ji , Michael Lopez , Minal Kale

The widely used 'Counterfactual' definition of Causal Effects was derived for unbiasedness and accuracy - and not generalizability. We propose a Combinatorial definition for the External Validity (EV) of intervention effects. We first…

Methodology · Statistics 2025-04-18 Andre F. Ribeiro

We develop a general theory of omitted variable bias for a wide range of common causal parameters, including (but not limited to) averages of potential outcomes, average treatment effects, average causal derivatives, and policy effects from…

Econometrics · Economics 2024-05-28 Victor Chernozhukov , Carlos Cinelli , Whitney Newey , Amit Sharma , Vasilis Syrgkanis

Generalizing treatment effects from a randomized trial to a target population requires the assumption that potential outcome distributions are invariant across populations after conditioning on observed covariates. This assumption fails…

Methodology · Statistics 2026-04-16 Amir Asiaee , Samhita Pal , Cole Beck , Jared D. Huling

Sensitivity Analysis is a framework to assess how conclusions drawn from missing outcome data may be vulnerable to departures from untestable underlying assumptions. We extend the E-value, a popular metric for quantifying robustness of…

Methodology · Statistics 2021-08-31 Wu Xue , Abbas Zaidi

In the presence of treatment effect heterogeneity, the average treatment effect (ATE) in a randomized controlled trial (RCT) may differ from the average effect of the same treatment if applied to a target population of interest. If all…

Methodology · Statistics 2017-05-02 Trang Quynh Nguyen , Cyrus Ebnesajjad , Stephen R. Cole , Elizabeth A. Stuart

Standard approaches in generalizability often focus on generalizing the intent-to-treat (ITT). However, in practice, a more policy-relevant quantity is the generalized impact of an intervention across compliers. While instrumental variable…

Methodology · Statistics 2025-06-03 Zhongren Chen , Melody Huang

The case$^2$ study, also referred to as the case-case study design, is a valuable approach for conducting inference for treatment effects. Unlike traditional case-control studies, the case$^2$ design compares treatment in two types of cases…

Methodology · Statistics 2025-03-03 Kan Chen , Ting Ye , Dylan S. Small

Recent work has made important contributions in the development of causally-interpretable meta-analysis. These methods transport treatment effects estimated in a collection of randomized trials to a target population of interest. Ideally,…

Methodology · Statistics 2023-02-08 Justin M. Clark , Kollin W. Rott , James S. Hodges , Jared D. Huling

When estimating causal effects, it is important to assess external validity, i.e., determine how useful a given study is to inform a practical question for a specific target population. One challenge is that the covariate distribution in…

Methodology · Statistics 2025-01-03 Zhenghao Zeng , Edward H. Kennedy , Lisa M. Bodnar , Ashley I. Naimi

Consider sensitivity analysis for estimating average treatment effects under unmeasured confounding, assumed to satisfy a marginal sensitivity model. At the population level, we provide new representations for the sharp population bounds…

Methodology · Statistics 2022-09-26 Zhiqiang Tan

A key objective of decomposition analysis is to identify a factor (the 'mediator') contributing to disparities in an outcome between social groups. In decomposition analysis, a scholarly interest often centers on estimating how much the…

Methodology · Statistics 2022-05-27 Soojin Park , Suyeon Kang , Chioun Lee , Shujie Ma

A fundamental limitation of causal inference in observational studies is that perceived evidence for an effect might instead be explained by factors not accounted for in the primary analysis. Methods for assessing the sensitivity of a…

Methodology · Statistics 2018-09-14 Colin B. Fogarty

While much of the causal inference literature has focused on addressing internal validity biases, both internal and external validity are necessary for unbiased estimates in a target population of interest. However, few generalizability…

Methodology · Statistics 2023-04-07 Irina Degtiar , Tim Layton , Jacob Wallace , Sherri Rose

Practitioners in diverse fields such as healthcare, economics and education are eager to apply machine learning to improve decision making. The cost and impracticality of performing experiments and a recent monumental increase in electronic…

Machine Learning · Computer Science 2023-08-01 Fredrik D. Johansson , Uri Shalit , Nathan Kallus , David Sontag