English

Transfer Learning for Causal Effect Estimation

Machine Learning 2024-01-02 v3 Statistics Theory Methodology Machine Learning Statistics Theory

Abstract

We present a Transfer Causal Learning (TCL) framework when target and source domains share the same covariate/feature spaces, aiming to improve causal effect estimation accuracy in limited data. Limited data is very common in medical applications, where some rare medical conditions, such as sepsis, are of interest. Our proposed method, named \texttt{1\ell_1-TCL}, incorporates 1\ell_1 regularized TL for nuisance models (e.g., propensity score model); the TL estimator of the nuisance parameters is plugged into downstream average causal/treatment effect estimators (e.g., inverse probability weighted estimator). We establish non-asymptotic recovery guarantees for the \texttt{1\ell_1-TCL} with generalized linear model (GLM) under the sparsity assumption in the high-dimensional setting, and demonstrate the empirical benefits of \texttt{1\ell_1-TCL} through extensive numerical simulation for GLM and recent neural network nuisance models. Our method is subsequently extended to real data and generates meaningful insights consistent with medical literature, a case where all baseline methods fail.

Keywords

Cite

@article{arxiv.2305.09126,
  title  = {Transfer Learning for Causal Effect Estimation},
  author = {Song Wei and Hanyu Zhang and Ronald Moore and Rishikesan Kamaleswaran and Yao Xie},
  journal= {arXiv preprint arXiv:2305.09126},
  year   = {2024}
}

Comments

Preliminary version, titled "Transfer causal learning: Causal effect estimation with knowledge transfer", has been presented in ICML 3rd Workshop on Interpretable Machine Learning in Healthcare (IMLH), 2023; see the arXiv version in v2

R2 v1 2026-06-28T10:35:25.758Z