English

Assumption-Lean Post-Integrated Inference with Surrogate Control Outcomes

Methodology 2025-12-15 v5 Machine Learning Genomics Applications Machine Learning

Abstract

Data integration methods aim to extract low-dimensional embeddings from high-dimensional outcomes to remove unwanted variations, such as batch effects and unmeasured covariates, across heterogeneous datasets. However, multiple hypothesis testing after integration can be biased due to data-dependent processes. We introduce a robust post-integrated inference method that accounts for latent heterogeneity by utilizing control outcomes. Leveraging causal interpretations, we derive nonparametric identifiability of the direct effects using negative control outcomes. By utilizing surrogate control outcomes as an extension of negative control outcomes, we develop semiparametric inference on projected direct effect estimands, accounting for hidden mediators, confounders, and moderators. These estimands remain statistically meaningful under model misspecifications and with error-prone embeddings. We provide bias quantifications and finite-sample linear expansions with uniform concentration bounds. The proposed doubly robust estimators are consistent and efficient under minimal assumptions and potential misspecification, facilitating data-adaptive estimation with machine learning algorithms. Our proposal is evaluated using random forests through simulations and analysis of single-cell CRISPR perturbed datasets, which may contain potential unmeasured confounders.

Keywords

Cite

@article{arxiv.2410.04996,
  title  = {Assumption-Lean Post-Integrated Inference with Surrogate Control Outcomes},
  author = {Jin-Hong Du and Kathryn Roeder and Larry Wasserman},
  journal= {arXiv preprint arXiv:2410.04996},
  year   = {2025}
}

Comments

22 pages for the main text, 27 pages for the appendix, 6 figures for the main text, 7 figures for the appendix

R2 v1 2026-06-28T19:11:04.659Z