English

Detecting clinician implicit biases in diagnoses using proximal causal inference

Machine Learning 2025-01-29 v1 Applications

Abstract

Clinical decisions to treat and diagnose patients are affected by implicit biases formed by racism, ableism, sexism, and other stereotypes. These biases reflect broader systemic discrimination in healthcare and risk marginalizing already disadvantaged groups. Existing methods for measuring implicit biases require controlled randomized testing and only capture individual attitudes rather than outcomes. However, the "big-data" revolution has led to the availability of large observational medical datasets, like EHRs and biobanks, that provide the opportunity to investigate discrepancies in patient health outcomes. In this work, we propose a causal inference approach to detect the effect of clinician implicit biases on patient outcomes in large-scale medical data. Specifically, our method uses proximal mediation to disentangle pathway-specific effects of a patient's sociodemographic attribute on a clinician's diagnosis decision. We test our method on real-world data from the UK Biobank. Our work can serve as a tool that initiates conversation and brings awareness to unequal health outcomes caused by implicit biases.

Keywords

Cite

@article{arxiv.2501.16399,
  title  = {Detecting clinician implicit biases in diagnoses using proximal causal inference},
  author = {Kara Liu and Russ Altman and Vasilis Syrgkanis},
  journal= {arXiv preprint arXiv:2501.16399},
  year   = {2025}
}

Comments

The ~64 pages of the appendix IS UNPUBLISHED and novel content

R2 v1 2026-06-28T21:20:31.173Z