English

Missing Values and Imputation in Healthcare Data: Can Interpretable Machine Learning Help?

Machine Learning 2023-04-25 v1

Abstract

Missing values are a fundamental problem in data science. Many datasets have missing values that must be properly handled because the way missing values are treated can have large impact on the resulting machine learning model. In medical applications, the consequences may affect healthcare decisions. There are many methods in the literature for dealing with missing values, including state-of-the-art methods which often depend on black-box models for imputation. In this work, we show how recent advances in interpretable machine learning provide a new perspective for understanding and tackling the missing value problem. We propose methods based on high-accuracy glass-box Explainable Boosting Machines (EBMs) that can help users (1) gain new insights on missingness mechanisms and better understand the causes of missingness, and (2) detect -- or even alleviate -- potential risks introduced by imputation algorithms. Experiments on real-world medical datasets illustrate the effectiveness of the proposed methods.

Keywords

Cite

@article{arxiv.2304.11749,
  title  = {Missing Values and Imputation in Healthcare Data: Can Interpretable Machine Learning Help?},
  author = {Zhi Chen and Sarah Tan and Urszula Chajewska and Cynthia Rudin and Rich Caruana},
  journal= {arXiv preprint arXiv:2304.11749},
  year   = {2023}
}

Comments

Preprint of a paper accepted by CHIL 2023

R2 v1 2026-06-28T10:15:10.216Z