English

A General Framework for Regression with Mismatched Data Based on Mixture Modeling

Methodology 2023-06-02 v1

Abstract

Data sets obtained from linking multiple files are frequently affected by mismatch error, as a result of non-unique or noisy identifiers used during record linkage. Accounting for such mismatch error in downstream analysis performed on the linked file is critical to ensure valid statistical inference. In this paper, we present a general framework to enable valid post-linkage inference in the challenging secondary analysis setting in which only the linked file is given. The proposed framework covers a wide selection of statistical models and can flexibly incorporate additional information about the underlying record linkage process. Specifically, we propose a mixture model for pairs of linked records whose two components reflect distributions conditional on match status, i.e., correct match or mismatch. Regarding inference, we develop a method based on composite likelihood and the EM algorithm as well as an extension towards a fully Bayesian approach. Extensive simulations and several case studies involving contemporary record linkage applications corroborate the effectiveness of our framework.

Keywords

Cite

@article{arxiv.2306.00909,
  title  = {A General Framework for Regression with Mismatched Data Based on Mixture Modeling},
  author = {Martin Slawski and Brady T. West and Priyanjali Bukke and Guoqing Diao and Zhenbang Wang and Emanuel Ben-David},
  journal= {arXiv preprint arXiv:2306.00909},
  year   = {2023}
}

Comments

34 pages not counting references and appendix

R2 v1 2026-06-28T10:53:40.064Z