English

Posterior accuracy and calibration under misspecification in Bayesian generalized linear models

Methodology 2024-03-19 v1

Abstract

Generalized linear models (GLMs) are popular for data-analysis in almost all quantitative sciences, but the choice of likelihood family and link function is often difficult. This motivates the search for likelihoods and links that minimize the impact of potential misspecification. We perform a large-scale simulation study on double-bounded and lower-bounded response data where we systematically vary both true and assumed likelihoods and links. In contrast to previous studies, we also study posterior calibration and uncertainty metrics in addition to point-estimate accuracy. Our results indicate that certain likelihoods and links can be remarkably robust to misspecification, performing almost on par with their respective true counterparts. Additionally, normal likelihood models with identity link (i.e., linear regression) often achieve calibration comparable to the more structurally faithful alternatives, at least in the studied scenarios. On the basis of our findings, we provide practical suggestions for robust likelihood and link choices in GLMs.

Keywords

Cite

@article{arxiv.2311.09081,
  title  = {Posterior accuracy and calibration under misspecification in Bayesian generalized linear models},
  author = {Maximilian Scholz and Paul-Christian Bürkner},
  journal= {arXiv preprint arXiv:2311.09081},
  year   = {2024}
}

Comments

arXiv admin note: text overlap with arXiv:2210.06927

R2 v1 2026-06-28T13:22:15.631Z