Detecting and diagnosing prior and likelihood sensitivity with power-scaling
Abstract
Determining the sensitivity of the posterior to perturbations of the prior and likelihood is an important part of the Bayesian workflow. We introduce a practical and computationally efficient sensitivity analysis approach using importance sampling to estimate properties of posteriors resulting from power-scaling the prior or likelihood. On this basis, we suggest a diagnostic that can indicate the presence of prior-data conflict or likelihood noninformativity and discuss limitations to this power-scaling approach. The approach can be easily included in Bayesian workflows with minimal effort by the model builder and we present an implementation in our new R package priorsense. We further demonstrate the workflow on case studies of real data using models varying in complexity from simple linear models to Gaussian process models.
Cite
@article{arxiv.2107.14054,
title = {Detecting and diagnosing prior and likelihood sensitivity with power-scaling},
author = {Noa Kallioinen and Topi Paananen and Paul-Christian Bürkner and Aki Vehtari},
journal= {arXiv preprint arXiv:2107.14054},
year = {2024}
}
Comments
31 pages, 15 (+5 suppl) figures