English

Annealed Importance Sampling with q-Paths

Machine Learning 2024-04-29 v1

Abstract

Annealed importance sampling (AIS) is the gold standard for estimating partition functions or marginal likelihoods, corresponding to importance sampling over a path of distributions between a tractable base and an unnormalized target. While AIS yields an unbiased estimator for any path, existing literature has been primarily limited to the geometric mixture or moment-averaged paths associated with the exponential family and KL divergence. We explore AIS using qq-paths, which include the geometric path as a special case and are related to the homogeneous power mean, deformed exponential family, and α\alpha-divergence.

Cite

@article{arxiv.2012.07823,
  title  = {Annealed Importance Sampling with q-Paths},
  author = {Rob Brekelmans and Vaden Masrani and Thang Bui and Frank Wood and Aram Galstyan and Greg Ver Steeg and Frank Nielsen},
  journal= {arXiv preprint arXiv:2012.07823},
  year   = {2024}
}

Comments

NeurIPS Workshop on Deep Learning through Information Geometry (Best Paper Award)

R2 v1 2026-06-23T20:57:54.832Z