Fundamental limits for weighted empirical approximations of tilted distributions
Statistics Theory
2026-01-01 v1 Machine Learning
Probability
Machine Learning
Statistics Theory
Abstract
Consider the task of generating samples from a tilted distribution of a random vector whose underlying distribution is unknown, but samples from it are available. This finds applications in fields such as finance and climate science, and in rare event simulation. In this article, we discuss the asymptotic efficiency of a self-normalized importance sampler of the tilted distribution. We provide a sharp characterization of its accuracy, given the number of samples and the degree of tilt. Our findings reveal a surprising dichotomy: while the number of samples needed to accurately tilt a bounded random vector increases polynomially in the tilt amount, it increases at a super polynomial rate for unbounded distributions.
Keywords
Cite
@article{arxiv.2512.23979,
title = {Fundamental limits for weighted empirical approximations of tilted distributions},
author = {Sarvesh Ravichandran Iyer and Himadri Mandal and Dhruman Gupta and Rushil Gupta and Agniv Bandhyopadhyay and Achal Bassamboo and Varun Gupta and Sandeep Juneja},
journal= {arXiv preprint arXiv:2512.23979},
year = {2026}
}
Comments
84 pages, 6 figures