English

Computable exponential bounds for screened estimation and simulation

Probability 2009-09-29 v2 Statistics Theory Computation Statistics Theory

Abstract

Suppose the expectation E(F(X))E(F(X)) is to be estimated by the empirical averages of the values of FF on independent and identically distributed samples {Xi}\{X_i\}. A sampling rule called the "screened" estimator is introduced, and its performance is studied. When the mean E(U(X))E(U(X)) of a different function UU is known, the estimates are "screened," in that we only consider those which correspond to times when the empirical average of the {U(Xi)}\{U(X_i)\} is sufficiently close to its known mean. As long as UU dominates FF appropriately, the screened estimates admit exponential error bounds, even when F(X)F(X) is heavy-tailed. The main results are several nonasymptotic, explicit exponential bounds for the screened estimates. A geometric interpretation, in the spirit of Sanov's theorem, is given for the fact that the screened estimates always admit exponential error bounds, even if the standard estimates do not. And when they do, the screened estimates' error probability has a significantly better exponent. This implies that screening can be interpreted as a variance reduction technique. Our main mathematical tools come from large deviations techniques. The results are illustrated by a detailed simulation example.

Keywords

Cite

@article{arxiv.math/0612040,
  title  = {Computable exponential bounds for screened estimation and simulation},
  author = {Ioannis Kontoyiannis and Sean P. Meyn},
  journal= {arXiv preprint arXiv:math/0612040},
  year   = {2009}
}

Comments

Published in at http://dx.doi.org/10.1214/00-AAP492 the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)