English

Large deviation asymptotics and control variates for simulating large functions

Probability 2007-05-23 v1

Abstract

Consider the normalized partial sums of a real-valued function FF of a Markov chain, ϕn:=n1k=0n1F(Φ(k)),n1.\phi_n:=n^{-1}\sum_{k=0}^{n-1}F(\Phi(k)),\qquad n\ge1. The chain {Φ(k):k0}\{\Phi(k):k\ge0\} takes values in a general state space X\mathsf {X}, with transition kernel PP, and it is assumed that the Lyapunov drift condition holds: PVVW+bICPV\le V-W+b\mathbb{I}_C where V:X(0,)V:\mathsf {X}\to(0,\infty), W:X[1,)W:\mathsf {X}\to[1,\infty), the set CC is small and WW dominates FF. Under these assumptions, the following conclusions are obtained: 1. It is known that this drift condition is equivalent to the existence of a unique invariant distribution π\pi satisfying π(W)<\pi(W)<\infty, and the law of large numbers holds for any function FF dominated by WW: ϕnϕ:=π(F),a.s.,n.\phi_n\to\phi:=\pi(F),\qquad{a.s.}, n\to\infty. 2. The lower error probability defined by P{ϕnc}\mathsf {P}\{\phi_n\le c\}, for c<ϕc<\phi, n1n\ge1, satisfies a large deviation limit theorem when the function FF satisfies a monotonicity condition. Under additional minor conditions an exact large deviations expansion is obtained. 3. If WW is near-monotone, then control-variates are constructed based on the Lyapunov function VV, providing a pair of estimators that together satisfy nontrivial large asymptotics for the lower and upper error probabilities. In an application to simulation of queues it is shown that exact large deviation asymptotics are possible even when the estimator does not satisfy a central limit theorem.

Keywords

Cite

@article{arxiv.math/0603328,
  title  = {Large deviation asymptotics and control variates for simulating large functions},
  author = {Sean P. Meyn},
  journal= {arXiv preprint arXiv:math/0603328},
  year   = {2007}
}

Comments

Published at http://dx.doi.org/10.1214/105051605000000737 in the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)