English

Some results on the Gittins index for a normal reward process

Statistics Theory 2007-06-13 v1 Statistics Theory

Abstract

We consider the Gittins index for a normal distribution with unknown mean θ\theta and known variance where θ\theta has a normal prior. In addition to presenting some monotonicity properties of the Gittins index, we derive an approximation to the Gittins index by embedding the (discrete-time) normal setting into the continuous-time Wiener process setting in which the Gittins index is determined by the stopping boundary for an optimal stopping problem. By an application of Chernoff's continuity correction in optimal stopping, the approximation includes a correction term which accounts for the difference between the discrete and continuous-time stopping boundaries. Numerical results are also given to assess the performance of this simple approximation.

Keywords

Cite

@article{arxiv.math/0702831,
  title  = {Some results on the Gittins index for a normal reward process},
  author = {Yi-Ching Yao},
  journal= {arXiv preprint arXiv:math/0702831},
  year   = {2007}
}

Comments

Published at http://dx.doi.org/10.1214/074921706000001111 in the IMS Lecture Notes Monograph Series (http://www.imstat.org/publications/lecnotes.htm) by the Institute of Mathematical Statistics (http://www.imstat.org)