English

Quickest detection of a hidden target and extremal surfaces

Probability 2014-09-08 v1

Abstract

Let Z=(Zt)t0Z=(Z_t)_{t\ge0} be a regular diffusion process started at 00, let \ell be an independent random variable with a strictly increasing and continuous distribution function FF, and let τ=inf{t0Zt=}\tau_{\ell}=\inf\{t\ge0\vert Z_t=\ell\} be the first entry time of ZZ at the level \ell. We show that the quickest detection problem infτ[P(τ<τ)+cE(ττ)+]\inf_{\tau}\bigl[\mathsf{P}(\tau<\tau_{\ell})+c\mathsf{E}(\tau -\tau_{\ell})^+\bigr] is equivalent to the (three-dimensional) optimal stopping problem supτE[Rτ0τc(Rt)dt],\sup_{\tau}\mathsf{E}\biggl[R_{\tau}-\int _0^{\tau}c(R_t)\,dt\biggr], where R=SIR=S-I is the range process of X=2F(Z)1X=2F(Z)-1 (i.e., the difference between the running maximum and the running minimum of XX ) and c(r)=crc(r)=cr with c>0c>0. Solving the latter problem we find that the following stopping time is optimal: τ=inf{t0f(It,St)Xtg(It,St)},\tau_*=\inf \bigl\{t\ge0\vert f_*(I_t,S_t)\le X_t\le g_*(I_t,S_t)\bigr\}, where the surfaces ff_* and gg_* can be characterised as extremal solutions to a couple of first-order nonlinear PDEs expressed in terms of the infinitesimal characteristics of XX and cc. This is done by extending the arguments associated with the maximality principle [Ann. Probab. 26 (1998) 1614-1640] to the three-dimensional setting of the present problem and disclosing the general structure of the solution that is valid in all particular cases. The key arguments developed in the proof should be applicable in similar multi-dimensional settings.

Keywords

Cite

@article{arxiv.1409.1745,
  title  = {Quickest detection of a hidden target and extremal surfaces},
  author = {Goran Peskir},
  journal= {arXiv preprint arXiv:1409.1745},
  year   = {2014}
}

Comments

Published in at http://dx.doi.org/10.1214/13-AAP979 the Annals of Applied Probability (http://www.imstat.org/aap/) by the Institute of Mathematical Statistics (http://www.imstat.org)