English

On the $f$-Norm Ergodicity of Markov Processes in Continuous Time

Probability 2015-12-03 v1

Abstract

Consider a Markov process {Φ(t):t0}\{\Phi(t) : t\geq 0\} evolving on a Polish space X{\sf X}. A version of the ff-Norm Ergodic Theorem is obtained: Suppose that the process is ψ\psi-irreducible and aperiodic. For a given function f ⁣:X:[1,)f\colon{\sf X}:\to[1,\infty), under suitable conditions on the process the following are equivalent: \begin{enumerate} \item[(i)] There is a unique invariant probability measure π\pi satisfying fdπ<\int f\,d\pi<\infty. \item[(ii)] There is a closed set CC satisfying ψ(C)>0\psi(C)>0 that is ``self ff-regular.'' \item There is a function V ⁣:X(0,]V\colon{\sf X} \to (0,\infty] that is finite on at least one point in X{\sf X}, for which the following Lyapunov drift condition is satisfied, DVf+b\fieldIC,\eqno(V3) {\cal D} V\leq - f+b\field{I}_C\, , \eqno{\hbox{(V3)}} where CC is a closed small set and D{\cal D} is the extended generator of the process. \end{enumerate} For discrete-time chains the result is well-known. Moreover, in that case, the ergodicity of \bfPhi\bfPhi under a suitable norm is also obtained: For each initial condition xXx\in{\sf X} satisfying V(x)<V(x)<\infty, and any function g ⁣:Xg\colon{\sf X}\to\Re for which g|g| is bounded by ff, limtEx[g(Φ(t))]=gdπ. \lim_{t\to\infty} {\sf E}_x[g(\Phi(t))] = \int g\,d\pi. Possible approaches are explored for establishing appropriate versions of corresponding results in continuous time, under appropriate assumptions on the process {Φ(t)}\{\Phi(t)\} or on the function gg.

Keywords

Cite

@article{arxiv.1512.00523,
  title  = {On the $f$-Norm Ergodicity of Markov Processes in Continuous Time},
  author = {I. Kontoyiannis and S. P. Meyn},
  journal= {arXiv preprint arXiv:1512.00523},
  year   = {2015}
}