Stationary entrance chains and applications to random walks
Abstract
For a Markov chain with values in a Polish space, consider the entrance chain, obtained by sampling at the moments when it enters a fixed set from its complement . Similarly, consider the exit chain, obtained by sampling at the exit times from to . We use the method of inducing from ergodic theory to study invariant measures of these two types of Markov chains in the case when the initial chain has a known invariant measure. We give explicit formulas for invariant measures of the entrance and exit chains under certain recurrence-type assumptions on and , which apply even for transient chains. Then we study uniqueness and ergodicity of these invariant measures assuming that is topologically recurrent, topologically irreducible, and weak Feller. We give applications to random walks in , which we regard as ``stationary'' Markov chains started under the Lebesgue measure. We are mostly interested in dimension one, where we study the Markov chain of overshoots above the zero level of a random walk that oscillates between and . We show that this chain is ergodic, and use this result to prove a central limit theorem for the number of level crossings of a random walk with zero mean and finite variance of increments.
Keywords
Cite
@article{arxiv.2403.00619,
title = {Stationary entrance chains and applications to random walks},
author = {Aleksandar Mijatovic and Vladislav Vysotsky},
journal= {arXiv preprint arXiv:2403.00619},
year = {2025}
}
Comments
This is a final version accepted in Stochastic Processes and their Applications. New statements (Theorem 3.2, Corollary 3.1, Lemma A.5) were added and many minor corrections were made. There is an overlap with arXiv:1808.05010 but this version differs significantly -- the exposition was streamlined and many non-new and non-essential results were removed