Related papers: Inverse Problems for Ergodicity of Markov Chains
The master equation and, more generally, Markov processes are routinely used as models for stochastic processes. They are often justified on the basis of randomization and coarse-graining assumptions. Here instead, we derive n-th order…
Explicit conditions are presented for the existence, uniqueness and ergodicity of the strong solution to a class of generalized stochastic porous media equations. Our estimate of the convergence rate is sharp according to the known optimal…
Convergence rate analyses of random walk Metropolis-Hastings Markov chains on general state spaces have largely focused on establishing sufficient conditions for geometric ergodicity or on analysis of mixing times. Geometric ergodicity is a…
We establish general theorems quantifying the notion of recurrence --- through an estimation of the moments of passage times --- for irreducible continuous-time Markov chains on countably infinite state spaces. Sharp conditions of…
For general (1+1)-affine Markov processes, we prove the ergodicity and exponential ergodicity in total variation distances. Our methods follow the arguments of ergodic properties for L\'{e}vy-driven OU-processes and a coupling of…
Monte Carlo simulations of systems of particles such as hard spheres or soft spheres with singular kernels can display around a phase transition prohibitively long convergence times when using traditional Hasting-Metropolis reversible…
We present an approach for testing for the existence of continuous generators of discrete stochastic transition matrices. Typically, the known approaches to ascertain the existence of continuous Markov processes are based in the assumption…
Strong invariance principles in Markov chain Monte Carlo are crucial to theoretically grounded output analysis. Using the wide-sense regenerative nature of the process, we obtain explicit bounds in the strong invariance converging rates for…
We provide a criterion for establishing lower bounds on the rate of convergence in $f$-variation of a continuous-time ergodic Markov process to its invariant measure. The criterion consists of novel super- and submartingale conditions for…
The present manuscript consists of inverse problems for a coupled system of wave equations with potential in $\mathbb{R}^3$. By establishing the fundamental solution to the aforementioned operator, we study the uniqueness aspects of the…
Based on a new explicit representation of the solution to the Poisson equation with respect to single birth processes, the unified treatment for various criteria on classical problems (including uniqueness, recurrence, ergodicity,…
The data processing inequality is central to information theory and motivates the study of monotonic divergences. However, it is not clear operationally we need to consider all such divergences. We establish a simple method for Pinsker…
The main focus of this article is the study of ergodicity of Interacting Particle Systems (IPS). We present a simple lemma showing that scaling time is equivalent to taking the convex combination of the transition matrix of the IPS with the…
We study the temporal dissipation of variance and relative entropy for ergodic Markov Chains in continuous time, and compute explicitly the corresponding dissipation rates. These are identified, as is well known, in the case of the variance…
Continuous-time Markov chains on non-negative integers can be used for modeling biological systems, population dynamics, and queueing models. Qualitative behaviors of birth-and-death models, typical examples of such one-dimensional…
In this paper, we establish moment and Bernstein-type inequalities for additive functionals of geometrically ergodic Markov chains. These inequalities extend the corresponding inequalities for independent random variables. Our conditions…
This paper considers the optimal control of time varying continuous time Markov chains whose transition rates are themselves Markov processes. In one set of problems the solution of an ordinary differential equation is shown to determine…
In this brief note, we find formulas for the distribution and the transition probability matrices of a stochastic process described as a time-reversion in a finite time window of a Markov chain, with cluster observation of the Markov state…
We study the ergodicity of backward product of stochastic and doubly stochastic matrices by introducing the concept of absolute infinite flow property. We show that this property is necessary for ergodicity of any chain of stochastic…
The paper is devoted to the development of the theory of inverse problems for evolution equations with terms rapidly oscillating in time. A new approach to setting such problems is developed for the case in which additional constraints are…