English
Related papers

Related papers: Quasi-limiting estimates for periodic absorbed Mar…

200 papers

We consider a discrete time semi-Markov process where the characteristics defining the process depend on a small perturbation parameter. It is assumed that the state space consists of one finite communicating class of states and, in…

Probability · Mathematics 2016-03-21 Mikael Petersson

This work provides complete description of Quasistationary Distributions (QSDs) for Markov chains with a unique absorbing state and an irreducible set of non-absorbing states. As is well-known, every QSD has an associated absorption…

Probability · Mathematics 2025-11-14 Iddo Ben-Ari , Ningwei Jiang

The asymptotic normality in multi-dimension of the nonparametric estimator of the transition probabilities of a Markov renewal chain is proved, and is applied to that of other nonparametric estimators involved with the associated…

Statistics Theory · Mathematics 2023-04-11 Hiroki Ogata , Luis Iván Hernández Ruíz , Kouji Yano

For general absorbed Markov processes $(X_t)_{0\leq t<\tau_{\partial}}$ having a quasi-stationary distribution (QSD) $\pi$ and absorption time $\tau_{\partial}$, we introduce a Dobrushin-type criterion providing for exponential convergence…

Probability · Mathematics 2022-10-26 Oliver Tough

We study the limit behaviour of a generally non-linear ordinary differential equation whose solution is a superadditive generalisation of a stochastic matrix, and provide necessary and sufficient conditions for this solution to be ergodic,…

Probability · Mathematics 2016-09-21 Jasper De Bock

We consider a collection of Markov chains that model the evolution of multitype biological populations. The state space of the chains is the positive orthant, and the boundary of the orthant is absorbing representing the extinction states…

Probability · Mathematics 2019-11-18 Amarjit Budhiraja , Nicolas Fraiman , Adam Waterbury

This paper aims to provide some tools coming from functional inequalities to deal with quasi-stationarity for absorbed Markov processes. First, it is shown how a Poincar\'e inequality related to a suitable Doob transform entails exponential…

Probability · Mathematics 2021-03-29 William Oçafrain

This paper deals with ergodic theorems for particular time-inhomogeneous Markov processes, whose the time-inhomogeneity is asymptotically periodic. Under a Lyapunov/minorization condition, it is shown that, for any measurable bounded…

Probability · Mathematics 2022-04-06 William Oçafrain

Asymptotic properties of Markov Processes, such as steady state probabilities or hazard rate for absorbing states can be efficiently calculated by means of linear algebra even for large-scale problems. This paper discusses the methods for…

Performance · Computer Science 2017-05-17 Vitali Volovoi

The partial sum of the states of a Markov chain or more generally a Markov source is asymptotically normally distributed under suitable conditions. One of these conditions is that the variance is unbounded. A simple combinatorial…

Combinatorics · Mathematics 2023-06-22 Sara Kropf

This paper tackles the issue of establishing a lower-bound on the asymptotic ratio of survival probabilities between two different initial conditions, asymptotically in time for a given Markov process with extinction. Such a comparison is a…

Probability · Mathematics 2023-05-12 Aurélien Velleret

The large deviations at Level 2.5 are applied to Markov processes with absorbing states in order to obtain the explicit extinction rate of metastable quasi-stationary states in terms of their empirical time-averaged density and of their…

Statistical Mechanics · Physics 2022-01-13 Cecile Monthus

In the continuity of a recent paper ([6]), dealing with finite Markov chains, this paper proposes and analyzes a recursive algorithm for the approximation of the quasi-stationary distribution of a general Markov chain living on a compact…

Probability · Mathematics 2017-11-15 Michel Benaim , Bertrand Cloez , Fabien Panloup

We investigate absorption, i.e., almost sure convergence to an absorbing state, in time-varying (non-homogeneous) discrete-time Markov chains with finite state space. We consider systems that can switch among a finite set of transition…

Systems and Control · Electrical Eng. & Systems 2020-08-18 Yasin Yazicioglu

Using elementary methods, we prove that for a countable Markov chain $P$ of ergodic degree $d > 0$ the rate of convergence towards the stationary distribution is subgeometric of order $n^{-d}$, provided the initial distribution satisfies…

Probability · Mathematics 2007-05-23 Stefano Isola

In the paper, we study a new rate of convergence estimate for homogeneous discrete-time nonlinear Markov chains based on the Markov-Dobrushin condition. This result generalizes the convergence estimates for any positive number of transition…

Probability · Mathematics 2021-10-22 Aleksandr A. Shchegolev

This paper aims to establish a central limit theorem for Markov processes conditioned not to be absorbed under a very general assumption on quasi-stationarity for the underlying process. To do so, a central limit theorem has been…

Probability · Mathematics 2023-03-31 William Oçafrain

We study the long-time behavior of an additive functional that takes into account the jumps of a symmetric Markov process. This process is assumed to be observed through a biased observation scheme that includes the survival to events of…

Probability · Mathematics 2026-01-07 Daehong Kim , Takara Tagawa , Aurélien Velleret

For Markov chains and Markov processes exhibiting a form of stochastic monotonicity (larger states shift up transition probabilities in terms of stochastic dominance), stability and ergodicity results can be obtained using order-theoretic…

Probability · Mathematics 2024-10-01 Takashi Kamihigashi , John Stachurski

The purpose of this paper is to study the time average behavior of Markov chains with transition probabilities being kernels of completely continuous operators, and therefore to provide a sufficient condition for a class of Markov chains…

Probability · Mathematics 2018-11-16 Shizhou Xu