English
Related papers

Related papers: Ergodic properties of some Markov chains models in…

200 papers

In this paper, we provide sufficient conditions for the existence of the invariant distribution and for subgeometric rates of convergence in Wasserstein distance for general state-space Markov chains which are (possibly) not irreducible.…

Probability · Mathematics 2015-07-15 Alain Durmus , Gersende Fort , Eric Moulines

We study the recurrence of inhomogeneous Markov chains in the plane, when the environment is horizontally stratified and the heterogeneity of quasi-periodic type.

Dynamical Systems · Mathematics 2020-12-14 Julien Brémont

We study the periodic properties of sequences of quantum channels sampled from an ergodic stochastic process satisfying a natural irreducibility condition. We relate these periodic properties to certain global spectral data defined by the…

Mathematical Physics · Physics 2026-04-13 Owen Ekblad , Jeffrey Schenker

We provide a criterion for establishing lower bounds on the rate of convergence in $f$-variation of a continuous-time ergodic Markov process to its invariant measure. The criterion consists of novel super- and submartingale conditions for…

Probability · Mathematics 2024-04-16 Miha Brešar , Aleksandar Mijatović

We study perturbation theory and uniform ergodicity for discrete-time Markov chains on general state spaces in terms of the uniform moments of the first hitting times on some set. The methods we adopt are different from previous ones. For…

Probability · Mathematics 2020-03-17 Yonghua Mao , Yanhong Song

This paper provides a general and abstract approach to approximate ergodic regimes of Markov and Feller processes. More precisely, we show that the recursive algorithm presented in Lamberton & Pages (2002) and based on simulation algorithms…

Probability · Mathematics 2018-01-17 Gilles Pagès , Clément Rey

Using the renewal approach we prove exponential inequalities for additive functionals and empirical processes of ergodic Markov chains, thus obtaining counterparts of inequalities for sums of independent random variables. The inequalities…

Probability · Mathematics 2013-10-18 Radosław Adamczak , Witold Bednorz

Adaptive Markov chains are an important class of Monte Carlo methods for sampling from probability distributions. The time evolution of adaptive algorithms depends on past samples, and thus these algorithms are non-Markovian. Although there…

Probability · Mathematics 2014-10-02 Natesh S. Pillai , Aaron Smith

This paper aims at improving the convergence to equilibrium of finite ergodic Markov chains via permutations and projections. First, we prove that a specific mixture of permuted Markov chains arises naturally as a projection under the KL…

Probability · Mathematics 2025-07-22 Michael C. H. Choi , Max Hird , Youjia Wang

In our earlier paper, a generalized Dobrushin ergodicity coefficient of Markov operators (acting on abstract state spaces) with respect to a projection $P$, has been introduced and studied. It turned out that the introduced coefficient was…

Functional Analysis · Mathematics 2020-01-22 Farrukh Mukhamedov , Ahmed Al-Rawashdeh

We study a variable length Markov chain model associated with a group of stationary processes that share the same context tree but each process has potentially different conditional probabilities. We propose a new model selection and…

Methodology · Statistics 2016-01-01 Alexandre Belloni , Roberto I. Oliveira

Continuous-time Markov chains on non-negative integers can be used for modeling biological systems, population dynamics, and queueing models. Qualitative behaviors of birth-and-death models, typical examples of such one-dimensional…

Probability · Mathematics 2025-10-24 Minjun Kim , Seokhwan Moon , Jinsu Kim

We formulate a criterion for the existence and uniqueness of an invariant measure for a Markov process taking values in a Polish phase space. In addition, weak-$^*$ ergodicity, that is, the weak convergence of the ergodic averages of the…

Probability · Mathematics 2010-10-19 Tomasz Komorowski , Szymon Peszat , Tomasz Szarek

Monte Carlo simulations of systems of particles such as hard spheres or soft spheres with singular kernels can display around a phase transition prohibitively long convergence times when using traditional Hasting-Metropolis reversible…

Statistical Mechanics · Physics 2023-10-10 Athina Monemvassitis , Arnaud Guillin , Manon Michel

In this paper, we present criteria for non-exponential ergodicity of continuous-time Markov chains on a countable state space. These criteria can be verified by examining the ratio of transition rates over certain paths. We applied this…

Probability · Mathematics 2024-02-09 Minjoon Kim , Jinsu Kim

We study distributions of meeting times for finite symmetric Markov chains. For Markov kernels defined on large state spaces which satisfy certain weak inhomogeneity in return probabilities of points up to large numbers of steps, we obtain…

Probability · Mathematics 2014-10-20 Yu-Ting Chen

We study time-inhomogeneous Markov chains to obtain quantitative results on their asymptotic behavior. We use Poincar\'e, Nash, and logarithmic-Sobolev inequalities. We assume that our Markov chain admits a finite invariant measure at each…

Probability · Mathematics 2024-06-25 Nordine Moumeni

In this note we present two types of biological models which have interesting ergodic and chaotic properties. The first type are one-dimensional transformations, like a logistic map, which are used to describe the change in population size…

Dynamical Systems · Mathematics 2024-02-05 Ryszard Rudnicki

We consider Markov processes that alternate continuous motions and jumps in a general locally compact polish space. Starting from a mechanistic construction, a first contribution of this article is to provide conditions on the dynamics so…

Probability · Mathematics 2022-04-07 Ronan Le Guével , Frédéric Lavancier , Emilien Manent

We study the stochastic dynamics of a system of interacting species in a stochastic environment by means of a continuous-time Markov chain with transition rates depending on the state of the environment. Models of gene regulation in systems…

Dynamical Systems · Mathematics 2019-12-03 Daniele Cappelletti , Abhishek Pal Majumder , Carsten Wiuf