English
Related papers

Related papers: Convergence analysis of some multivariate Markov c…

200 papers

In the paper, we study a new rate of convergence estimate for homogeneous discrete-time nonlinear Markov chains based on the Markov-Dobrushin condition. This result generalizes the convergence estimates for any positive number of transition…

Probability · Mathematics 2021-10-22 Aleksandr A. Shchegolev

We prove a Chernoff-type bound for sums of matrix-valued random variables sampled via a regular (aperiodic and irreducible) finite Markov chain. Specially, consider a random walk on a regular Markov chain and a Hermitian matrix-valued…

Machine Learning · Statistics 2020-10-30 Jiezhong Qiu , Chi Wang , Ben Liao , Richard Peng , Jie Tang

The first motivation of this paper is to study stationarity and ergodic properties for a general class of time series models defined conditional on an exogenous covariates process. The dynamic of these models is given by an autoregressive…

Statistics Theory · Mathematics 2020-07-16 Paul Doukhan , Michael H. Neumann , Lionel Truquet

Improved rates of convergence for ergodic homogeneous Markov chains are studied. In comparison to the earlier papers the setting is also generalised to the case without a unique dominated measure. Examples are provided where the new bound…

Probability · Mathematics 2021-11-02 Alexander Veretennikov , Maria Veretennikova

We formulate some simple conditions under which a Markov chain may be approximated by the solution to a differential equation, with quantifiable error probabilities. The role of a choice of coordinate functions for the Markov chain is…

Probability · Mathematics 2008-04-23 R. W. R. Darling , J. R. Norris

We study the properties of a subclass of stochastic processes called discrete time nonlinear Markov chains with an aggregator, which naturally appear in various topics such as strategic queueing systems, inventory dynamics, opinion…

Probability · Mathematics 2025-12-24 Bar Light

We propose an explicit construction of a stationary solution for a stochastic recursion of the form $X\circ\theta=\phi(X)$ on a partially-ordered Polish space, when the monotonicity of $\phi$ is not assumed. Under certain conditions, we…

Probability · Mathematics 2010-09-08 Pascal Moyal

We introduce and analyze a new class of monotone stochastic recursions in a regenerative environment which is essentially broader than that of Markov chains. We prove stability theorems and apply our results {to three canonical models in…

Probability · Mathematics 2022-02-22 Sergey Foss , Vsevolod Shneer , Jonathan P. Thomas , Tim Worrall

We study the ergodic behaviour of a discrete-time process $X$ which is a Markov chain in a stationary random environment. The laws of $X_t$ are shown to converge to a limiting law in (weighted) total variation distance as $t\to\infty$.…

Probability · Mathematics 2019-07-29 Balazs Gerencser , Miklos Rasonyi

Let $(X_n)_{n=0}^\infty$ denote a Markov chain on a Polish space that has a stationary distribution $\varpi$. This article concerns upper bounds on the Wasserstein distance between the distribution of $X_n$ and $\varpi$. In particular, an…

Probability · Mathematics 2021-02-16 Qian Qin , James P. Hobert

We consider the asymptotics of the invariant measure for the process of the empirical spatial distribution of $N$ coupled Markov chains in the limit of a large number of chains. Each chain reflects the stochastic evolution of one particle.…

Probability · Mathematics 2013-01-25 Vivek S. Borkar , Rajesh Sundaresan

Markov chain models are used in various fields, such behavioral sciences or econometrics. Although the goodness of fit of the model is usually assessed by large sample approximation, it is desirable to use conditional tests if the sample…

Statistics Theory · Mathematics 2012-01-11 Akimichi Takemura , Hisayuki Hara

We consider finite-state time-nonhomogeneous Markov chains where the probability of moving from state $i$ to state $j\neq i$ at time $n$ is $G(i,j)/n^\zeta$ for a ``generator'' matrix $G$ and strength parameter $\zeta>0$. In these chains,…

Probability · Mathematics 2007-05-23 Zach Dietz , Sunder Sethuraman

In this paper, we consider a class of nonautonomous multi-scale stochastic partial differential equations with fully local monotone coefficients. By introducing the evolution system of measures for time-inhomogeneous Markov semigroups, we…

Probability · Mathematics 2025-09-03 Mengyu Cheng , Xiaobin Sun , Yingchao Xie

The paper is devoted to the estimation of the rate of of exponential convergence of nonhomogeneous queues exhibiting different types of ergodicity. The main tool of our study is the method, which was proposed by the second author in the…

Probability · Mathematics 2007-06-13 Boris L. Granovsky , Aleksandr I. Zeifman

We study ergodic properties of nonlinear Markov chains and stochastic McKean-Vlasov equations. For nonlinear Markov chains we obtain sufficient conditions for existence and uniqueness of an invariant measure and uniform ergodicity. We also…

Probability · Mathematics 2013-11-26 Oleg Butkovsky

Many economic models feature monotone Markov dynamics on state spaces that may be noncompact. Establishing existence, uniqueness, and stability of stationary distributions in such settings has required a patchwork of sufficient conditions,…

Probability · Mathematics 2026-04-07 Takashi Kamihigashi , John Stachurski

Improved rates of convergence for ergodic Markov chains and relaxed conditions for them, as well as analogous convergence results for some non-homogeneous Markov chains are studied. The setting from the previous works is extended. Examples…

Probability · Mathematics 2022-09-27 A. Yu. Veretennikov , M. A. Veretennikova

We prove the existence of limiting distributions for a large class of Markov chains on a general state space in a random environment. We assume suitable versions of the standard drift and minorization conditions. In particular, the system…

Probability · Mathematics 2020-12-04 Attila Lovas , Miklós Rásonyi

The extremes of a univariate Markov chain with regulary varying stationary marginal distribution and asymptotically linear behavior are known to exhibit a multiplicative random walk structure called the tail chain. In this paper, we extend…

Probability · Mathematics 2014-02-04 Anja Janßen , Johan Segers