English
Related papers

Related papers: On the ergodic principle for Markov and quadratic …

200 papers

This paper is a survey of various proofs of the so called {\em fundamental theorem of Markov chains}: every ergodic Markov chain has a unique positive stationary distribution and the chain attains this distribution in the limit independent…

Probability · Mathematics 2022-04-05 Somenath Biswas

We consider Markov processes of cubic stochastic (in a fixed sense) matrices which are also called quadratic stochastic process (QSPs). A QSP is a particular case of a continuous-time dynamical system whose states are stochastic cubic…

Probability · Mathematics 2017-06-26 J. M. Casas , M. Ladra , U. A. Rozikov

We consider a large family of discrete and continuous time controlled Markov processes and study an ergodic risk-sensitive minimization problem. Under a blanket stability assumption, we provide a complete analysis to this problem. In…

Optimization and Control · Mathematics 2022-07-18 Anup Biswas , Somnath Pradhan

The class of nonlinear Markov processes is characterized by the dependence of the current state of the process on its current distribution in addition to the dependence on the previous state. Due to this feature, these processes are…

Probability · Mathematics 2022-12-27 Aleksandr Shchegolev

This paper aims to establish a central limit theorem for Markov processes conditioned not to be absorbed under a very general assumption on quasi-stationarity for the underlying process. To do so, a central limit theorem has been…

Probability · Mathematics 2023-03-31 William Oçafrain

This paper deals with ergodic theorems for particular time-inhomogeneous Markov processes, whose the time-inhomogeneity is asymptotically periodic. Under a Lyapunov/minorization condition, it is shown that, for any measurable bounded…

Probability · Mathematics 2022-04-06 William Oçafrain

For a quantum-mechanical counting process we show ergodicity, under the condition that the underlying open quantum system approaches equilibrium in the time mean. This implies equality of time average and ensemble average for correlation…

Quantum Physics · Physics 2007-05-23 Burkhard Kuemmerer , Hans Maassen

In this paper we showed an equivalence of notions of regularity, transitivity and Ergodic principle for quadratic stochastic Volterra operators acting on the finite dimensional simplex.

Dynamical Systems · Mathematics 2011-11-15 Mansoor Saburov

This paper introduces ergodic-risk criteria, which capture long-term cumulative risks associated with controlled Markov chains through probabilistic limit theorems--in contrast to existing methods that require assumptions of either finite…

Optimization and Control · Mathematics 2025-12-03 Shahriar Talebi , Na Li

It has been established under very general conditions that the ergodic properties of Markov processes are inherited by their conditional distributions given partial information. While the existing theory provides a rather complete picture…

Probability · Mathematics 2015-02-04 Patrick Rebeschini , Ramon van Handel

A piecewise-deterministic Markov process, specified by random jumps and switching semi-flows, as well as the associated Markov chain given by its post-jump locations, are investigated in this paper. The existence of an exponentially…

Probability · Mathematics 2020-12-07 Dawid Czapla , Katarzyna Horbacz , Hanna Wojewódka-Ściążko

We show that an isotropic self-similar Markov process in ${\Bbb R}^d$ has a skew product structure if and only if its radial and angular parts do not jump at the same time.

Probability · Mathematics 2011-05-31 Ming Liao , Longmin Wang

This paper consists of four parts. In the first part, we explain what eigenvalues we are interested in and show the difficulties of the study on the first (non-trivial) eigenvalue through examples. In the second part, we present some (dual)…

Probability · Mathematics 2007-05-23 Mu-Fa Chen

We provide a condition for f-ergodicity of strong Markov processes at a subgeometric rate. This condition is couched in terms of a supermartingale property for a functional of the Markov process. Equivalent formulations in terms of a drift…

Statistics Theory · Mathematics 2007-06-13 Randal Douc , Gersende Fort , Arnaud Guillin

Necessary and sufficient conditions for a Markov chain to be ergodic are that the chain is irreducible and aperiodic. This result is manifest in the case of random walks on finite groups by a statement about the support of the driving…

Quantum Algebra · Mathematics 2021-10-22 J. P. McCarthy

We study the ergodic behaviour of a discrete-time process $X$ which is a Markov chain in a stationary random environment. The laws of $X_t$ are shown to converge to a limiting law in (weighted) total variation distance as $t\to\infty$.…

Probability · Mathematics 2019-07-29 Balazs Gerencser , Miklos Rasonyi

We consider a discrete time hidden Markov model where the signal is a stationary Markov chain. When conditioned on the observations, the signal is a Markov chain in a random environment under the conditional measure. It is shown that this…

Probability · Mathematics 2009-09-24 Ramon van Handel

In this paper we find nonasymptotic exponential upper bounds for the deviation in the ergodic theorem for families of homogeneous Markov processes. We find some sufficient conditions for geometric ergodicity uniformly over a parametric…

Probability · Mathematics 2012-05-10 Leonid Galtchouk , Serguei Pergamenchtchikov

In this paper, we give a sufficient condition for the existence of a quasi-ergodic distribution for absorbing Markov processes. Using an orthogonal-polynomial approach, we prove that the previous main result is valid for the birth-death…

Probability · Mathematics 2019-02-25 Guoman He , Hanjun Zhang , Yixia Zhu

Noether's theorem links the symmetries of a quantum system with its conserved quantities, and is a cornerstone of quantum mechanics. Here we prove a version of Noether's theorem for Markov processes. In quantum mechanics, an observable…

Mathematical Physics · Physics 2017-08-22 John C. Baez , Brendan Fong