English
Related papers

Related papers: Ergodic properties of some Markov chains models in…

200 papers

We study various classes of random processes defined on the regular tree $T_d$ that are invariant under the automorphism group of $T_d$. Most important ones are factor of i.i.d. processes (randomized local algorithms), branching Markov…

Probability · Mathematics 2015-07-28 Ágnes Backhausz , Balázs Szegedy

We establish general conditions under which Markov chains produced by the Hamiltonian Monte Carlo method will and will not be geometrically ergodic. We consider implementations with both position-independent and position-dependent…

Computation · Statistics 2018-11-19 Samuel Livingstone , Michael Betancourt , Simon Byrne , Mark Girolami

We study existence and uniqueness of invariant probability measures for continuous-time Markov processes on general state spaces. Existence is obtained from tightness of time averages under a weak regularity assumption inspired by…

Probability · Mathematics 2026-01-21 Jean-Gabriel Attali

We establish the existence, uniqueness and attraction properties of an ergodic invariant measure for the Boussinesq Equations in the presence of a degenerate stochastic forcing acting only in the temperature equation and only at the largest…

Analysis of PDEs · Mathematics 2013-11-15 Juraj Földes , Nathan Glatt-Holtz , Geordie Richards , Enrique Thomann

Motivated by studying stochastic systems with non-Gaussian L\'evy noise, spectral properties for a type of linear cocycles are considered. These linear cocycles have countable jump discontinuities in time. A multiplicative ergodic theorem…

Probability · Mathematics 2018-01-09 Huijie Qiao , Jinqiao Duan

We consider a large family of discrete and continuous time controlled Markov processes and study an ergodic risk-sensitive minimization problem. Under a blanket stability assumption, we provide a complete analysis to this problem. In…

Optimization and Control · Mathematics 2022-07-18 Anup Biswas , Somnath Pradhan

Given a DFA we consider the random walk that starts at the initial state and at each time step moves to a new state by taking a random transition from the current state. This paper shows that for typical DFA this random walk induces an…

Formal Languages and Automata Theory · Computer Science 2013-11-28 Borja Balle

We investigate toy dynamical models of energy-level repulsion in quantum eigenvalue sequences. We focus on parametric (with respect to a running coupling or "complexity" parameter) stochastic processes that are capable of relaxing towards a…

Statistical Mechanics · Physics 2007-05-23 Piotr Garbaczewski

The aim of this text is to establish some relations between Markov chains in Dirichlet Environments on directed graphs and certain hypergeometric integrals associated with a particular arrangement of hyperplanes. We deduce from these…

Probability · Mathematics 2007-05-23 Christophe Sabot

We consider deep multivariate models for heterogeneous collections of random variables. In the context of computer vision, such collections may e.g. consist of images, segmentations, image attributes, and latent variables. When developing…

Machine Learning · Computer Science 2026-02-03 Dmitrij Schlesinger , Boris Flach , Alexander Shekhovtsov

The consistency of the Bayesian estimation of a parameter is shown for a class of ergodic discrete Markov chains. J.L. Doob's method was used, offered earlier for the i.i.d. situation. The result may be useful in the reliability theory for…

Probability · Mathematics 2025-03-27 A. I. Nurieva , A. Yu. Veretennikov

This paper consists of four parts. In the first part, we explain what eigenvalues we are interested in and show the difficulties of the study on the first (non-trivial) eigenvalue through examples. In the second part, we present some (dual)…

Probability · Mathematics 2007-05-23 Mu-Fa Chen

We introduce simple conditions ensuring that invariant distributions of a Feller Markov chain on a compact Riemannian manifold are absolutely continuous with a lower semi-continuous, continuous or smooth density with respect to the…

Probability · Mathematics 2024-10-25 Michel Benaïm , Oliver Tough

We study an intermittent quasistatic dynamical system composed of nonuniformly hyperbolic Pomeau--Manneville maps with time-dependent parameters. We prove an ergodic theorem which shows almost sure convergence of time averages in a certain…

Dynamical Systems · Mathematics 2016-06-22 Juho Leppänen , Mikko Stenlund

Using a model Hamiltonian for a single-mode electromagnetic field interacting with a nonlinear medium, we show that quantum expectation values of subsystem observables can exhibit remarkably diverse ergodic properties even when the dynamics…

Quantum Physics · Physics 2007-06-21 C. Sudheesh , S. Lakshmibala , V. Balakrishnan

Consider longitudinal networks whose edges turn on and off according to a discrete-time Markov chain with exponential-family transition probabilities. We characterize when their joint distributions are also exponential families with the…

Methodology · Statistics 2024-03-12 William K. Schwartz , Sonja Petrović , Hemanshu Kaul

We exhibit an efficient procedure for testing, based on a single long state sequence, whether an unknown Markov chain is identical to or $\varepsilon$-far from a given reference chain. We obtain nearly matching (up to logarithmic factors)…

Machine Learning · Statistics 2019-09-26 Geoffrey Wolfer , Aryeh Kontorovich

We study the limiting behavior of a random dynamic system driven by a stochastic chain. Our main interest is in the chains that are not necessarily ergodic but rather decomposable into ergodic classes. To investigate the conditions under…

Dynamical Systems · Mathematics 2011-02-02 Behrouz Touri , Angelia Nedi'c

Markov state modeling has gained popularity in various scientific fields since it reduces complex time-series data sets into transitions between a few states. Yet common Markov state modeling frameworks assume a single Markov chain…

Methodology · Statistics 2026-02-25 Christopher E. Miles , Robert J. Webber

We consider whether ergodic Markov chains with bounded step size remain bounded in probability when their transitions are modified by an adversary on a bounded subset. We provide counterexamples to show that the answer is no in general, and…