English
Related papers

Related papers: Measure Concentration of Hidden Markov Processes

200 papers

In our monograph with B. Roynette and M. Yor, we construct a sigma-finite measure related to penalisations of different stochastic processes, including the Brownian motion in dimension 1 or 2, and a large class of linear diffusions. In the…

Probability · Mathematics 2014-11-10 Joseph Najnudel

We consider Markovian models on graphs with local dynamics. We show that, under suitable conditions, such Markov chains exhibit both rapid convergence to equilibrium and strong concentration of measure in the stationary distribution. We…

Probability · Mathematics 2008-09-30 Malwina J. Luczak

For a real-valued measurable function $f$ and a nonnegative, nondecreasing function $\phi$, we first obtain a Chebyshev type inequality which provides an upper bound for $\displaystyle \phi(\lambda_{1}) \mu(\{x \in \Omega : f(x) \geq…

Functional Analysis · Mathematics 2022-09-14 M. Ashraf Bhat , G. Sankara Raju Kosuru

The goal of this paper is threefold. First, we survey the existing results on Hunt's hypothesis (H) for Markov processes and Getoor's conjecture for L\'{e}vy processes. Second, we investigate (H) for multidimensional L\'{e}vy processes from…

Probability · Mathematics 2019-08-20 Ze-Chun Hu , Wei Sun

Piecewise Deterministic Markov Processes (PDMPs) are studied in a general framework. First, different constructions are proven to be equivalent. Second, we introduce a coupling between two PDMPs following the same differential flow which…

Probability · Mathematics 2021-08-03 Alain Durmus , Arnaud Guillin , Pierre Monmarché

In this paper, we adopt a nonparametric Bayesian approach and investigate the asymptotic behavior of the posterior distribution in continuous time and general state space semi-Markov processes. In particular, we obtain posterior…

Statistics Theory · Mathematics 2019-06-14 V Barbu , Ghislaine Gayraud , N. Limnios , I. Votsi

We investigate a stationary process's crypticity---a measure of the difference between its hidden state information and its observed information---using the causal states of computational mechanics. Here, we motivate crypticity and cryptic…

Data Analysis, Statistics and Probability · Physics 2015-05-30 John R. Mahoney , Christopher J. Ellison , Ryan G. James , James P. Crutchfield

The analyticity of the entropy and relative entropy rates of continuous-state hidden Markov models is studied here. Using the analytic continuation principle and the stability properties of the optimal filter, the analyticity of these rates…

Information Theory · Computer Science 2019-09-02 Vladislav Z. B. Tadic , Arnaud Doucet

The convergence rate in Wasserstein distance is estimated for empirical measures of ergodic Markov processes, and the estimate can be sharp in some specific situations. The main result is applied to subordinations of typical models excluded…

Probability · Mathematics 2024-08-14 Feng-Yu Wang

We consider Markov chains on general state spaces in stationary random environment which are defined by a random mapping that is contractive up to a bounded perturbation. We prove their convergence to a limiting law, providing convergence…

Probability · Mathematics 2025-12-18 Attila Lovas , Miklós Rásonyi , Lionel Truquet

For Markov chains and Markov processes exhibiting a form of stochastic monotonicity (larger states shift up transition probabilities in terms of stochastic dominance), stability and ergodicity results can be obtained using order-theoretic…

Probability · Mathematics 2024-10-01 Takashi Kamihigashi , John Stachurski

This is a survey paper about reciprocal processes. The bridges of a Markov process are also Markov. But an arbitrary mixture of these bridges fails to be Markov in general. However, it still enjoys the interesting properties of a reciprocal…

Probability · Mathematics 2022-09-05 Christian Léonard , Sylvie Roelly , Jean-Claude Zambrini

This paper establishes the first almost sure convergence rate and the first maximal concentration bound with exponential tails for general contractive stochastic approximation algorithms with Markovian noise. As a corollary, we also obtain…

Machine Learning · Computer Science 2024-11-22 Xiaochi Qian , Zixuan Xie , Xinyu Liu , Shangtong Zhang

It is common, when dealing with quantum processes involving a subsystem of a much larger composite closed system, to treat them as effectively memory-less (Markovian). While open systems theory tells us that non-Markovian processes should…

Quantum Physics · Physics 2019-05-02 Pedro Figueroa-Romero , Kavan Modi , Felix A. Pollock

This paper provides a bound for the supremum of sample averages over a class of functions for a general class of mixing stochastic processes with arbitrary mixing rates. Regardless of the speed of mixing, the bound is comprised of a…

Probability · Mathematics 2026-03-27 Demian Pouzo

In order to give quantitative estimates for approximating the ergodic limit, we investigate probabilistic limit behaviors of time-averaging estimators of numerical discretizations for a class of time-homogeneous Markov processes, by…

Probability · Mathematics 2023-10-13 Chuchu Chen , Tonghe Dang , Jialin Hong , Guoting Song

In this paper, we establish sharp upper and lower bounds on the convergence rate of the empirical measures of point processes under the Wasserstein distance. To this end, we first introduce a new metric on the space of counting measures…

Statistics Theory · Mathematics 2026-04-28 Dongzhou Huang , Tianyi Jiang , Haonan Wang

The problem of calculating the rate of mutual information between two coarse-grained variables that together specify a continuous time Markov process is addressed. As a main obstacle, the coarse-grained variables are in general…

Statistical Mechanics · Physics 2013-10-01 Andre Cardoso Barato , David Hartich , Udo Seifert

We prove that an approximated version of the Brunn--Minkowski inequality with volume distortion coefficient implies a Gaussian concentration-of-measure phenomenon. Our main theorem is applicable to discrete spaces.

Differential Geometry · Mathematics 2008-05-08 Masayoshi Watanabe

We consider a general honest homogeneous continuous-time Markov process with restarts. The process is forced to restart from a given distribution at time moments generated by an independent Poisson process. The motivation to study such…

Probability · Mathematics 2012-06-26 Konstantin Avrachenkov , Alexei Piunovskiy , Zhang Yi