English
Related papers

Related papers: Measure Concentration of Hidden Markov Processes

200 papers

Constrained Markov processes, such as reflecting diffusions, behave as an unconstrained process in the interior of a domain but upon reaching the boundary are controlled in some way so that they do not leave the closure of the domain. In…

Probability · Mathematics 2019-12-06 Cristina Costantini , Thomas G. Kurtz

In an effort to aid communication among different fields and perhaps facilitate progress on problems common to all of them, this article discusses hidden Markov processes from several viewpoints, especially that of symbolic dynamics, where…

Dynamical Systems · Mathematics 2010-01-13 Mike Boyle , Karl Petersen

Model reduction of Markov processes is a basic problem in modeling state-transition systems. Motivated by the state aggregation approach rooted in control theory, we study the statistical state compression of a discrete-state Markov chain…

Machine Learning · Statistics 2019-11-26 Anru Zhang , Mengdi Wang

This paper introduces a new parsimonious structure for mixture of autoregressive models. the weighting coefficients are determined through latent random variables, following a hidden Markov model. We propose a dynamic programming algorithm…

Statistics Theory · Mathematics 2011-05-12 S. H. Alizadeh , S. Rezakhah

We study various generalizations of concentration of measure on the unit sphere, in particular by means of log-Sobolev inequalities. First, we show Sudakov-type concentration results and local semicircular laws for weighted random matrices.…

Probability · Mathematics 2024-08-09 Friedrich Götze , Holger Sambale

This note aims at presenting several new theoretical results for the compound Poisson point process, which follows the work of Zhang \emph{et al.} [Insurance~Math.~Econom.~59(2014), 325-336]. The first part provides a new characterization…

Statistics Theory · Mathematics 2019-12-10 Huiming Zhang , Xiaoxu Wu

We obtain moment and Gaussian bounds for general Lipschitz functions evaluated along the sample path of a Markov chain. We treat Markov chains on general (possibly unbounded) state spaces via a coupling method. If the first moment of the…

Probability · Mathematics 2010-12-08 J. -R. Chazottes , F. Redig

We prove a strong law of large numbers for a class of strongly mixing processes. Our result rests on recent advances in understanding of concentration of measure. It is simple to apply and gives finite-sample (as opposed to asymptotic)…

Probability · Mathematics 2008-07-30 Aryeh Kontorovich , Anthony Brockwell

We introduce a novel concept of convergence for Markovian processes within Orlicz spaces, extending beyond the conventional approach associated with $L_p$ spaces. After showing that Markovian operators are contractive in Orlicz spaces, our…

Information Theory · Computer Science 2025-11-24 Amedeo Roberto Esposito , Marco Mondelli

This paper is divided into two parts. The first part reviews the formulae for f-divergences in the study of continuous-time Markov processes and explores their applications in areas such as stochastic stability, the second law of…

Probability · Mathematics 2024-10-03 Jin Won Kim , Amirhossein Taghvaei , Prashant G. Mehta

Concentration of measure is a phenomenon in which a random variable that depends in a smooth way on a large number of independent random variables is essentially constant. The random variable will "concentrate" around its median or…

Probability · Mathematics 2015-08-25 Meg Walters

Let $K = \{0,1,...,q-1\}$. We use a special class of translation invariant measures on $K^\mathbb{Z}$ called algebraic measures to study the entropy rate of a hidden Markov processes. Under some irreducibility assumptions of the Markov…

Information Theory · Computer Science 2012-08-30 Katy Marchand , Jaideep Mulherkar , Bruno Nachtergaele

We obtain a Bernstein type Gaussian concentration inequality for martingales. Our inequality improves the Azuma-Hoeffding inequality for moderate deviations $x$. Following the work of McDiarmid (1989), Talagrand (1996) and Boucheron, Lugosi…

Probability · Mathematics 2017-10-17 Xiequan Fan

A recent result presented the expansion for the entropy rate of a Hidden Markov Process (HMP) as a power series in the noise variable $\eps$. The coefficients of the expansion around the noiseless ($\eps = 0$) limit were calculated up to…

Information Theory · Computer Science 2009-11-11 Or Zuk , Eytan Domany , Ido Kanter , Michael Aizenman

Recently, Samorodnitsky proved a strengthened version of Mrs. Gerber's Lemma, where the output entropy of a binary symmetric channel is bounded in terms of the average entropy of the input projected on a random subset of coordinates. Here,…

Information Theory · Computer Science 2016-05-11 Or Ordentlich

Finding the entropy rate of Hidden Markov Processes is an active research topic, of both theoretical and practical importance. A recently used approach is studying the asymptotic behavior of the entropy rate in various regimes. In this…

Information Theory · Computer Science 2016-11-17 Or Zuk , Eytan Domany , Ido Kanter , Michael Aizenman

The entropy of a binary symmetric Hidden Markov Process is calculated as an expansion in the noise parameter epsilon. We map the problem onto a one-dimensional Ising model in a large field of random signs and calculate the expansion…

Information Theory · Computer Science 2009-11-11 O. Zuk , I. Kanter , E. Domany

Conditions on the generator of a Markov process to control the fluctuations of its bridges are found. In particular, continuous time random walks on graphs and gradient diffusions are considered. Under these conditions, a concentration of…

Probability · Mathematics 2016-03-08 Giovanni Conforti

We study Markov processes on weighted directed hypergraphs where the state of at most one vertex can change at a time. Our setting is general enough to include simplicial epidemic processes, processes on multilayered networks or even the…

Probability · Mathematics 2024-10-10 Dániel Keliger , Balázs Ráth

We consider a Markov chain on $\mathbb{R}^d$ with invariant measure $\mu$. We are interested in the rate of convergence of the empirical measures towards the invariant measure with respect to various dual distances, including in particular…

Probability · Mathematics 2022-10-13 Adrian Riekert