Related papers: Negative Entropy, Zero temperature and stationary …

We consider hidden Markov models indexed by a binary tree where the hidden state space is a general metric space. We study the maximum likelihood estimator (MLE) of the model parameters based only on the observed variables. In both…

This paper considers the speed of convergence (mixing) of a finite Markov kernel $P$ with respect to the Kullback-Leibler divergence (entropy). Given a Markov kernel one defines either a discrete-time Markov chain (with the $n$-step…

We consider a discrete time hidden Markov model where the signal is a stationary Markov chain. When conditioned on the observations, the signal is a Markov chain in a random environment under the conditional measure. It is shown that this…

We prove explicit error bounds for Markov chain Monte Carlo (MCMC) methods to compute expectations of functions with unbounded stationary variance. We assume that there is a $p\in(1,2)$ so that the functions have finite $L_p$-norm. For…

We study the exponential dissipation of entropic functionals for continuous time Markov chains and the associated convex Sobolev inequalities, including MLSI and Beckner inequalities. We propose a method that combines the Bakry \'Emery…

We study the problem of exponential mixing and large deviations for discrete-time Markov processes associated with a class of random dynamical systems. Under some dissipativity and regularisation hypotheses for the underlying deterministic…

Let $\beta >1$ be a non-integer. We consider expansions of the form $\sum_{i=1}^{\infty} d_i \beta^{-i}$, where the digits $(d_i)_{i \geq 1}$ are generated by means of a Borel map $K_{\beta}$ defined on $\{0,1\}^{\N}\times [ 0, \lfloor…

This is a general description of a probabilistic formalism of mechanics, i.e., an extension of the Newtonian mechanics principles to the systems undergoing random motion. From an analysis of the induction procedure from experimental data to…

We study the ergodic behaviour of a discrete-time process $X$ which is a Markov chain in a stationary random environment. The laws of $X_t$ are shown to converge to a limiting law in (weighted) total variation distance as $t\to\infty$.…

Let $X$, $B$ and $Y$ be three Dirichlet, Bernoulli and beta independent random variables such that $X\sim \mathcal{D}(a_0,...,a_d),$ such that $\Pr(B=(0,...,0,1,0,...,0))=a_i/a$ with $a=\sum_{i=0}^da_i$ and such that $Y\sim \beta(1,a).$ We…

Let {X_n,n\geq0} be a Markov chain on a general state space X with transition probability P and stationary probability \pi. Suppose an additive component S_n takes values in the real line R and is adjoined to the chain such that…

Let $X$ be the constrained random walk on ${\mathbb Z}_+^2$ having increments $(1,0)$, $(-1,1)$, $(0,-1)$ with jump probabilities $\lambda(M_k)$, $\mu_1(M_k)$, and $\mu_2(M_k)$ where $M$ is an irreducible aperiodic finite state Markov…

We study zero-temperature Glauber dynamics on \Z^d, which is a dynamic version of the Ising model of ferromagnetism. Spins are initially chosen according to a Bernoulli distribution with density p, and then the states are continuously (and…

Given two compact metric spaces $X$ and $Y$, a Lipschitz continuous cost function $c$ on $X \times Y$ and two probabilities $\mu \in\mathcal{P}(X),\,\nu\in\mathcal{P}(Y)$, we propose to study the Monge-Kantorovich problem and its duality…

We consider $N$ non-interacting fermions in an isotropic $d$-dimensional harmonic trap. We compute analytically the cumulative distribution of the maximal radial distance of the fermions from the trap center at zero temperature. While in…

We prove deviation bounds for the random variable $\sum_{i=1}^{n} f_i(Y_i)$ in which $\{Y_i\}_{i=1}^{\infty}$ is a Markov chain with stationary distribution and state space $[N]$, and $f_i: [N] \rightarrow [-a_i, a_i]$. Our bound improves…

An introduction to numerical large-deviation sampling is provided. First, direct biasing with a known distribution is explained. As simple example, the Bernoulli experiment is used throughout the text. Next, Markov chain Monte Carlo (MCMC)…

Via operator theoretic methods, we formalize the concentration phenomenon for a given observable `$r$' of a discrete time Markov chain with `$\mu_{\pi}$' as invariant ergodic measure, possibly having support on an unbounded state space. The…

We consider the random reversible Markov kernel K obtained by assigning i.i.d. nonnegative weights to the edges of the complete graph over n vertices and normalizing by the corresponding row sum. The weights are assumed to be in the domain…

We propose distribution-free runs-based control charts for detecting location shifts. Using the fact that given the number of total successes, the outcomes of a sequence of Bernoulli trials are random permutations, we are able to control…