English
Related papers

Related papers: Exponential Convergence Rates for Stochastically O…

200 papers

Recursive stochastic algorithms have gained significant attention in the recent past due to data driven applications. Examples include stochastic gradient descent for solving large-scale optimization problems and empirical dynamic…

Machine Learning · Computer Science 2020-07-27 Abhishek Gupta , Hao Chen , Jianzong Pi , Gaurav Tendolkar

In this paper we obtain non-uniform exponential upper bounds for the rate of convergence of a version of the algorithm Context, when the underlying tree is not necessarily bounded. The algorithm Context is a well-known tool to estimate the…

Statistics Theory · Mathematics 2008-05-22 Antonio Galves , Florencia Leonardi

For general, almost surely absorbed Markov processes, we obtain necessary and sufficient conditions for exponential convergence to a unique quasi-stationary distribution in the total variation norm. These conditions also ensure the…

Probability · Mathematics 2014-12-25 Nicolas Champagnat , Denis Villemonais

We provide a general framework to study stochastic sequences related to individual learning in economics, learning automata in computer sciences, social learning in marketing, and other applications. More precisely, we study the asymptotic…

Probability · Mathematics 2014-10-07 Carlos Oyarzun , Johannes Ruf

In this paper we consider the convergence of the conditional entropy to the entropy rate for Markov chains. Convergence of certain statistics of long range dependent processes, such as the sample mean, is slow. It has been shown in Carpio…

Probability · Mathematics 2021-10-29 Andrew Feutrill , Matthew Roughan

Hidden Markov chains are widely applied statistical models of stochastic processes, from fundamental physics and chemistry to finance, health, and artificial intelligence. The hidden Markov processes they generate are notoriously…

Chaotic Dynamics · Physics 2021-05-26 Alexandra M. Jurgens , James P. Crutchfield

Let $X$ be the constrained random walk on ${\mathbb Z}_+^2$ having increments $(1,0)$, $(-1,1)$, $(0,-1)$ with jump probabilities $\lambda(M_k)$, $\mu_1(M_k)$, and $\mu_2(M_k)$ where $M$ is an irreducible aperiodic finite state Markov…

Probability · Mathematics 2019-09-17 Fatma Başoğlu Kabran , Ali Devin Sezer

We study the convergence rate to stationarity for a class of exchangeable partition-valued Markov chains called cut-and-paste chains. The law governing the transitions of a cut-and-paste chain are determined by products of i.i.d. stochastic…

Probability · Mathematics 2012-09-25 Harry Crane , Steven P. Lalley

We consider Markov processes in continuous time with state space $\posint^N$ and provide two sufficient conditions and one necessary condition for the existence of moments $E(\|X(t)\|^r)$ of all orders $r \in \nat$ for all $t \geq 0$. The…

Probability · Mathematics 2015-02-02 Muruhan Rathinam

The exponential rate of convergence and the Central Limit Theorem for some Markov operators are established. The operators correspond to iterated function systems which, for example, may be used to generalize the cell cycle model given by…

Probability · Mathematics 2017-01-03 Sander Hille , Katarzyna Horbacz , Tomasz Szarek , Hanna Wojewódka

We study a Markov process with two components: the first component evolves according to one of finitely many underlying Markovian dynamics, with a choice of dynamics that changes at the jump times of the second component. The second…

Probability · Mathematics 2015-04-14 Bertrand Cloez , Martin Hairer

Extreme value functionals of stochastic processes are inverse functionals of the first passage time -- a connection that renders their probability distribution functions equivalent. Here, we deepen this link and establish a framework for…

Statistical Mechanics · Physics 2019-05-30 David Hartich , Aljaz Godec

This paper establishes the first almost sure convergence rate and the first maximal concentration bound with exponential tails for general contractive stochastic approximation algorithms with Markovian noise. As a corollary, we also obtain…

Machine Learning · Computer Science 2024-11-22 Xiaochi Qian , Zixuan Xie , Xinyu Liu , Shangtong Zhang

We consider periodic Markov chains with absorption. Applying to iterates of this periodic Markov chain criteria for the exponential convergence of conditional distributions of aperiodic absorbed Markov chains, we obtain exponential…

Probability · Mathematics 2022-11-08 Nicolas Champagnat , Denis Villemonais

We consider general Markov processes with absorption and provide criteria ensuring the exponential convergence in total variation of the distribution of the process conditioned not to be absorbed. The first one is based on two-sided…

Probability · Mathematics 2018-01-18 Nicolas Champagnat , Koléhè Coulibaly-Pasquier , Denis Villemonais

We develop a stochastic approximation-type algorithm to solve finite state/action, infinite-horizon, risk-aware Markov decision processes. Our algorithm has two loops. The inner loop computes the risk by solving a stochastic saddle-point…

Optimization and Control · Mathematics 2019-12-05 Wenjie Huang , William B. Haskell

Let $(X,\p_x)$ be a continuous time Markov chain with finite or countable state space $S$ and let $T$ be its first passage time in a subset $D$ of $S$. It is well known that if $\mu$ is a quasi-stationary distribution relatively to $T$,…

Probability · Mathematics 2013-10-25 Romain Bourget , Loïc Chaumont , Natalia Sapoukhina

The exponential upper bounds for the convergence rate of the distribution of restorable element with partially energized standby redundancy are founded, in the case when all working and repair times are bounded by exponential random…

Probability · Mathematics 2018-08-30 Galina Zverkina

We provide necessary and sufficient conditions for convergence of exponential integrals of Markov additive processes. Other than in the classical L\'evy case studied by Erickson and Maller we have to distinguish between almost sure…

Probability · Mathematics 2020-03-06 Anita Behme , Apostolos Sideris

In this paper it is shown that adaptive importance sampling algorithms converge at exponential rate for Markov chain expectation problems that admit a combination of a filtered estimator and a Markov zero-variance measure. It extends a…

Probability · Mathematics 2018-07-11 Ludolf E. Meester