English
Related papers

Related papers: Quantitative contraction rates for Markov chains o…

200 papers

The exponential contraction in $L^1$-Wasserstein distance and exponential convergence in $L^q$-Wasserstein distance ($q\geq 1$) are considered for stochastic differential equations with irregular drift. When the irregular drift drift is…

Probability · Mathematics 2024-04-22 Shao-Qin Zhang

In this article, relying on Foster-Lyapunov drift conditions, we establish subexponential upper and lower bounds on the rate of convergence in the $\mathrm{L}^p$-Wasserstein distance for a class of irreducible and aperiodic Markov…

Probability · Mathematics 2022-02-28 Ari Arapostathis , Guodong Pang , Nikola Sandrić

We consider general Markov processes with absorption and provide criteria ensuring the exponential convergence in total variation of the distribution of the process conditioned not to be absorbed. The first one is based on two-sided…

Probability · Mathematics 2018-01-18 Nicolas Champagnat , Koléhè Coulibaly-Pasquier , Denis Villemonais

We present a general-purpose method to train Markov chain Monte Carlo kernels, parameterized by deep neural networks, that converge and mix quickly to their target distribution. Our method generalizes Hamiltonian Monte Carlo and is trained…

Machine Learning · Statistics 2018-03-06 Daniel Levy , Matthew D. Hoffman , Jascha Sohl-Dickstein

We develop a framework for the compression of reversible Markov chains with rigorous error control. Given a subset of selected states, we construct reduced dynamics that can be lifted to an approximation of the full dynamics, and we prove…

Numerical Analysis · Mathematics 2025-09-03 Mark Fornace , Michael Lindsey

We study the problem of sampling from a distribution $\target$ using the Langevin Monte Carlo algorithm and provide rate of convergences for this algorithm in terms of Wasserstein distance of order $2$. Our result holds as long as the…

Computation · Statistics 2016-07-04 Thomas Bonis

We use coupling to study the time taken until the distribution of a statistic on a Markov chain is close to its stationary distribution. Coupling is a common technique used to obtain upper bounds on mixing times of Markov chains, and we…

Probability · Mathematics 2019-10-09 Graham White

We consider the discrete time unitary dynamics given by a quantum walk on $\Z^d$ performed by a particle with internal degree of freedom, called coin state, according to the following iterated rule: a unitary update of the coin state takes…

Mathematical Physics · Physics 2015-05-30 Eman Hamza , Alain Joye

Nonlinear Markov chains with finite state space have been introduced in Kolokoltsov (2010). The characteristic property of these processes is that the transition probabilities do not only depend on the state, but also on the distribution of…

Probability · Mathematics 2020-07-07 Berenice Anne Neumann

Convergence rate analyses of random walk Metropolis-Hastings Markov chains on general state spaces have largely focused on establishing sufficient conditions for geometric ergodicity or on analysis of mixing times. Geometric ergodicity is a…

Statistics Theory · Mathematics 2023-07-24 Riddhiman Bhattacharya , Galin L. Jones

In quantum many-body systems, time-evolved states typically remain confined to a smaller region of the Hilbert space known as the $\textit{Krylov subspace}$. The time evolution can be mapped onto a one-dimensional problem of a particle…

High Energy Physics - Theory · Physics 2025-09-01 Hugo A. Camargo , Yichao Fu , Viktor Jahnke , Keun-Young Kim , Kuntal Pal

We study branching Markov chains on a countable state space (space of types) $\mathscr{X}$, with the focus on the qualitative aspects of the limit behaviour of the evolving empirical population distributions. No conditions are imposed on…

Probability · Mathematics 2025-07-30 Vadim A. Kaimanovich , Wolfgang Woess

An inequality of K. Marton shows that the joint distribution of a Markov chain with uniformly contracting transition kernels exhibits concentration. We prove an analogous inequality for broadcast models on finite trees. We use this…

Probability · Mathematics 2019-08-23 Christopher Shriver

We derive the first explicit bounds for the spectral gap of a random walk Metropolis algorithm on $R^d$ for any value of the proposal variance, which when scaled appropriately recovers the correct $d^{-1}$ dependence on dimension for…

Probability · Mathematics 2024-09-25 Christophe Andrieu , Anthony Lee , Sam Power , Andi Q. Wang

An algorithm for estimating quasi-stationary distribution of finite state space Markov chains has been proven in a previous paper. Now this paper proves a similar algorithm that works for general state space Markov chains under very general…

Probability · Mathematics 2015-03-04 Jose H. Blanchet , Peter Glynn , Shuheng Zheng

Recursive stochastic algorithms have gained significant attention in the recent past due to data driven applications. Examples include stochastic gradient descent for solving large-scale optimization problems and empirical dynamic…

Machine Learning · Computer Science 2020-07-27 Abhishek Gupta , Hao Chen , Jianzong Pi , Gaurav Tendolkar

Concentration bounds for non-product, non-Haar measures are fairly recent: the first such result was obtained for contracting Markov chains by Marton in 1996 via the coupling method. The work that followed, with few exceptions, also used…

Probability · Mathematics 2012-07-10 Leonid , Kontorovich

We obtain an upper escape rate function for a continuous time minimal symmetric Markov chain, defined on a locally finite weighted graph. This upper rate function is given in terms of volume growth with respect to an adapted path metric and…

Probability · Mathematics 2013-04-24 Xueping Huang , Yuichi Shiozawa

Physical notions of stochastic resonance for potential diffusions in periodically changing double-well potentials such as the spectral power amplification have proved to be defective. They are not robust for the passage to their effective…

Probability · Mathematics 2007-05-23 Samuel Herrmann , Peter Imkeller

We are interested in studying the sensitivity of diffusion processes or their approximations by Markov Chains with respect to a perturbation of the coefficients.

Probability · Mathematics 2016-11-28 V. Konakov , A. Kozhina , S. Menozzi