English
Related papers

Related papers: Spectral theory for Markov chains with transition …

200 papers

The main purpose of this article is to establish moderate deviation principles for additive functionals of bifurcating Markov chains. Bifurcating Markov chains are a class of processes which are indexed by a regular binary tree. They can be…

Probability · Mathematics 2021-05-21 S. Valère Bitseki Penda , Gorgui Gackou

Markov Chain Monte Carlo is repeatedly used to analyze the properties of intractable distributions in a convenient way. In this paper we derive conditions for geometric ergodicity of a general class of nonparametric stochastic volatility…

Statistical Finance · Quantitative Finance 2016-12-09 Jerzy P. Rydlewski , Małgorzata Snarska

Information geometry of Markov chains has been studied using the dually flat structure of the space of transition probabilities. Although applications of this structure have been investigated, few attempts have examined its statistical…

Differential Geometry · Mathematics 2025-11-20 Naomichi Nakajima

Physical notions of stochastic resonance for potential diffusions in periodically changing double-well potentials such as the spectral power amplification have proved to be defective. They are not robust for the passage to their effective…

Probability · Mathematics 2007-05-23 Samuel Herrmann , Peter Imkeller

The switch chain is a well-known Markov chain for sampling directed graphs with a given degree sequence. While not ergodic in general, we show that it is ergodic for regular degree sequences. We then prove that the switch chain is rapidly…

Combinatorics · Mathematics 2011-10-17 Catherine Greenhill

In this paper, we are interested in investigating the perturbation bounds for the stationary distributions for discrete-time or continuous-time Markov chains on a countable state space. For discrete-time Markov chains, two new norm-wise…

Probability · Mathematics 2012-08-27 Yuanyuan Liu

Perturbation theory for Markov chains addresses the question how small differences in the transitions of Markov chains are reflected in differences between their distributions. We prove powerful and flexible bounds on the distance of the…

Computation · Statistics 2017-02-27 Daniel Rudolf , Nikolaus Schweizer

We extend Hoeffding's lemma to general-state-space and not necessarily reversible Markov chains. Let $\{X_i\}_{i \ge 1}$ be a stationary Markov chain with invariant measure $\pi$ and absolute spectral gap $1-\lambda$, where $\lambda$ is…

Statistics Theory · Mathematics 2018-07-19 Jianqing Fan , Bai Jiang , Qiang Sun

We consider irreversible Markov chains on finite commutative rings randomly generated using both addition and multiplication. We restrict ourselves to the case where the addition is uniformly random and multiplication is arbitrary. We first…

Representation Theory · Mathematics 2020-06-11 Arvind Ayyer , Pooja Singla

We consider evaluation of proper posterior distributions obtained from improper prior distributions. Our context is estimating a bounded function $\phi$ of a parameter when the loss is quadratic. If the posterior mean of $\phi$ is…

Statistics Theory · Mathematics 2008-11-10 Morris L. Eaton , James P. Hobert , Galin L. Jones , Wen-Lin Lai

We analyze the properties of degree-preserving Markov chains based on elementary edge switchings in undirected and directed graphs. We give exact yet simple formulas for the mobility of a graph (the number of possible moves) in terms of its…

Disordered Systems and Neural Networks · Physics 2012-03-12 E. S. Roberts , A. Annibale , A. C. C. Coolen

We consider Markov chains with random transition probabilities which, moreover, fluctuate randomly with time. We describe such a system by a product of stochastic matrices, $U(t)=M_t\cdots M_1$, with the factors $M_i$ drawn independently…

Mathematical Physics · Physics 2018-11-14 G. C. P. Innocentini , M. Novaes

We consider the parameter estimation of Markov chain when the unknown transition matrix belongs to an exponential family of transition matrices. Then, we show that the sample mean of the generator of the exponential family is an…

Statistics Theory · Mathematics 2016-09-28 Masahito Hayashi , Shun Watanabe

The goal of this paper is to develop a general method to establish conditional ergodicity of infinite-dimensional Markov chains. Given a Markov chain in a product space, we aim to understand the ergodic properties of its conditional…

Probability · Mathematics 2014-10-28 Xin Thomson Tong , Ramon van Handel

We consider continuous-time Markov chain on a finite state space X. We assume X can be clustered into several subsets such that the intra-transition rates within these subsets are of order $\mathcal{O}(\frac{1}{\epsilon})$ comparing to the…

Probability · Mathematics 2016-01-28 Wei Zhang

We study a simple Markov chain, the switch chain, on the set of all perfect matchings in a bipartite graph. This Markov chain was proposed by Diaconis, Graham and Holmes as a possible approach to a sampling problem arising in Statistics. We…

Data Structures and Algorithms · Computer Science 2017-01-27 Martin Dyer , Mark Jerrum , Haiko Müller

We define a finite Markov chain, called generalized crested product, which naturally appears as a generalization of the first crested product of Markov chains. A complete spectral analysis is developed and the $k$-step transition…

Probability · Mathematics 2016-02-16 Daniele D'Angeli , Alfredo Donno

We extend our previous study of Markov chains on finite commutative rings (arXiv:1605.05089) to arbitrary finite rings with identity. At each step, we either add or multiply by a randomly chosen element of the ring, where the addition…

Representation Theory · Mathematics 2019-01-15 Arvind Ayyer , Pooja Singla

Scattering theory has been suggested as a convenient method to identify topological phases of matter, in particular of disordered systems for which the Bloch band-theory approach is inapplicable. Here we examine this idea, employing as a…

Mesoscale and Nanoscale Physics · Physics 2024-03-14 Zhi-Hai Liu , O. Entin-Wohlman , A. Aharony , J. Q. You , H. Q. Xu

Let $\{Y_i\}_{i=1}^{\infty}$ be a stationary reversible Markov chain with state space $[N]$, let $(X, \| \cdot \|)$ be a real-valued Banach space and let $f_1, \ldots, f_n: [N] \rightarrow X$ be functions with mean $0$ such that $\|f_i(v)\|…

Probability · Mathematics 2026-03-02 Shravas Rao