English
Related papers

Related papers: Bayesian analysis for reversible Markov chains

200 papers

It is shown that transient graphs for the simple random walk do not admit a nearest neighbor transient Markov chain (not necessarily a reversible one), that crosses all edges with positive probability, while there is such chain for the…

Probability · Mathematics 2019-02-15 Itai Benjamini , Jonathan Hermon

We investigate the utility to computational Bayesian analyses of a particular family of recursive marginal likelihood estimators characterized by the (equivalent) algorithms known as "biased sampling" or "reverse logistic regression" in the…

Methodology · Statistics 2014-10-16 Ewan Cameron , Anthony Pettitt

All one-condition generalized inverses of the Markovian kernel I - P, where P is the transition matrix of a finite irreducible Markov chain, can be uniquely specified in terms of the stationary probabilities and the mean first passage times…

Probability · Mathematics 2014-03-05 Jeffrey J. Hunter

This article presents a Bayesian inferential method where the likelihood for a model is unknown but where data can easily be simulated from the model. We discretize simulated (continuous) data to estimate the implicit likelihood in a…

We present an algorithm that can efficiently compute a broad class of inferences for discrete-time imprecise Markov chains, a generalised type of Markov chains that allows one to take into account partially specified probabilities and other…

Probability · Mathematics 2019-07-02 Natan T'Joens , Thomas Krak , Jasper De Bock , Gert de Cooman

A common task in experimental sciences is to fit mathematical models to real-world measurements to improve understanding of natural phenomenon (reverse-engineering or inverse modeling). When complex dynamical systems are considered, such as…

Numerical Analysis · Mathematics 2018-06-18 Jean-Charles Croix , Nicolas Durrande , Mauricio Alvarez

We develop a new Bayesian modelling framework for the class of higher-order, variable-memory Markov chains, and introduce an associated collection of methodological tools for exact inference with discrete time series. We show that a version…

The Markov Chain Monte Carlo method is the dominant paradigm for posterior computation in Bayesian analysis. It is common to control computation time by making approximations to the Markov transition kernel. Comparatively little attention…

Computation · Statistics 2017-08-30 James E. Johndrow , Jonathan C. Mattingly , Sayan Mukherjee , David Dunson

A fundamental task in numerical computation is the solution of large linear systems. The conjugate gradient method is an iterative method which offers rapid convergence to the solution, particularly when an effective preconditioner is…

Methodology · Statistics 2018-12-18 Jon Cockayne , Chris Oates , Ilse Ipsen , Mark Girolami

This article constructs a class of random probability measures based on exponentially and polynomially tilting operated on the laws of completely random measures. The class is proved to be conjugate in that it covers both prior and…

Statistics Theory · Mathematics 2013-12-19 John W. Lau

Bayesian analysis often concerns an evaluation of models with different dimensionality as is necessary in, for example, model selection or mixture models. To facilitate this evaluation, transdimensional Markov chain Monte Carlo (MCMC)…

Methodology · Statistics 2018-08-13 Daniel W. Heck , Antony M. Overstall , Quentin F. Gronau , Eric-Jan Wagenmakers

We consider a Markov chain on invertible $n\times n$ matrices with entries in $\mathbb{Z}_2$ which moves by picking an ordered pair of distinct rows and add the first one to the other, modulo $2$. We establish a logarithmic Sobolev…

Probability · Mathematics 2025-09-29 Anna Ben-Hamou

In a recent breakthrough, Teyssier [Tey20] introduced a new method for approximating the distance from equilibrium of a random walk on a group. He used it to study the limit profile for the random transpositions card shuffle. His techniques…

Probability · Mathematics 2025-05-15 Evita Nestoridi , Sam Olesker-Taylor

This article shows how coupled Markov chains that meet exactly after a random number of iterations can be used to generate unbiased estimators of the solutions of the Poisson equation. Through this connection, we re-derive known unbiased…

Computation · Statistics 2025-12-10 Randal Douc , Pierre E. Jacob , Anthony Lee , Dootika Vats

We aim at an explicit characterization of the renormalized Hamiltonian after decimation transformation of a one-dimensional Ising-type Hamiltonian with a nearest-neighbor interaction and a magnetic field term. To facilitate a deeper…

Statistical Mechanics · Physics 2015-06-05 Mei Yin

Let $(\tau_x)_{x \in \Z^d}$ be i.i.d. random variables with heavy (polynomial) tails. Given $a \in [0,1]$, we consider the Markov process defined by the jump rates $\omega_{x \to y} = {\tau_x}^{-(1-a)} {\tau_y}^a$ between two neighbours $x$…

Probability · Mathematics 2009-02-02 Jean-Christophe Mourrat

This paper aims at improving the convergence to equilibrium of finite ergodic Markov chains via permutations and projections. First, we prove that a specific mixture of permuted Markov chains arises naturally as a projection under the KL…

Probability · Mathematics 2025-07-22 Michael C. H. Choi , Max Hird , Youjia Wang

We consider a prior for nonparametric Bayesian estimation which uses finite random series with a random number of terms. The prior is constructed through distributions on the number of basis functions and the associated coefficients. We…

Statistics Theory · Mathematics 2015-02-10 Weining Shen , Subhashis Ghosal

There is a rich literature on Bayesian methods for density estimation, which characterize the unknown density as a mixture of kernels. Such methods have advantages in terms of providing uncertainty quantification in estimation, while being…

Methodology · Statistics 2024-04-10 Shounak Chattopadhyay , Antik Chakraborty , David B. Dunson

The velocity-jump model is a specific type of piecewise deterministic Markov process in which an individual's velocity is constant except at times that form the events of some point process. It represents an interpretable continuous-time…

Methodology · Statistics 2025-09-26 Paul G. Blackwell