English
Related papers

Related papers: Solving the Poisson equation using coupled Markov …

200 papers

This paper deals with a complete bipartite matching problem with the objective of finding an optimal matching that maximizes a certain generic predefined utility function on the set of all matchings. After proving the NP-hardness of the…

Discrete Mathematics · Computer Science 2017-10-30 Shana Moothedath , Prasanna Chaporkar , Madhu N. Belur

Markov Chain Monte Carlo (MCMC) techniques are now widely used for cosmological parameter estimation. Chains are generated to sample the posterior probability distribution obtained following the Bayesian approach. An important issue is how…

In this article, we primarily propose a novel Bayesian characterization of stationary and nonstationary stochastic processes. In practice, this theory aims to distinguish between global stationarity and nonstationarity for both parametric…

Statistics Theory · Mathematics 2020-05-04 Sucharita Roy , Sourabh Bhattacharya

We study the stochastic dynamics of a system of interacting species in a stochastic environment by means of a continuous-time Markov chain with transition rates depending on the state of the environment. Models of gene regulation in systems…

Dynamical Systems · Mathematics 2019-12-03 Daniele Cappelletti , Abhishek Pal Majumder , Carsten Wiuf

In the paper, we study a new rate of convergence estimate for homogeneous discrete-time nonlinear Markov chains based on the Markov-Dobrushin condition. This result generalizes the convergence estimates for any positive number of transition…

Probability · Mathematics 2021-10-22 Aleksandr A. Shchegolev

We establish a new Bernstein-type deviation inequality for general (non-reversible) discrete-time Markov chains via an elementary approach. More robust than existing works in the literature, our result only requires the Markov chain to…

Probability · Mathematics 2025-10-07 De Huang , Xiangyuan Li

We propose a very fast approximate Markov Chain Monte Carlo (MCMC) sampling framework that is applicable to a large class of sparse Bayesian inference problems, where the computational cost per iteration in several models is of order…

Computation · Statistics 2021-08-17 Yves Atchadé , Liwei Wang

We consider the problem of estimating the transition rate matrix of a continuous-time Markov chain from a finite-duration realisation of this process. We approach this problem in an imprecise probabilistic framework, using a set of prior…

Machine Learning · Statistics 2018-07-12 Thomas Krak , Alexander Erreygers , Jasper De Bock

I show how any reversible Markov chain on a finite state space that is irreducible, and hence suitable for estimating expectations with respect to its invariant distribution, can be used to construct a non-reversible Markov chain on a…

Probability · Mathematics 2007-06-13 Radford M. Neal

We introduce two types of estimators of the finite-dimensional parameters in the case of observations of inhomogeneous Poisson processes. These are the estimators of the method of moments and multi-step MLE. It is shown that the estimators…

Statistics Theory · Mathematics 2018-06-19 Ali S. Dabye , Alix A. Gounoung , Yury A. Kutoyants

We formulate some simple conditions under which a Markov chain may be approximated by the solution to a differential equation, with quantifiable error probabilities. The role of a choice of coordinate functions for the Markov chain is…

Probability · Mathematics 2008-04-23 R. W. R. Darling , J. R. Norris

This paper introduces a general framework for estimating variance components in the linear mixed models via general unbiased estimating equations, which include some well-used estimators such as the restricted maximum likelihood estimator.…

Methodology · Statistics 2021-05-18 Tatsuya Kubokawa , Shonosuke Sugasawa , Hiromasa Tamae , Sanjay Chaudhuri

There is a lack of simple and scalable algorithms for uncertainty quantification. Bayesian methods quantify uncertainty through posterior and predictive distributions, but it is difficult to rapidly estimate summaries of these…

Computation · Statistics 2016-12-28 Cheng Li , Sanvesh Srivastava , David B. Dunson

We use coupling to study the time taken until the distribution of a statistic on a Markov chain is close to its stationary distribution. Coupling is a common technique used to obtain upper bounds on mixing times of Markov chains, and we…

Probability · Mathematics 2019-10-09 Graham White

Approximate Bayesian computation allows for inference of complicated probabilistic models with intractable likelihoods using model simulations. The Markov chain Monte Carlo implementation of approximate Bayesian computation is often…

Computation · Statistics 2019-05-17 Matti Vihola , Jordan Franks

We obtain universal estimates on the convergence to equilibrium and the times of coupling for continuous time irreducible reversible finite-state Markov chains, both in the total variation and in the L^2 norms. The estimates in total…

Probability · Mathematics 2012-01-24 Mykhaylo Shkolnikov

The Ewens sampling formula is a distribution related to the random partition of a positive integer. In this study, we investigate the issue of non-existence solutions in parameter estimation under the distribution. As a result, the first…

Statistics Theory · Mathematics 2021-05-25 Masayo Y. Hirose , Shuhei Mano

Markov chain Monte Carlo is a method of producing a correlated sample in order to estimate features of a target distribution via ergodic averages. A fundamental question is when should sampling stop? That is, when are the ergodic averages…

Statistics Theory · Mathematics 2007-06-13 Galin Jones , Murali Haran , Brian Caffo , Ronald Neath

We develop sampling methods, which consist of Gaussian invariant versions of random walk Metropolis (RWM), Metropolis adjusted Langevin algorithm (MALA) and second order Hessian or Manifold MALA. Unlike standard RWM and MALA we show that…

Machine Learning · Statistics 2025-06-27 Michalis K. Titsias , Angelos Alexopoulos , Siran Liu , Petros Dellaportas

A key quantity of interest in Bayesian inference are expectations of functions with respect to a posterior distribution. Markov Chain Monte Carlo is a fundamental tool to consistently compute these expectations via averaging samples drawn…

Machine Learning · Statistics 2015-02-10 Heiko Strathmann , Dino Sejdinovic , Mark Girolami