English
Related papers

Related papers: Graph-accelerated Markov Chain Monte Carlo using A…

200 papers

Gibbs sampling is one of the most commonly used Markov Chain Monte Carlo (MCMC) algorithms due to its simplicity and efficiency. It cycles through the latent variables, sampling each one from its distribution conditional on the current…

Machine Learning · Computer Science 2024-08-26 Yanbo Wang , Wenyu Chen , Shimin Shan

We propose a new class of learning algorithms that combines variational approximation and Markov chain Monte Carlo (MCMC) simulation. Naive algorithms that use the variational approximation as proposal distribution can perform poorly…

Machine Learning · Computer Science 2013-01-14 Nando de Freitas , Pedro Hojen-Sorensen , Michael I. Jordan , Stuart Russell

In this paper we study the ergodicity properties of some adaptive Markov chain Monte Carlo algorithms (MCMC) that have been recently proposed in the literature. We prove that under a set of verifiable conditions, ergodic averages calculated…

Probability · Mathematics 2016-08-16 Christophe Andrieu , Éric Moulines

Stochastic sampling based trackers have shown good performance for abrupt motion tracking so that they have gained popularity in recent years. However, conventional methods tend to use a two-stage sampling paradigm, in which the search…

Computer Vision and Pattern Recognition · Computer Science 2015-03-11 Tianfei Zhou , Yao Lu , Feng Lv , Huijun Di , Qingjie Zhao , Jian Zhang

We compare convergence rates of Metropolis--Hastings chains to multi-modal target distributions when the proposal distributions can be of ``local'' and ``small world'' type. In particular, we show that by adding occasional long-range jumps…

Probability · Mathematics 2007-05-23 Yongtao Guan , Stephen M. Krone

Bayesian inference for doubly-intractable pairwise exponential graphical models typically involves variations of the exchange algorithm or approximate Markov chain Monte Carlo (MCMC) samplers. However, existing methods for both classes of…

Computation · Statistics 2026-03-30 Yujie Chen , Antik Chakraborty , Anindya Bhadra

Sampling from the stationary distribution is one of the fundamental tasks of Markov chain-based algorithms and has important applications in machine learning, combinatorial optimization and network science. For the quantum case, qsampling…

Quantum Physics · Physics 2023-03-08 Xinyin Li , Yun Shang

Monte Carlo methods use random sampling to estimate numerical quantities which are hard to compute deterministically. One important example is the use in statistical physics of rapidly mixing Markov chains to approximately compute partition…

Quantum Physics · Physics 2017-07-12 Ashley Montanaro

The configuration model is a standard tool for uniformly generating random graphs with a specified degree sequence, and is often used as a null model to evaluate how much of an observed network's structure can be explained by its degree…

Social and Information Networks · Computer Science 2023-05-31 Upasana Dutta , Bailey K. Fosdick , Aaron Clauset

We propose an efficient Markov Chain Monte Carlo method for sampling equilibrium distributions for stochastic lattice models, capable of handling correctly long and short-range particle interactions. The proposed method is a Metropolis-type…

Numerical Analysis · Mathematics 2010-06-21 Evangelia Kalligiannaki , Markos A. Katsoulakis , Petr Plechac

In this paper, we consider the Markov-Chain Monte Carlo (MCMC) approach for random sampling of combinatorial objects. The running time of such an algorithm depends on the total mixing time of the underlying Markov chain and is unknown in…

Discrete Mathematics · Computer Science 2016-09-15 Steffen Rechner , Annabell Berger

This paper develops a Bayesian computational platform at the interface between posterior sampling and optimization in models whose marginal likelihoods are difficult to evaluate. Inspired by adversarial optimization, namely Generative…

Statistics Theory · Mathematics 2021-12-01 Tetsuya Kaji , Veronika Rockova

Sampling from posterior distributions using Markov chain Monte Carlo (MCMC) methods can require an exhaustive number of iterations, particularly when the posterior is multi-modal as the MCMC sampler can become trapped in a local mode for a…

Methodology · Statistics 2019-10-30 Christopher Nemeth , Fredrik Lindsten , Maurizio Filippone , James Hensman

In statistical analysis, Monte Carlo (MC) stands as a classical numerical integration method. When encountering challenging sample problem, Markov chain Monte Carlo (MCMC) is a commonly employed method. However, the MCMC estimator is biased…

Numerical Analysis · Mathematics 2024-11-05 Jiarui Du , Zhijian He

Monte Carlo algorithms often aim to draw from a distribution $\pi$ by simulating a Markov chain with transition kernel $P$ such that $\pi$ is invariant under $P$. However, there are many situations for which it is impractical or impossible…

Methodology · Statistics 2014-04-16 P. Alquier , N. Friel , R. Everitt , A. Boland

An important problem arising in the study of complex networks, for instance in community detection and motif finding, is the sampling of graphs with fixed degree sequence. The equivalent problem of generating random 0,1 matrices with fixed…

Combinatorics · Mathematics 2018-07-27 Annabell Berger , Corrie Jacobien Carstens

We propose a method to efficiently integrate truncated probability densities. The method uses Markov chain Monte Carlo method to sample from a probability density matching the function being integrated. The required normalisation or…

Computation · Statistics 2013-12-10 A. John Arul , Kannan Iyer

Finite element model updating is challenging because 1) the problem is oftentimes underdetermined while the measurements are limited and/or incomplete; 2) many combinations of parameters may yield responses that are similar with respect to…

Applications · Statistics 2021-07-28 Kai Zhou , Jiong Tang

We show that for any multiple-try Metropolis algorithm, one can always accept the proposal and evaluate the importance weight that is needed to correct for the bias without extra computational cost. This results in a general, convenient,…

Computation · Statistics 2024-10-03 Guanxun Li , Aaron Smith , Quan Zhou

Markov chain Monte Carlo (MCMC) methods are foundational algorithms for Bayesian inference and probabilistic modeling. However, most MCMC algorithms are inherently sequential and their time complexity scales linearly with the sequence…

Computation · Statistics 2025-12-03 David M. Zoltowski , Skyler Wu , Xavier Gonzalez , Leo Kozachkov , Scott W. Linderman