English
Related papers

Related papers: Partition function approach to non-Gaussian likeli…

200 papers

Motivated by the problem of exploring discrete but very complex state spaces in Bayesian models, we propose a novel Markov Chain Monte Carlo search algorithm: the taxicab sampler. We describe the construction of this sampler and discuss how…

Methodology · Statistics 2022-10-04 Vincent Geels , Matthew Pratola , Radu Herbei

Many probabilistic models introduce strong dependencies between variables using a latent multivariate Gaussian distribution or a Gaussian process. We present a new Markov chain Monte Carlo algorithm for performing inference in models with…

Computation · Statistics 2010-03-22 Iain Murray , Ryan Prescott Adams , David J. C. MacKay

Markov chain Monte Carlo (MCMC) algorithms have become powerful tools for Bayesian inference. However, they do not scale well to large-data problems. Divide-and-conquer strategies, which split the data into batches and, for each batch, run…

Computation · Statistics 2017-07-18 Christopher Nemeth , Chris Sherlock

In statistical modeling of computer experiments sometimes prior information is available about the underlying function. For example, the physical system simulated by the computer code may be known to be monotone with respect to some or all…

Methodology · Statistics 2014-06-17 Shirin Golchi , Derek R. Bingham , Hugh Chipman , David A. Campbell

In this paper we consider fully Bayesian inference in general state space models. Existing particle Markov chain Monte Carlo (MCMC) algorithms use an augmented model that takes into account all the variable sampled in a sequential Monte…

Methodology · Statistics 2014-07-31 Christopher K. Carter , Eduardo F. Mendes , Robert Kohn

Efficient sampling of many-dimensional and multimodal density functions is a task of great interest in many research fields. We describe an algorithm that allows parallelizing inherently serial Markov chain Monte Carlo (MCMC) sampling by…

Computation · Statistics 2020-08-10 Vasyl Hafych , Philipp Eller , Oliver Schulz , Allen Caldwell

We present a novel Ensemble Monte Carlo Growth method to sample the equilibrium thermodynamic properties of random chains. The method is based on the multicanonical technique of computing the density of states in the energy space. Such a…

Statistical Mechanics · Physics 2020-03-04 Graziano Vernizzi , Trung Dac Nguyen , Henri Orland , Monica Olvera de la Cruz

We consider the problem of inferring a latent function in a probabilistic model of data. When dependencies of the latent function are specified by a Gaussian process and the data likelihood is complex, efficient computation often involve…

Machine Learning · Statistics 2018-07-23 Martin Tegner , Benjamin Bloem-Reddy , Stephen Roberts

We propose a Monte Carlo algorithm to sample from high dimensional probability distributions that combines Markov chain Monte Carlo and importance sampling. We provide a careful theoretical analysis, including guarantees on robustness to…

Computation · Statistics 2019-09-18 Giacomo Zanella , Gareth Roberts

We describe a general strategy for sampling configurations from a given distribution, NOT based on the standard Metropolis (Markov chain) strategy. It uses the fact that nontrivial problems in statistical physics are high dimensional and…

Statistical Mechanics · Physics 2009-11-07 P. Grassberger

Global fits of physics models require efficient methods for exploring high-dimensional and/or multimodal posterior functions. We introduce a novel method for accelerating Markov Chain Monte Carlo (MCMC) sampling by pairing a…

High Energy Physics - Phenomenology · Physics 2023-09-06 N. T. Hunt-Smith , W. Melnitchouk , F. Ringer , N. Sato , A. W Thomas , M. J. White

We introduce Markov chain Monte Carlo (MCMC) algorithms based on numerical approximations of piecewise-deterministic Markov processes obtained with the framework of splitting schemes. We present unadjusted as well as adjusted algorithms,…

Probability · Mathematics 2025-11-04 Andrea Bertazzi , Paul Dobson , Pierre Monmarché

Monte Carlo methods use random sampling to estimate numerical quantities which are hard to compute deterministically. One important example is the use in statistical physics of rapidly mixing Markov chains to approximately compute partition…

Quantum Physics · Physics 2017-07-12 Ashley Montanaro

To conduct Bayesian inference with large data sets, it is often convenient or necessary to distribute the data across multiple machines. We consider a likelihood function expressed as a product of terms, each associated with a subset of the…

Computation · Statistics 2020-04-09 Lewis J. Rendell , Adam M. Johansen , Anthony Lee , Nick Whiteley

Bayesian hierarchical modeling is a popular approach to capturing unobserved heterogeneity across individual units. However, standard estimation methods such as Markov chain Monte Carlo (MCMC) can be impracticable for modeling outcomes from…

Methodology · Statistics 2014-11-04 Michael Braun , Paul Damien

For several decades now, Bayesian inference techniques have been applied to theories of particle physics, cosmology and astrophysics to obtain the probability density functions of their free parameters. In this study, we review and compare…

High Energy Physics - Phenomenology · Physics 2025-09-03 Joshua Albert , Csaba Balazs , Andrew Fowlie , Will Handley , Nicholas Hunt-Smith , Roberto Ruiz de Austri , Martin White

Traditional Bayesian random partition models assume that the size of each cluster grows linearly with the number of data points. While this is appealing for some applications, this assumption is not appropriate for other tasks such as…

Methodology · Statistics 2020-04-07 Brenda Betancourt , Giacomo Zanella , Rebecca C. Steorts

Recent developments in big data and analytics research have produced an abundance of large data sets that are too big to be analyzed in their entirety, due to limits on computer memory or storage capacity. To address these issues,…

Methodology · Statistics 2016-01-06 Alexey Miroshnikov , Erin M. Conlon

We develop an Evolutionary Markov Chain Monte Carlo (EMCMC) algorithm for sampling spatial partitions that lie within a large and complex spatial state space. Our algorithm combines the advantages of evolutionary algorithms (EAs) as…

Computation · Statistics 2021-01-19 Wendy K. Tam Cho , Yan Y. Liu

Practitioners of Bayesian statistics have long depended on Markov chain Monte Carlo (MCMC) to obtain samples from intractable posterior distributions. Unfortunately, MCMC algorithms are typically serial, and do not scale to the large…

Machine Learning · Statistics 2015-06-11 Maxim Rabinovich , Elaine Angelino , Michael I. Jordan