English
Related papers

Related papers: Geometric nested sampling: sampling from distribut…

200 papers

Markov Chain Monte Carlo (MCMC) methods, such as the Metropolis-Hastings (MH) algorithm, are widely used for Bayesian inference. One of the most important issues for any MCMC method is the convergence of the Markov chain, which depends…

Computation · Statistics 2015-11-20 Luca Martino , Jesse Read , David Luengo

MCMC algorithms such as Metropolis-Hastings algorithms are slowed down by the computation of complex target distributions as exemplified by huge datasets. We offer in this paper a useful generalisation of the Delayed Acceptance approach,…

Computation · Statistics 2015-03-06 Marco Banterle , Clara Grazian , Anthony Lee , Christian P. Robert

The ability to generate samples of the random effects from their conditional distributions is fundamental for inference in mixed effects models. Random walk Metropolis is widely used to perform such sampling, but this method is known to…

Methodology · Statistics 2019-10-29 Belhal Karimi , Marc Lavielle , Eric Moulines

We consider the problem of sampling from posterior distributions for Bayesian models where some parameters are restricted to be orthogonal matrices. Such matrices are sometimes used in neural networks models for reasons of regularization…

Machine Learning · Statistics 2019-01-24 Viktor Yanush , Dmitry Kropotov

Markov chain sampling methods that automatically adapt to characteristics of the distribution being sampled can be constructed by exploiting the principle that one can sample from a distribution by sampling uniformly from the region under…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Radford M. Neal

We introduce Markov chain Monte Carlo (MCMC) algorithms based on numerical approximations of piecewise-deterministic Markov processes obtained with the framework of splitting schemes. We present unadjusted as well as adjusted algorithms,…

Probability · Mathematics 2025-11-04 Andrea Bertazzi , Paul Dobson , Pierre Monmarché

The distributions of toroidal data, often viewed as an extension of circular distributions, do not consider the intrinsic geometry of a curved torus. For the first time, Diaconis et al. (2013)[Diaconis, P., Holmes, S., & Shahshahani, M.…

Methodology · Statistics 2023-04-05 Buddhananda Banerjee , Surojit Biswas

This study considers using Metropolis-Hastings algorithm for stochastic simulation of chemical reactions. The proposed method uses SSA (Stochastic Simulation Algorithm) distribution which is a standard method for solving well-stirred…

Numerical Analysis · Computer Science 2014-10-31 Azam S. Zavar Moosavi , Paul Tranquilli , Adrian Sandu

Markov Chain Monte Carlo (MCMC) algorithms are commonly used for their versatility in sampling from complicated probability distributions. However, as the dimension of the distribution gets larger, the computational costs for a satisfactory…

Cosmology and Nongalactic Astrophysics · Physics 2020-12-01 Hector J. Hortua , Riccardo Volpi , Dimitri Marinelli , Luigi Malago

We propose to view non-rigid surface registration as a probabilistic inference problem. Given a target surface, we estimate the posterior distribution of surface registrations. We demonstrate how the posterior distribution can be used to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Dennis Madsen , Andreas Morel-Forster , Patrick Kahr , Dana Rahbani , Thomas Vetter , Marcel Lüthi

The recently introduced nested sampling algorithm allows the direct and efficient calculation of the partition function of atomistic systems. We demonstrate its applicability to condensed phase systems with periodic boundary conditions by…

Statistical Mechanics · Physics 2014-01-09 Lívia B. Pártay , Albert P. Bartók , Gábor Csányi

We consider distributed optimization problems where forming the Hessian is computationally challenging and communication is a significant bottleneck. We develop unbiased parameter averaging methods for randomized second order optimization…

Machine Learning · Statistics 2020-02-18 Burak Bartan , Mert Pilanci

We review Skilling's nested sampling (NS) algorithm for Bayesian inference and more broadly multi-dimensional integration. After recapitulating the principles of NS, we survey developments in implementing efficient NS algorithms in practice…

We introduce new Gaussian proposals to improve the efficiency of the standard Hastings-Metropolis algorithm in Markov chain Monte Carlo (MCMC) methods, used for the sampling from a target distribution in large dimension $d$. The improved…

Numerical Analysis · Mathematics 2016-11-28 Alain Durmus , Gareth O. Roberts , Gilles Vilmart , Konstantinos C. Zygalakis

Piecewise-Deterministic Markov Processes (PDMPs) hold significant promise for sampling from complex probability distributions. However, their practical implementation is hindered by the need to compute model-specific bounds. Conversely,…

Computation · Statistics 2025-03-17 Augustin Chevallier , Sam Power , Matthew Sutton

Probabilistic modeling provides the capability to represent and manipulate uncertainty in data, models, predictions and decisions. We are concerned with the problem of learning probabilistic models of dynamical systems from measured data.…

Computation · Statistics 2018-03-14 Thomas B. Schön , Andreas Svensson , Lawrence Murray , Fredrik Lindsten

In this chapter, we identify fundamental geometric structures that underlie the problems of sampling, optimisation, inference and adaptive decision-making. Based on this identification, we derive algorithms that exploit these geometric…

Given a target distribution $\mu \propto e^{-\mathcal{H}}$ to sample from with Hamiltonian $\mathcal{H}$, in this paper we propose and analyze new Metropolis-Hastings sampling algorithms that target an alternative distribution…

Probability · Mathematics 2021-11-30 Michael C. H. Choi , Jing Zhang

Markov Chain Monte Carlo (MCMC) methods have a drawback when working with a target distribution or likelihood function that is computationally expensive to evaluate, specially when working with big data. This paper focuses on…

Machine Learning · Computer Science 2019-10-22 Asif J. Chowdhury , Gabriel Terejanu

Inferring time-varying networks is important to understand the development and evolution of interactions over time. However, the vast majority of currently used models assume direct measurements of node states, which are often difficult to…

Applications · Statistics 2014-05-06 Xin Wang , Ke Yuan , Christoph Hellmayr , Wei Liu , Florian Markowetz