English
Related papers

Related papers: Gradient-Based Markov Chain Monte Carlo for Bayesi…

200 papers

Posterior sampling by Monte Carlo methods provides a more comprehensive solution approach to inverse problems than computing point estimates such as the maximum posterior using optimization methods, at the expense of usually requiring many…

Numerical Analysis · Mathematics 2024-11-28 Paolo Villani , Daniel Andrés-Arcones , Jörg F. Unger , Martin Weiser

Gaussian latent variable models are a key class of Bayesian hierarchical models with applications in many fields. Performing Bayesian inference on such models can be challenging as Markov chain Monte Carlo algorithms struggle with the…

Computation · Statistics 2020-11-09 Charles C. Margossian , Aki Vehtari , Daniel Simpson , Raj Agrawal

Bayesian models have become very popular over the last years in several fields such as signal processing, statistics, and machine learning. Bayesian inference requires the approximation of complicated integrals involving posterior…

Computation · Statistics 2021-07-20 Luca Martino , Víctor Elvira

In this work we consider time series with a finite number of discrete point changes. We assume that the data in each segment follows a different probability density functions (pdf). We focus on the case where the data in all segments are…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Ali Mohammad-Djafari , Olivier Feron

Despite exceptional predictive performance of Deep sequence models (DSMs), the main concern of their deployment centers around the lack of uncertainty awareness. In contrast, probabilistic models quantify the uncertainty associated with…

Machine Learning · Computer Science 2026-03-03 Wenlong Chen

This paper presents a new Markov chain Monte Carlo method to sample from the posterior distribution of conjugate mixture models. This algorithm relies on a flexible split-merge procedure built using the particle Gibbs sampler. Contrary to…

Computation · Statistics 2017-05-30 Alexandre Bouchard-Côté , Arnaud Doucet , Andrew Roth

We propose a Bayesian inference approach for a class of latent Markov models. These models are widely used for the analysis of longitudinal categorical data, when the interest is in studying the evolution of an individual unobservable…

Methodology · Statistics 2011-01-05 Francesco Bartolucci , Silvia Pandolfi

The use of Cauchy Markov random field priors in statistical inverse problems can potentially lead to posterior distributions which are non-Gaussian, high-dimensional, multimodal and heavy-tailed. In order to use such priors successfully,…

Computation · Statistics 2022-02-15 Neil K. Chada , Lassi Roininen , Jarkko Suuronen

The rise of artificial intelligence (AI) hinges on the efficient training of modern deep neural networks (DNNs) for non-convex optimization and uncertainty quantification, which boils down to a non-convex Bayesian learning problem. A…

Computation · Statistics 2023-06-01 Wei Deng

We analyse the performance of a recursive Monte Carlo method for the Bayesian estimation of the static parameters of a discrete--time state--space Markov model. The algorithm employs two layers of particle filters to approximate the…

Computation · Statistics 2016-03-31 Dan Crisan , Joaquin Miguez

We present a new approach to Bayesian inference that entirely avoids Markov chain simulation, by constructing a map that pushes forward the prior measure to the posterior measure. Existence and uniqueness of a suitable measure-preserving…

Computation · Statistics 2012-08-31 Tarek A. El Moselhy , Youssef M. Marzouk

This paper introduces methodology for performing Bayesian inference sequentially on a sequence of posteriors on spaces of different dimensions. We show how this may be achieved through the use of sequential Monte Carlo (SMC) samplers (Del…

Computation · Statistics 2020-06-02 Richard G Everitt , Richard Culliford , Felipe Medina-Aguayo , Daniel J Wilson

This paper proposes Bayesian mosaic, a parallelizable composite posterior, for scalable Bayesian inference on a broad class of multivariate discrete data models. Sampling is embarrassingly parallel since Bayesian mosaic is a multiplication…

Methodology · Statistics 2018-04-03 Ye Wang , David Dunson

The advances in variational inference are providing promising paths in Bayesian estimation problems. These advances make variational phylogenetic inference an alternative approach to Markov Chain Monte Carlo methods for approximating the…

Populations and Evolution · Quantitative Biology 2023-09-12 Amine M. Remita , Golrokh Vitae , Abdoulaye Baniré Diallo

We present an unbiased method for Bayesian posterior means based on kinetic Langevin dynamics that combines advanced splitting methods with enhanced gradient approximations. Our approach avoids Metropolis correction by coupling Markov…

Computation · Statistics 2025-12-04 Neil K. Chada , Benedict Leimkuhler , Daniel Paulin , Peter A. Whalley

Researchers increasingly wish to estimate time-varying parameter (TVP) regressions which involve a large number of explanatory variables. Including prior information to mitigate over-parameterization concerns has led to many using Bayesian…

Econometrics · Economics 2020-02-25 Florian Huber , Gary Koop , Michael Pfarrhofer

Markov chain Monte Carlo (MCMC) is widely used for Bayesian inference in models of complex systems. Performance, however, is often unsatisfactory in models with many latent variables due to so-called poor mixing, necessitating development…

Methodology · Statistics 2019-10-25 C. M. Pooley , S. C. Bishop , A. Doeschl-Wilson , G. Marion

For Bayesian learning, given likelihood function and Gaussian prior, the elliptical slice sampler, introduced by Murray, Adams and MacKay 2010, provides a tool for the construction of a Markov chain for approximate sampling of the…

Machine Learning · Statistics 2021-07-27 Viacheslav Natarovskii , Daniel Rudolf , Björn Sprungk

Piecewise Deterministic Markov Processes (PDMPs) are studied in a general framework. First, different constructions are proven to be equivalent. Second, we introduce a coupling between two PDMPs following the same differential flow which…

Probability · Mathematics 2021-08-03 Alain Durmus , Arnaud Guillin , Pierre Monmarché

We consider the optimal approximate posterior over the top-layer weights in a Bayesian neural network for regression, and show that it exhibits strong dependencies on the lower-layer weights. We adapt this result to develop a correlated…

Machine Learning · Statistics 2021-06-23 Sebastian W. Ober , Laurence Aitchison