English
Related papers

Related papers: Generalised linear mixed model analysis via sequen…

200 papers

It is common practice to use Laplace approximations to compute marginal likelihoods in Bayesian versions of generalised linear models (GLM). Marginal likelihoods combined with model priors are then used in different search algorithms to…

Methodology · Statistics 2022-02-01 Jon Lachmann , Geir Storvik , Florian Frommlet , Aliaksadr Hubin

In this article we develop a new sequential Monte Carlo (SMC) method for multilevel (ML) Monte Carlo estimation. In particular, the method can be used to estimate expectations with respect to a target probability distribution over an…

Computation · Statistics 2017-03-16 Alexandros Beskos , Ajay Jasra , Kody Law , Youssef Marzouk , Yan Zhou

This work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-scale Bayesian…

Machine Learning · Statistics 2024-05-21 Sohail Reddy , Hillary Fairbanks

Exponential random graph models are extremely difficult models to handle from a statistical viewpoint, since their normalising constant, which depends on model parameters, is available only in very trivial cases. We show how inference can…

Applications · Statistics 2010-09-30 Alberto Caimo , Nial Friel

Sampling from posterior distributions using Markov chain Monte Carlo (MCMC) methods can require an exhaustive number of iterations, particularly when the posterior is multi-modal as the MCMC sampler can become trapped in a local mode for a…

Methodology · Statistics 2019-10-30 Christopher Nemeth , Fredrik Lindsten , Maurizio Filippone , James Hensman

Spatial generalized linear mixed-effects models are popularly used to analyze spatially indexed univariate responses. However, with modern technology, it is common to observe vector-valued mixed-type responses, e.g., a combination of…

Methodology · Statistics 2026-04-23 Arghya Mukherjee , Arnab Hazra , Dootika Vats

We propose a Monte Carlo sampler from the reverse diffusion process. Unlike the practice of diffusion models, where the intermediary updates -- the score functions -- are learned with a neural network, we transform the score matching…

Machine Learning · Statistics 2024-03-14 Xunpeng Huang , Hanze Dong , Yifan Hao , Yi-An Ma , Tong Zhang

Bayesian models have become very popular over the last years in several fields such as signal processing, statistics, and machine learning. Bayesian inference requires the approximation of complicated integrals involving posterior…

Computation · Statistics 2021-07-20 Luca Martino , Víctor Elvira

We develop a scalable multi-step Monte Carlo algorithm for inference under a large class of nonparametric Bayesian models for clustering and classification. Each step is "embarrassingly parallel" and can be implemented using the same Markov…

Computation · Statistics 2018-06-08 Yang Ni , Peter Müller , Maurice Diesendruck , Sinead Williamson , Yitan Zhu , Yuan Ji

Stochastic gradient Markov chain Monte Carlo (MCMC) algorithms have received much attention in Bayesian computing for big data problems, but they are only applicable to a small class of problems for which the parameter space has a fixed…

Computation · Statistics 2020-02-10 Qifan Song , Yan Sun , Mao Ye , Faming Liang

The FBMS R package facilitates Bayesian model selection and model averaging in complex regression settings by employing a variety of Monte Carlo model exploration methods. At its core, the package implements an efficient Mode Jumping Markov…

Methodology · Statistics 2025-09-03 Florian Frommlet , Jon Lachmann , Geir Storvik , Aliaksandr Hubin

This paper deals with some computational aspects in the Bayesian analysis of statistical models with intractable normalizing constants. In the presence of intractable normalizing constants in the likelihood function, traditional MCMC…

Computation · Statistics 2008-04-22 Yves Atchade , Nicolas Lartillot , Christian P. Robert

Markov chain Monte Carlo (MCMC) methods have not been broadly adopted in Bayesian neural networks (BNNs). This paper initially reviews the main challenges in sampling from the parameter posterior of a neural network via MCMC. Such…

Machine Learning · Statistics 2021-10-05 Theodore Papamarkou , Jacob Hinkle , M. Todd Young , David Womble

In this paper we propose to evaluate and compare Markov chain Monte Carlo (MCMC) methods to estimate the parameters in a generalized extreme value model. We employed the Bayesian approach using traditional Metropolis-Hastings methods,…

Computation · Statistics 2016-11-03 Marcelo Hartmann , Ricardo Ehlers

Many probabilistic models introduce strong dependencies between variables using a latent multivariate Gaussian distribution or a Gaussian process. We present a new Markov chain Monte Carlo algorithm for performing inference in models with…

Computation · Statistics 2010-03-22 Iain Murray , Ryan Prescott Adams , David J. C. MacKay

We present a new method for conducting Monte Carlo inference in graphical models which combines explicit search with generalized importance sampling. The idea is to reduce the variance of importance sampling by searching for significant…

Machine Learning · Computer Science 2013-01-18 Dale Schuurmans , Finnegan Southey

This paper concerns the use of sequential Monte Carlo methods (SMC) for smoothing in general state space models. A well-known problem when applying the standard SMC technique in the smoothing mode is that the resampling mechanism introduces…

Statistics Theory · Mathematics 2008-03-06 Jimmy Olsson , Olivier Cappé , Randal Douc , Eric Moulines

Random sampling of graph partitions under constraints has become a popular tool for evaluating legislative redistricting plans. Analysts detect partisan gerrymandering by comparing a proposed redistricting plan with an ensemble of sampled…

Applications · Statistics 2023-11-09 Cory McCartan , Kosuke Imai

We propose a novel sequential Monte Carlo (SMC) method for sampling from unnormalized target distributions based on a reverse denoising diffusion process. While recent diffusion-based samplers simulate the reverse diffusion using…

Computation · Statistics 2025-11-06 Luhuan Wu , Yi Han , Christian A. Naesseth , John P. Cunningham

Approximate Bayesian computation (ABC) is a class of Bayesian inference algorithms that targets for problems with intractable or {unavailable} likelihood function. It uses synthetic data drawn from the simulation model to approximate the…

Computation · Statistics 2024-12-24 Xuefei Cao , Shijia Wang , Yongdao Zhou