English
Related papers

Related papers: Approximate blocked Gibbs sampling for Bayesian ne…

200 papers

The message passing-based graph neural networks (GNNs) have achieved great success in many real-world applications. However, training GNNs on large-scale graphs suffers from the well-known neighbor explosion problem, i.e., the exponentially…

Machine Learning · Computer Science 2025-03-18 Zhihao Shi , Xize Liang , Jie Wang

We introduce a Markov Chain Monte Carlo (MCMC) method that is designed to sample from target distributions with irregular geometry using an adaptive scheme. In cases where targets exhibit non-Gaussian behaviour, we propose that adaption…

Computation · Statistics 2023-10-06 Ameer Dharamshi , Vivian Ngo , Jeffrey S. Rosenthal

Bayesian inference for doubly-intractable pairwise exponential graphical models typically involves variations of the exchange algorithm or approximate Markov chain Monte Carlo (MCMC) samplers. However, existing methods for both classes of…

Computation · Statistics 2026-03-30 Yujie Chen , Antik Chakraborty , Anindya Bhadra

We propose a general framework using spike-and-slab prior distributions to aid with the development of high-dimensional Bayesian inference. Our framework allows inference with a general quasi-likelihood function. We show that highly…

Statistics Theory · Mathematics 2019-08-21 Yves Atchade , Anwesha Bhattacharyya

A popular approach to semi-supervised learning proceeds by endowing the input data with a graph structure in order to extract geometric information and incorporate it into a Bayesian framework. We introduce new theory that gives appropriate…

Machine Learning · Statistics 2020-01-14 Nicolas Garcia Trillos , Zachary Kaplan , Thabo Samakhoana , Daniel Sanz-Alonso

In the following article we consider approximate Bayesian parameter inference for observation driven time series models. Such statistical models appear in a wide variety of applications, including econometrics and applied mathematics. This…

Computation · Statistics 2013-04-01 Ajay Jasra , Nikolas Kantas , Elena Ehrlich

Bayesian shrinkage methods have generated a lot of recent interest as tools for high-dimensional regression and model selection. These methods naturally facilitate tractable uncertainty quantification and incorporation of prior information.…

Computation · Statistics 2017-04-17 Bala Rajaratnam , Doug Sparks , Kshitij Khare , Liyuan Zhang

Acyclic digraphs are the underlying representation of Bayesian networks, a widely used class of probabilistic graphical models. Learning the underlying graph from data is a way of gaining insights about the structural properties of a…

Machine Learning · Statistics 2022-05-06 Jack Kuipers , Giusi Moffa

The likelihood-free sequential Approximate Bayesian Computation (ABC) algorithms, are increasingly popular inference tools for complex biological models. Such algorithms proceed by constructing a succession of probability distributions over…

Computation · Statistics 2012-10-12 Daniel Silk , Saran Filippi , Michael P. H. Stumpf

MinMax sampling is a technique for downsampling a real-valued vector which minimizes the maximum variance over all vector components. This approach is useful for reducing the amount of data that must be sent over a constrained network link…

Machine Learning · Computer Science 2024-04-30 Joel Wolfrath , Abhishek Chandra

Markov Chain Monte Carlo (MCMC) algorithms are routinely used to draw samples from distributions with intractable normalization constants. However, standard MCMC algorithms do not apply to doubly-intractable distributions in which there are…

Computation · Statistics 2012-07-02 Iain Murray , Zoubin Ghahramani , David MacKay

We present new MCMC algorithms for computing the posterior distributions and expectations of the unknown variables in undirected graphical models with regular structure. For demonstration purposes, we focus on Markov Random Fields (MRFs).…

Computation · Statistics 2012-07-19 Firas Hamze , Nando de Freitas

This work presents an efficient approach for accelerating multilevel Markov Chain Monte Carlo (MCMC) sampling for large-scale problems using low-fidelity machine learning models. While conventional techniques for large-scale Bayesian…

Machine Learning · Statistics 2024-05-21 Sohail Reddy , Hillary Fairbanks

We develop a framework for approximating collapsed Gibbs sampling in generative latent variable cluster models. Collapsed Gibbs is a popular MCMC method, which integrates out variables in the posterior to improve mixing. Unfortunately for…

Machine Learning · Statistics 2018-07-23 Christopher Aicher , Emily B. Fox

In Bayesian inverse problems, one aims at characterizing the posterior distribution of a set of unknowns, given indirect measurements. For non-linear/non-Gaussian problems, analytic solutions are seldom available: Sequential Monte Carlo…

Methodology · Statistics 2022-12-26 Alessandro Viani , Adam M Johansen , Alberto Sorrentino

Bayesian methods hold significant promise for improving the uncertainty quantification ability and robustness of deep neural network models. Recent research has seen the investigation of a number of approximate Bayesian inference methods…

Machine Learning · Computer Science 2022-02-09 Meet P. Vadera , Adam D. Cobb , Brian Jalaian , Benjamin M. Marlin

We consider Markov chain Monte Carlo (MCMC) algorithms for Bayesian high-dimensional regression with continuous shrinkage priors. A common challenge with these algorithms is the choice of the number of iterations to perform. This is…

Methodology · Statistics 2021-07-13 Niloy Biswas , Anirban Bhattacharya , Pierre E. Jacob , James E. Johndrow

Bayesian inference of Gibbs random fields (GRFs) is often referred to as a doubly intractable problem, since the likelihood function is intractable. The exploration of the posterior distribution of such models is typically carried out with…

Computation · Statistics 2017-10-16 Aidan Boland , Nial Friel , Florian Maire

Slice sampling is a well-established Markov chain Monte Carlo method for (approximate) sampling of target distributions which are only known up to a normalizing constant. The method is based on choosing a new state on a slice, i.e., a…

Computation · Statistics 2025-12-22 Kevin Bitterlich , Daniel Rudolf , Björn Sprungk

Missing values in covariates due to censoring by signal interference or lack of sensitivity in the measuring devices are common in industrial problems. We propose a full Bayesian solution to the prediction problem with an efficient Markov…

Methodology · Statistics 2022-01-21 Caroline Svahn , Mattias Villani