English
Related papers

Related papers: Accelerated Parallel Non-conjugate Sampling for Ba…

200 papers

We advocate for a new paradigm of cosmological likelihood-based inference, leveraging recent developments in machine learning and its underlying technology, to accelerate Bayesian inference in high-dimensional settings. Specifically, we…

Cosmology and Nongalactic Astrophysics · Physics 2024-09-06 Davide Piras , Alicja Polanska , Alessio Spurio Mancini , Matthew A. Price , Jason D. McEwen

Inference for doubly intractable distributions is challenging because the intractable normalizing functions of these models include parameters of interest. Previous auxiliary variable MCMC algorithms are infeasible for multi-dimensional…

Computation · Statistics 2020-08-07 Jaewoo Park

Multi-scale problems, where variables of interest evolve in different time-scales and live in different state-spaces, can be found in many fields of science. Here, we introduce a new recursive methodology for Bayesian inference that aims at…

Computation · Statistics 2024-07-08 Sara Pérez-Vieites , Harold Molina-Bulla , Joaquin Miguez

This paper presents a fast algorithm for estimating hidden states of Bayesian state space models. The algorithm is a variation of amortized simulation-based inference algorithms, where a large number of artificial datasets are generated at…

Econometrics · Economics 2022-10-14 Ramis Khabibullin , Sergei Seleznev

Parameter inference is a fundamental problem in data-driven modeling. Given observed data that is believed to be a realization of some parameterized model, the aim is to find parameter values that are able to explain the observed data. In…

Data Structures and Algorithms · Computer Science 2016-04-20 Carlo Albert , Simone Ulzega , Ruedi Stoop

We present a new nonparametric mixture-of-experts model for multivariate regression problems, inspired by the probabilistic k-nearest neighbors algorithm. Using a conditionally specified model, predictions for out-of-sample inputs are based…

Machine Learning · Statistics 2022-08-05 Tianfang Zhang , Rasmus Bokrantz , Jimmy Olsson

Variational inference methods have been shown to lead to significant improvements in the computational efficiency of approximate Bayesian inference in mixed multinomial logit models when compared to standard Markov-chain Monte Carlo (MCMC)…

Computation · Statistics 2020-04-14 Filipe Rodrigues

This work introduces a Bayesian methodology for fitting large discrete graphical models with spike-and-slab priors to encode sparsity. We consider a quasi-likelihood approach that enables node-wise parallel computation resulting in reduced…

Methodology · Statistics 2019-10-21 Anwesha Bhattacharyya , Yves Atchade

Over the past decades, linear mixed models have attracted considerable attention in various fields of applied statistics. They are popular whenever clustered, hierarchical or longitudinal data are investigated. Nonetheless, statistical…

Methodology · Statistics 2021-09-20 Katarzyna Reluga , María José Lombardía , Stefan Andreas Sperlich

We propose a novel approximate inference algorithm that approximates a target distribution by amortising the dynamics of a user-selected MCMC sampler. The idea is to initialise MCMC using samples from an approximation network, apply the…

Machine Learning · Statistics 2017-05-23 Yingzhen Li , Richard E. Turner , Qiang Liu

Approximate Bayesian inference on the basis of summary statistics is well-suited to complex problems for which the likelihood is either mathematically or computationally intractable. However the methods that use rejection suffer from the…

Computation · Statistics 2010-05-04 M. G. B. Blum , O. Francois

The predictive Bayesian view involves eliciting a sequence of one-step-ahead predictive distributions in lieu of specifying a likelihood function and prior distribution. Recent methods have leveraged predictive distributions which are…

Methodology · Statistics 2025-07-25 Yiu Yin Yung , Stephen M. S. Lee , Edwin Fong

This paper introduces a general Bayesian non- parametric latent feature model suitable to per- form automatic exploratory analysis of heterogeneous datasets, where the attributes describing each object can be either discrete, continuous or…

Machine Learning · Statistics 2017-07-27 Isabel Valera , Melanie F. Pradier , Zoubin Ghahramani

We introduce a model-based asynchronous multi-fidelity method for hyperparameter and neural architecture search that combines the strengths of asynchronous Hyperband and Gaussian process-based Bayesian optimization. At the heart of our…

Machine Learning · Computer Science 2020-07-01 Aaron Klein , Louis C. Tiao , Thibaut Lienart , Cedric Archambeau , Matthias Seeger

We develop methods for efficient amortized approximate Bayesian inference over posterior distributions of probabilistic clustering models, such as Dirichlet process mixture models. The approach is based on mapping distributed,…

Machine Learning · Statistics 2018-11-27 Ari Pakman , Liam Paninski

A generic algorithm for the extraction of probabilistic (Bayesian) information about model parameters from data is presented. The algorithm propagates an ensemble of particles in the product space of model parameters and outputs. Each…

Computation · Statistics 2015-09-18 Carlo Albert

Sampling from the full posterior distribution of high-dimensional non-linear, non-Gaussian latent dynamical models presents significant computational challenges. While Particle Gibbs (also known as conditional sequential Monte Carlo) is…

Computation · Statistics 2025-03-05 Adrien Corenflos , Simo Särkkä

We propose an efficient way to sample from a class of structured multivariate Gaussian distributions which routinely arise as conditional posteriors of model parameters that are assigned a conditionally Gaussian prior. The proposed…

Computation · Statistics 2016-06-28 Anirban Bhattacharya , Antik Chakraborty , Bani K. Mallick

The article develops a hybrid Variational Bayes algorithm that combines the mean-field and fixed-form Variational Bayes methods. The new estimation algorithm can be used to approximate any posterior without relying on conjugate priors. We…

Methodology · Statistics 2013-08-09 David J Nott , Minh-Ngoc Tran , Anthony Y. C. Kuk , Robert Kohn

Hierarchical models are versatile tools for joint modeling of data sets arising from different, but related, sources. Fully Bayesian inference may, however, become computationally prohibitive if the source-specific data models are complex,…

Computation · Statistics 2016-05-06 Ritabrata Dutta , Paul Blomstedt , Samuel Kaski