English
Related papers

Related papers: Fast Simulation-Based Bayesian Estimation of Heter…

200 papers

Latent Gaussian models have a rich history in statistics and machine learning, with applications ranging from factor analysis to compressed sensing to time series analysis. The classical method for maximizing the likelihood of these models…

Machine Learning · Computer Science 2023-06-07 Alexander Lin , Bahareh Tolooshams , Yves Atchadé , Demba Ba

Multi-sensor state space models underpin fusion applications in networks of sensors. Estimation of latent parameters in these models has the potential to provide highly desirable capabilities such as network self-calibration. Conventional…

Systems and Control · Computer Science 2018-01-04 Murat Uney , Bernard Mulgrew , Daniel E Clark

Inference of latent feature models in the Bayesian nonparametric setting is generally difficult, especially in high dimensional settings, because it usually requires proposing features from some prior distribution. In special cases, where…

Machine Learning · Statistics 2022-06-14 Michael Minyi Zhang , Sinead A. Williamson , Fernando Perez-Cruz

Bayesian models are a powerful tool for studying complex data, allowing the analyst to encode rich hierarchical dependencies and leverage prior information. Most importantly, they facilitate a complete characterization of uncertainty…

Machine Learning · Statistics 2023-04-25 Steven Winter , Trevor Campbell , Lizhen Lin , Sanvesh Srivastava , David B. Dunson

Metropolis-Hastings estimates intractable expectations - can differentiating the algorithm estimate their gradients? The challenge is that Metropolis-Hastings trajectories are not conventionally differentiable due to the discrete…

Statistics Theory · Mathematics 2024-06-21 Gaurav Arya , Moritz Schauer , Ruben Seyer

We propose to use deep learning to estimate parameters in statistical models when standard likelihood estimation methods are computationally infeasible. We show how to estimate parameters from max-stable processes, where inference is…

Methodology · Statistics 2021-08-02 Amanda Lenzi , Julie Bessac , Johann Rudi , Michael L. Stein

In statistical practice, a realistic Bayesian model for a given data set can be defined by a likelihood function that is analytically or computationally intractable, due to large data sample size, high parameter dimensionality, or complex…

Methodology · Statistics 2019-03-19 George Karabatsos , Fabrizio Leisen

Bayesian inference allows machine learning models to express uncertainty. Current machine learning models use only a single learnable parameter combination when making predictions, and as a result are highly overconfident when their…

Machine Learning · Computer Science 2022-02-23 Andrew Wood , Moshik Hershcovitch , Daniel Waddington , Sarel Cohen , Peter Chin

Stochastic reaction network models are often used to explain and predict the dynamics of gene regulation in single cells. These models usually involve several parameters, such as the kinetic rates of chemical reactions, that are not…

Computation · Statistics 2020-01-07 Thomas A. Catanach , Huy D. Vo , Brian Munsky

This paper proposes novel noise-free Bayesian optimization strategies that rely on a random exploration step to enhance the accuracy of Gaussian process surrogate models. The new algorithms retain the ease of implementation of the classical…

Machine Learning · Computer Science 2024-07-18 Hwanwoo Kim , Daniel Sanz-Alonso

The marginal likelihood, or Bayesian evidence, is a crucial quantity for Bayesian model comparison but its computation can be challenging for complex models, even in parameters space of moderate dimension. The learned harmonic mean…

Methodology · Statistics 2026-01-27 Alicja Polanska , Jason D. McEwen

Many statistical models can be simulated forwards but have intractable likelihoods. Approximate Bayesian Computation (ABC) methods are used to infer properties of these models from data. Traditionally these methods approximate the posterior…

Machine Learning · Statistics 2018-04-03 George Papamakarios , Iain Murray

Inverse medium scattering solvers generally reconstruct a single solution without an associated measure of uncertainty. This is true both for the classical iterative solvers and for the emerging deep learning methods. But ill-posedness and…

Machine Learning · Computer Science 2022-12-12 AmirEhsan Khorashadizadeh , Ali Aghababaei , Tin Vlašić , Hieu Nguyen , Ivan Dokmanić

Driven by the critical needs of biomanufacturing 4.0, we introduce a probabilistic knowledge graph hybrid model characterizing the risk- and science-based understanding of bioprocess mechanisms. It can faithfully capture the important…

Machine Learning · Statistics 2022-10-03 Wei Xie , Keqi Wang , Hua Zheng , Ben Feng

Bayesian network classifiers (BNCs) possess a number of properties desirable for a modern classifier: They are easily interpretable, highly scalable, and offer adaptable complexity. However, traditional methods for learning BNCs have…

Machine Learning · Computer Science 2025-05-30 Connor Cooper , Geoffrey I. Webb , Daniel F. Schmidt

Gaussian time-series models are often specified through their spectral density. Such models present several computational challenges, in particular because of the non-sparse nature of the covariance matrix. We derive a fast approximation of…

Computation · Statistics 2012-11-20 Nicolas Chopin , Judith Rousseau , Brunero Liseo

We recently proposed a general algorithm for approximating nonstandard Bayesian posterior distributions by minimization of their Kullback-Leibler divergence with respect to a more convenient approximating distribution. In this note we offer…

Computation · Statistics 2014-01-10 Tim Salimans

Gaussian processes allow for flexible specification of prior assumptions of unknown dynamics in state space models. We present a procedure for efficient Bayesian learning in Gaussian process state space models, where the representation is…

Computation · Statistics 2016-04-18 Andreas Svensson , Arno Solin , Simo Särkkä , Thomas B. Schön

We present Sequential Neural Variational Inference (SNVI), an approach to perform Bayesian inference in models with intractable likelihoods. SNVI combines likelihood-estimation (or likelihood-ratio-estimation) with variational inference to…

Machine Learning · Statistics 2022-10-20 Manuel Glöckler , Michael Deistler , Jakob H. Macke

Our paper deals with inferring simulator-based statistical models given some observed data. A simulator-based model is a parametrized mechanism which specifies how data are generated. It is thus also referred to as generative model. We…

Machine Learning · Statistics 2016-01-01 Michael U. Gutmann , Jukka Corander