English
Related papers

Related papers: Simulation-based stacking

200 papers

Bayesian methods have proved powerful in many applications for the inference of model parameters from data. These methods are based on Bayes' theorem, which itself is deceptively simple. However, in practice the computations required are…

Methodology · Statistics 2020-07-10 Michael A. Chappell , Mark W. Woolrich

Estimation and inference in dynamic discrete choice models often relies on approximation to lower the computational burden of dynamic programming. Unfortunately, the use of approximation can impart substantial bias in estimation and results…

Econometrics · Economics 2020-10-23 Ben Deaner

Approximate Bayesian computation (ABC) is commonly used for parameter estimation and model comparison for intractable simulator-based models whose likelihood function cannot be evaluated. In this paper we instead investigate the feasibility…

Methodology · Statistics 2022-09-13 Marko Järvenpää , Jukka Corander

Model-based approaches bear great promise for decision making of agents interacting with the physical world. In the context of spatial environments, different types of problems such as localisation, mapping, navigation or autonomous…

Machine Learning · Statistics 2019-06-21 Atanas Mirchev , Baris Kayalibay , Maximilian Soelch , Patrick van der Smagt , Justin Bayer

Conservative inference is a major concern in simulation-based inference. It has been shown that commonly used algorithms can produce overconfident posterior approximations. Balancing has empirically proven to be an effective way to mitigate…

Machine Learning · Statistics 2023-04-24 Arnaud Delaunoy , Benjamin Kurt Miller , Patrick Forré , Christoph Weniger , Gilles Louppe

Likelihood-free Bayesian inference algorithms are popular methods for calibrating the parameters of complex, stochastic models, required when the likelihood of the observed data is intractable. These algorithms characteristically rely…

Computation · Statistics 2021-12-23 Thomas P Prescott , David J Warne , Ruth E Baker

The posterior in probabilistic programs with stochastic support decomposes as a weighted sum of the local posterior distributions associated with each possible program path. We show that making predictions with this full posterior…

Machine Learning · Computer Science 2024-04-15 Tim Reichelt , Luke Ong , Tom Rainforth

We recently proposed a general algorithm for approximating nonstandard Bayesian posterior distributions by minimization of their Kullback-Leibler divergence with respect to a more convenient approximating distribution. In this note we offer…

Computation · Statistics 2014-01-10 Tim Salimans

Verifying the correctness of Bayesian computation is challenging. This is especially true for complex models that are common in practice, as these require sophisticated model implementations and algorithms. In this paper we introduce…

Methodology · Statistics 2020-10-22 Sean Talts , Michael Betancourt , Daniel Simpson , Aki Vehtari , Andrew Gelman

We marry ideas from deep neural networks and approximate Bayesian inference to derive a generalised class of deep, directed generative models, endowed with a new algorithm for scalable inference and learning. Our algorithm introduces a…

Machine Learning · Statistics 2014-06-02 Danilo Jimenez Rezende , Shakir Mohamed , Daan Wierstra

Model uncertainty is pervasive in real world analysis situations and is an often-neglected issue in applied statistics. However, standard approaches to the research process do not address the inherent uncertainty in model building and,…

Methodology · Statistics 2024-03-01 Mariana Nold , Florian Meinfelder , David Kaplan

Bayesian neural network posterior distributions have a great number of modes that correspond to the same network function. The abundance of such modes can make it difficult for approximate inference methods to do their job. Recent work has…

Machine Learning · Statistics 2024-07-03 Tommy Rochussen

Estimation of parameters that obey specific constraints is crucial in statistics and machine learning; for example, when parameters are required to satisfy boundedness, monotonicity, or linear inequalities. Traditional approaches impose…

Methodology · Statistics 2026-04-03 Lachlan Astfalck , Deborshee Sen , Sayan Patra , Edward Cripps , David Dunson

Sample-based Bayesian inference provides a route to uncertainty quantification in the geosciences, and inverse problems in general, though is very computationally demanding in the naive form that requires simulating an accurate computer…

Computation · Statistics 2019-04-12 Tiangang Cui , Colin Fox , Michael J O'Sullivan

Approximate inference in probability models is a fundamental task in machine learning. Approximate inference provides powerful tools to Bayesian reasoning, decision making, and Bayesian deep learning. The main goal is to estimate the…

Machine Learning · Computer Science 2020-03-10 Jun Han

Bayesian calibration of black-box computer models offers an established framework to obtain a posterior distribution over model parameters. Traditional Bayesian calibration involves the emulation of the computer model and an additive model…

Machine Learning · Statistics 2018-10-30 Sébastien Marmin , Maurizio Filippone

This paper examines Bayesian belief network inference using simulation as a method for computing the posterior probabilities of network variables. Specifically, it examines the use of a method described by Henrion, called logic sampling,…

Artificial Intelligence · Computer Science 2013-04-11 Homer L. Chin , Gregory F. Cooper

Bayesian inference is a powerful tool for parameter estimation and uncertainty quantification in dynamical systems. However, for nonlinear oscillator networks such as Kuramoto models, widely used to study synchronization phenomena in…

Applications · Statistics 2026-03-24 Emma Hannula , Jana de Wiljes , Matthew T. Moores , Heikki Haario , Lassi Roininen

Simulation plays a central role in scientific discovery. In many applications, the bottleneck is no longer running a simulator; it is choosing among large families of plausible simulators, each corresponding to different forward…

Simulation-based inference (SBI) enables Bayesian analysis when the likelihood is intractable but model simulations are available. Recent advances in statistics and machine learning, including Approximate Bayesian Computation and deep…

Methodology · Statistics 2025-09-15 Haoyu Jiang , Yuexi Wang , Yun Yang