English
Related papers

Related papers: Detecting Model Misspecification in Amortized Baye…

200 papers

Aided by advances in neural density estimation, considerable progress has been made in recent years towards a suite of simulation-based inference (SBI) methods capable of performing flexible, black-box, approximate Bayesian inference for…

Machine Learning · Statistics 2022-09-07 Patrick Cannon , Daniel Ward , Sebastian M. Schmon

Simulation-based inference (SBI) methods such as approximate Bayesian computation (ABC), synthetic likelihood, and neural posterior estimation (NPE) rely on simulating statistics to infer parameters of intractable likelihood models.…

Machine Learning · Statistics 2023-10-06 Daolang Huang , Ayush Bharti , Amauri Souza , Luigi Acerbi , Samuel Kaski

Neural density estimators have proven remarkably powerful in performing efficient simulation-based Bayesian inference in various research domains. In particular, the BayesFlow framework uses a two-step approach to enable amortized parameter…

Methodology · Statistics 2022-11-10 Marvin Schmitt , Paul-Christian Bürkner , Ullrich Köthe , Stefan T. Radev

Simulation-based Bayesian inference (SBI) methods are widely used for parameter estimation in complex models where evaluating the likelihood is challenging but generating simulations is relatively straightforward. However, these methods…

Amortized Bayesian inference (ABI) offers fast, scalable approximations to posterior densities by training neural surrogates on data simulated from the statistical model. However, ABI methods are highly sensitive to model misspecification:…

Machine Learning · Statistics 2026-01-27 Šimon Kucharský , Aayush Mishra , Daniel Habermann , Stefan T. Radev , Paul-Christian Bürkner

Model misspecification analysis strategies, such as anomaly detection, model validation, and model comparison are a key component of scientific model development. Over the last few years, there has been a rapid rise in the use of…

Instrumentation and Methods for Astrophysics · Physics 2025-03-17 Noemi Anau Montel , James Alvey , Christoph Weniger

Simulation-based inference (SBI) enables parameter estimation for complex stochastic models with intractable likelihoods when model simulation is feasible. Neural posterior estimation (NPE) is a popular SBI approach that often achieves…

Methodology · Statistics 2026-02-23 Ryan P. Kelly , David T. Frazier , David J. Warne , Christopher C. Drovandi

Simulation-Based Inference (SBI) is an approach to statistical inference where simulations from an assumed model are used to construct estimators and confidence sets. SBI is often used when the likelihood is intractable and to construct…

Methodology · Statistics 2025-08-05 Lorenzo Tomaselli , Valérie Ventura , Larry Wasserman

Bayesian inference allows expressing the uncertainty of posterior belief under a probabilistic model given prior information and the likelihood of the evidence. Predominantly, the likelihood function is only implicitly established by a…

Simulation-based inference techniques are indispensable for parameter estimation of mechanistic and simulable models with intractable likelihoods. While traditional statistical approaches like approximate Bayesian computation and Bayesian…

Methodology · Statistics 2024-03-08 Ryan P. Kelly , David J. Nott , David T. Frazier , David J. Warne , Chris Drovandi

We analyze the behavior of approximate Bayesian computation (ABC) when the model generating the simulated data differs from the actual data generating process; i.e., when the data simulator in ABC is misspecified. We demonstrate both…

Statistics Theory · Mathematics 2020-12-17 David T. Frazier , Christian P. Robert , Judith Rousseau

Simulation-Based Inference (SBI) offers a principled and flexible framework for conducting Bayesian inference in any situation where forward simulations are feasible. However, validating the accuracy and reliability of the inferred…

Instrumentation and Methods for Astrophysics · Physics 2026-01-21 James Alvey , Carlo R. Contaldi , Mauro Pieroni

This paper presents recent methodological advances to perform simulation-based inference (SBI) of a general class of Bayesian hierarchical models (BHMs), while checking for model misspecification. Our approach is based on a two-step…

Methodology · Statistics 2022-11-03 Florent Leclercq

We present a procedure to diagnose model misspecification in situations where inference is performed using approximate Bayesian computation. We demonstrate theoretically, and empirically that this procedure can consistently detect the…

Methodology · Statistics 2022-10-25 Andrés Ramírez-Hassan , David T. Frazier

Bayesian simulation-based inference (SBI) methods are used in statistical models where simulation is feasible but the likelihood is intractable. Standard SBI methods can perform poorly in cases of model misspecification, and there has been…

Methodology · Statistics 2025-04-15 Wang Yuyan , Michael Evans , David J. Nott

A central challenge in many areas of science and engineering is to identify model parameters that are consistent with prior knowledge and empirical data. Bayesian inference offers a principled framework for this task, but can be…

Amortized Bayesian inference (ABI) with neural networks can solve probabilistic inverse problems orders of magnitude faster than classical methods. However, ABI is not yet sufficiently robust for widespread and safe application. When…

Machine Learning · Statistics 2026-03-04 Aayush Mishra , Daniel Habermann , Marvin Schmitt , Stefan T. Radev , Paul-Christian Bürkner

Bayesian models quantify uncertainty and facilitate optimal decision-making in downstream applications. For most models, however, practitioners are forced to use approximate inference techniques that lead to sub-optimal decisions due to…

Machine Learning · Statistics 2019-09-12 Tomasz Kuśmierczyk , Joseph Sakaya , Arto Klami

Driven by steady progress in deep generative modeling, simulation-based inference (SBI) has emerged as the workhorse for inferring the parameters of stochastic simulators. However, recent work has demonstrated that model misspecification…

Decisions based partly or solely on predictions from probabilistic models may be sensitive to model misspecification. Statisticians are taught from an early stage that "all models are wrong", but little formal guidance exists on how to…

Methodology · Statistics 2015-03-09 James Watson , Chris Holmes
‹ Prev 1 2 3 10 Next ›