English
Related papers

Related papers: Simulation-based inference with deep ensembles: Ev…

200 papers

Simulation-based inference (SBI) enables amortized Bayesian inference for simulators with implicit likelihoods. But when we are primarily interested in the quality of predictive simulations, or when the model cannot exactly reproduce the…

Machine Learning · Statistics 2023-11-03 Richard Gao , Michael Deistler , Jakob H. Macke

Many scientific models are composed of multiple discrete components, and scientists often make heuristic decisions about which components to include. Bayesian inference provides a mathematical framework for systematically selecting model…

Machine Learning · Computer Science 2024-05-31 Cornelius Schröder , Jakob H. Macke

Simulation-based inference (SBI) provides a powerful framework for inferring posterior distributions of stochastic simulators in a wide range of domains. In many settings, however, the posterior distribution is not the end goal itself --…

Machine Learning · Computer Science 2023-12-19 Mila Gorecki , Jakob H. Macke , Michael Deistler

Standard cosmological analysis, which relies on two-point statistics, fails to extract the full information of the data. This limits our ability to constrain with precision cosmological parameters. Thus, recent years have seen a paradigm…

The Laser Interferometer Space Antenna (LISA) data stream will inevitably contain gaps due to maintenance and environmental disturbances, introducing nonstationarities and spectral leakage that compromise standard frequency-domain…

Instrumentation and Methods for Astrophysics · Physics 2025-12-30 Ruiting Mao , Jeong Eun Lee , Matthew C. Edwards

This study explores the potential of small language model(SLM) ensembles to achieve accuracy comparable to proprietary large language models (LLMs). We propose Ensemble Bayesian Inference (EBI), a novel approach that applies Bayesian…

Computation and Language · Computer Science 2025-12-23 Haru-Tada Sato , Fuka Matsuzaki , Jun-ichiro Takahashi

Simulation-based inference (SBI) enables cosmological parameter estimation when closed-form likelihoods or models are unavailable. However, SBI relies on machine learning for neural compression and density estimation. This requires large…

Cosmology and Nongalactic Astrophysics · Physics 2025-09-29 Alex A. Saoulis , Davide Piras , Niall Jeffrey , Alessio Spurio Mancini , Ana M. G. Ferreira , Benjamin Joachimi

Classic Bayesian methods with complex models are frequently infeasible due to an intractable likelihood. Simulation-based inference methods, such as Approximate Bayesian Computing (ABC), calculate posteriors without accessing a likelihood…

Computation · Statistics 2026-01-09 Elliot Maceda , Emily C. Hector , Amanda Lenzi , Brian J. Reich

The standard approach to inference from cosmic large-scale structure data employs summary statistics that are compared to analytic models in a Gaussian likelihood with pre-computed covariance. To overcome the idealising assumptions about…

Cosmology and Nongalactic Astrophysics · Physics 2023-08-24 Kiyam Lin , Maximilian von Wietersheim-Kramsta , Benjamin Joachimi , Stephen Feeney

Bayesian sequence prediction is a simple technique for predicting future symbols sampled from an unknown measure on infinite sequences over a countable alphabet. While strong bounds on the expected cumulative error are known, there are only…

Machine Learning · Computer Science 2013-07-02 Tor Lattimore , Marcus Hutter , Peter Sunehag

Bayesian statistical inference loses predictive optimality when generative models are misspecified. Working within an existing coherent loss-based generalisation of Bayesian inference, we show existing Modular/Cut-model inference is…

Methodology · Statistics 2026-05-18 Chris U. Carmona , Geoff K. Nicholls

We present Sequential Neural Variational Inference (SNVI), an approach to perform Bayesian inference in models with intractable likelihoods. SNVI combines likelihood-estimation (or likelihood-ratio-estimation) with variational inference to…

Machine Learning · Statistics 2022-10-20 Manuel Glöckler , Michael Deistler , Jakob H. Macke

Bayesian inference is often implemented using approximations, which can yield interval estimates that are too narrow, not fully capturing the uncertainty in the posterior distribution. We address the question of how to adjust these…

Methodology · Statistics 2026-03-23 Tiffany Cai , Philip Greengard , Ben Goodrich , Andrew Gelman

Recent work has attempted to directly approximate the `function-space' or predictive posterior distribution of Bayesian models, without approximating the posterior distribution over the parameters. This is appealing in e.g. Bayesian neural…

Machine Learning · Statistics 2020-11-19 David R. Burt , Sebastian W. Ober , Adrià Garriga-Alonso , Mark van der Wilk

Simulation-based inference (SBI) makes it possible to infer the parameters of a model from high-dimensional low-level features of the observed events. In this work we show how this method can be used to establish the presence of a weak…

High Energy Physics - Phenomenology · Physics 2024-07-31 Kierthika Chathirathas , Torben Ferber , Felix Kahlhoefer , Alessandro Morandini

Simulation-based inference (SBI) is the preferred framework for estimating parameters of intractable models in science and engineering. A significant challenge in this context is the large computational cost of simulating data from complex…

Machine Learning · Statistics 2025-02-18 Ayush Bharti , Daolang Huang , Samuel Kaski , François-Xavier Briol

Semi-implicit variational inference (SIVI) is a powerful framework for approximating complex posterior distributions, but training with the Kullback-Leibler (KL) divergence can be challenging due to high variance and bias in…

Machine Learning · Computer Science 2025-06-06 Tobias Pielok , Bernd Bischl , David Rügamer

Simulation-based inference (SBI) enables parameter estimation for complex stochastic models with intractable likelihoods when model simulation is feasible. Neural posterior estimation (NPE) is a popular SBI approach that often achieves…

Methodology · Statistics 2026-02-23 Ryan P. Kelly , David T. Frazier , David J. Warne , Christopher C. Drovandi

Identifying tire and vehicle parameters is an essential step in designing control and planning algorithms for autonomous vehicles. This paper proposes a new method: Simulation-Based Inference (SBI), a modern interpretation of Approximate…

Robotics · Computer Science 2021-08-30 Ali Boyali , Simon Thompson , David Robert Wong

Predictive Bayesian inference (PBI) represents a model-and prior-agnostic approach to standard Bayesian inference which allows users to quantify uncertainty for a functional of interest only by specifying a forward predictive model for…

Methodology · Statistics 2026-05-04 David T. Frazier , Hui Wang