English
Related papers

Related papers: Multilevel neural simulation-based inference

200 papers

This paper presents recent methodological advances to perform simulation-based inference (SBI) of a general class of Bayesian hierarchical models (BHMs), while checking for model misspecification. Our approach is based on a two-step…

Methodology · Statistics 2022-11-03 Florent Leclercq

Bayesian inference represents a principled way to incorporate Earth structure uncertainty in full-waveform moment tensor inversions, but traditional approaches generally require significant approximations that risk biasing the resulting…

Geophysics · Physics 2026-03-20 A. A. Saoulis , T. -S. Pham , A. M. G. Ferreira

Simulation based inference (SBI) methods enable the estimation of posterior distributions when the likelihood function is intractable, but where model simulation is feasible. Popular neural approaches to SBI are the neural posterior…

Machine Learning · Statistics 2024-04-23 Xiaoyu Wang , Ryan P. Kelly , David J. Warne , Christopher Drovandi

Simulation-based inference (SBI) is an established approach for performing Bayesian inference on scientific simulators. SBI so far works best on low-dimensional parametric models. However, it is difficult to infer function-valued…

Machine Learning · Computer Science 2025-11-17 Guy Moss , Leah Sophie Muhle , Reinhard Drews , Jakob H. Macke , Cornelius Schröder

We introduce two synthetic likelihood methods for Simulation-Based Inference (SBI), to conduct either amortized or targeted inference from experimental observations when a high-fidelity simulator is available. Both methods learn a…

Machine Learning · Computer Science 2023-04-19 Pierre Glaser , Michael Arbel , Samo Hromadka , Arnaud Doucet , Arthur Gretton

Simulation-based Inference (SBI) is a widely used set of algorithms to learn the parameters of complex scientific simulation models. While primarily run on CPUs in HPC clusters, these algorithms have been shown to scale in performance when…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-30 Sourabh Kulkarni , Csaba Andras Moritz

Simulation-based inference (SBI) methods tackle complex scientific models with challenging inverse problems. However, SBI models often face a significant hurdle due to their non-differentiable nature, which hampers the use of gradient-based…

Machine Learning · Computer Science 2023-06-29 Vincent D. Zaballa , Elliot E. Hui

A major challenge in sample-based inference (SBI) for Bayesian neural networks is the size and structure of the networks' parameter space. Our work shows that successful SBI is possible by embracing the characteristic relationship between…

Machine Learning · Computer Science 2024-05-29 Emanuel Sommer , Lisa Wimmer , Theodore Papamarkou , Ludwig Bothmann , Bernd Bischl , David Rügamer

Simulation-based inference methods have been shown to be inaccurate in the data-poor regime, when training simulations are limited or expensive. Under these circumstances, the inference network is particularly prone to overfitting, and…

In recent years, there has been a remarkable development of simulation-based inference (SBI) algorithms, and they have now been applied across a wide range of astrophysical and cosmological analyses. There are a number of key advantages to…

Instrumentation and Methods for Astrophysics · Physics 2025-03-18 Noemi Anau Montel , James Alvey , Christoph Weniger

Some of the issues that make sampling parameter spaces of various beyond the Standard Model (BSM) scenarios computationally expensive are the high dimensionality of the input parameter space, complex likelihoods, and stringent experimental…

High Energy Physics - Phenomenology · Physics 2026-02-16 Atrideb Chatterjee , Arghya Choudhury , Sourav Mitra , Arpita Mondal , Subhadeep Mondal

The simulation cost for cosmological simulation-based inference can be decreased by combining simulation sets of varying fidelity. We propose an approach to such multi-fidelity inference based on feature matching and knowledge distillation.…

Cosmology and Nongalactic Astrophysics · Physics 2025-07-02 Leander Thiele , Adrian E. Bayer , Naoya Takeishi

The stochastic variational inference (SVI) paradigm, which combines variational inference, natural gradients, and stochastic updates, was recently proposed for large-scale data analysis in conjugate Bayesian models and demonstrated to be…

Machine Learning · Statistics 2018-02-05 Rishit Sheth , Roni Khardon

Comparison of appropriate models to describe observational data is a fundamental task of science. The Bayesian model evidence, or marginal likelihood, is a computationally challenging, yet crucial, quantity to estimate to perform Bayesian…

Cosmology and Nongalactic Astrophysics · Physics 2023-11-10 A. Spurio Mancini , M. M. Docherty , M. A. Price , J. D. McEwen

Across many domains of science, stochastic models are an essential tool to understand the mechanisms underlying empirically observed data. Models can be of different levels of detail and accuracy, with models of high-fidelity (i.e., high…

Bayesian regression remains a simple but effective tool based on Bayesian inference techniques. For large-scale applications, with complicated posterior distributions, Markov Chain Monte Carlo methods are applied. To improve the well-known…

Computation · Statistics 2020-09-28 Joris Tavernier , Jaak Simm , Adam Arany , Karl Meerbergen , Yves Moreau

Bayesian parameter inference for complex stochastic simulators is challenging due to intractable likelihood functions. Existing simulation-based inference methods often require large number of simulations and become costly to use in…

Machine Learning · Computer Science 2026-04-06 Vasilis Gkolemis , Christos Diou , Michael U. Gutmann

Model parameter inference is a universal problem across science. This challenge is particularly pronounced in developmental biology, where faithful mechanistic descriptions require spatial-stochastic models with numerous parameters, yet…

Biological Physics · Physics 2024-07-16 Michael A. Ramirez-Sierra , Thomas R. Sokolowski

Simulation-based inference (SBI) enables amortized Bayesian inference by first training a neural posterior estimator (NPE) on prior-simulator pairs, typically through low-dimensional summary statistics, which can then be cheaply reused for…

Machine Learning · Statistics 2026-02-11 Sherman Khoo , Dennis Prangle , Song Liu , Mark Beaumont

For complex simulation problems, inferring parameters often precludes the use of classical likelihood-based techniques due to intractable likelihoods. Simulation-based inference (SBI) methods offer a likelihood-free approach to directly…

Machine Learning · Computer Science 2026-04-16 Haley Rosso , Talea Mayo