English
Related papers

Related papers: Effortless, Simulation-Efficient Bayesian Inferenc…

200 papers

Across many domains of science, stochastic models are an essential tool to understand the mechanisms underlying empirically observed data. Models can be of different levels of detail and accuracy, with models of high-fidelity (i.e., high…

Accurate null depth retrieval is critical in nulling interferometry. However, achieving accurate null depth calibration is challenging due to various noise sources, instrumental imperfections, and the complexity of real observational…

Instrumentation and Methods for Astrophysics · Physics 2025-11-14 Baoyi Zeng , Marc-Antoine Martinod , Denis Defrère

Bayesian optimal experimental design (BOED) seeks to maximize the expected information gain (EIG) of experiments. This requires a likelihood estimate, which in many settings is intractable. Simulation-based inference (SBI) provides powerful…

Machine Learning · Computer Science 2026-02-09 Samuel Klein , Willie Neiswanger , Daniel Ratner , Michael Kagan , Sean Gasiorowski

Estimation of causal effects is critical to a range of scientific disciplines. Existing methods for this task either require interventional data, knowledge about the ground truth causal graph, or rely on assumptions such as…

Machine Learning · Computer Science 2025-11-21 Jake Robertson , Arik Reuter , Siyuan Guo , Noah Hollmann , Frank Hutter , Bernhard Schölkopf

Reliable predictive uncertainty estimation plays an important role in enabling the deployment of neural networks to safety-critical settings. A popular approach for estimating the predictive uncertainty of neural networks is to define a…

Machine Learning · Statistics 2023-12-29 Tim G. J. Rudner , Zonghao Chen , Yee Whye Teh , Yarin Gal

We present a novel probabilistic programming framework that couples directly to existing large-scale simulators through a cross-platform probabilistic execution protocol, which allows general-purpose inference engines to record and control…

Bayesian Physics Informed Neural Networks (B-PINNs) have gained significant attention for inferring physical parameters and learning the forward solutions for problems based on partial differential equations. However, the overparameterized…

Machine Learning · Statistics 2023-03-15 Andrew Pensoneault , Xueyu Zhu

In engineering design, navigating complex decision-making landscapes demands a thorough exploration of the design, performance, and constraint spaces, often impeded by resource-intensive simulations. Data-driven methods can mitigate this…

Computational Engineering, Finance, and Science · Computer Science 2024-01-17 Cyril Picard , Faez Ahmed

Bayesian inference is an effective approach for solving statistical learning problems, especially with uncertainty and incompleteness. However, Bayesian inference is a computing-intensive task whose efficiency is physically limited by the…

Emerging Technologies · Computer Science 2019-02-20 Xiaotao Jia , Jianlei Yang , Pengcheng Dai , Runze Liu , Yiran Chen , Weisheng Zhao

We introduce Flat Hilbert Bayesian Inference (FHBI), an algorithm designed to enhance generalization in Bayesian inference. Our approach involves an iterative two-step procedure with an adversarial functional perturbation step and a…

Machine Learning · Computer Science 2025-06-10 Tuan Truong , Quyen Tran , Quan Pham-Ngoc , Nhat Ho , Dinh Phung , Trung Le

While most ML models expect independent and identically distributed data, this assumption is often violated in real-world scenarios due to distribution shifts, resulting in the degradation of machine learning model performance. Until now,…

Machine Learning · Computer Science 2024-11-19 Kai Helli , David Schnurr , Noah Hollmann , Samuel Müller , Frank Hutter

Sensitivity analyses reveal the influence of various modeling choices on the outcomes of statistical analyses. While theoretically appealing, they are overwhelmingly inefficient for complex Bayesian models. In this work, we propose…

We develop a Bayesian inference method for discretely-observed stochastic differential equations (SDEs). Inference is challenging for most SDEs, due to the analytical intractability of the likelihood function. Nevertheless, forward…

Methodology · Statistics 2024-11-08 Petar Jovanovski , Andrew Golightly , Umberto Picchini

While Bayesian inference provides a principled framework for reasoning under uncertainty, its widespread adoption is limited by the intractability of exact posterior computation, necessitating the use of approximate inference. However,…

Machine Learning · Statistics 2026-05-19 George Whittle , Juliusz Ziomek , Jacob Rawling , Maike A. Osborne

Classic Bayesian methods with complex models are frequently infeasible due to an intractable likelihood. Simulation-based inference methods, such as Approximate Bayesian Computing (ABC), calculate posteriors without accessing a likelihood…

Computation · Statistics 2026-01-09 Elliot Maceda , Emily C. Hector , Amanda Lenzi , Brian J. Reich

Simulation-based inference (SBI) provides amortized Bayesian parameter inference from simulator-generated data without requiring explicit likelihood evaluation. Its reliability can degrade under model misspecification, where real-world…

Machine Learning · Computer Science 2026-05-18 Joon Jang , Eunho Jeong , Kyu Sung Choi , Hyeonjin Kim

We revisit empirical Bayes in the absence of a tractable likelihood function, as is typical in scientific domains relying on computer simulations. We investigate how the empirical Bayesian can make use of neural density estimators first to…

Machine Learning · Statistics 2021-03-02 Maxime Vandegar , Michael Kagan , Antoine Wehenkel , Gilles Louppe

We present FlowSN, a statistical framework using simulation-based inference (SBI) with normalising flows to account for selection effects in observational astronomy. Failure to account for selection effects can lead to biased inference on…

A simulation is useful when the phenomenon of interest is either expensive to regenerate or irreproducible with the same context. Recently, Bayesian inference on the distribution of the simulation input parameter has been implemented…

Machine Learning · Computer Science 2022-11-07 Dongjun Kim , Kyungwoo Song , Seungjae Shin , Wanmo Kang , Il-Chul Moon , Weonyoung Joo

The marginal likelihood, or evidence, plays a central role in Bayesian model selection, yet remains notoriously challenging to compute in likelihood-free settings. While Simulation-Based Inference (SBI) techniques such as Sequential Neural…

Computation · Statistics 2025-07-14 Paul Bastide , Arnaud Estoup , Jean-Michel Marin , Julien Stoehr