English
Related papers

Related papers: Efficient identification of informative features i…

200 papers

When a statistical model $\{P_{\theta} : \theta \in \Theta\}$ lacks analytically tractable likelihoods, parametric statistical inference based on data generated from an unknown underlying distribution $P$ can still be performed as long as…

Methodology · Statistics 2026-05-19 Peter Matthew Jacobs , Lekha Patel , Anirban Bhattacharya , Debdeep Pati

In Generalised Bayesian Inference (GBI), the learning rate and hyperparameters of the loss must be estimated. These inference-hyperparameters can't be estimated jointly with the other parameters, from the data, by giving them a prior.…

Methodology · Statistics 2026-05-18 Jeong Eun Lee , Sitong Liu , Geoff K. Nicholls

The standard approach to inference from cosmic large-scale structure data employs summary statistics that are compared to analytic models in a Gaussian likelihood with pre-computed covariance. To overcome the idealising assumptions about…

Cosmology and Nongalactic Astrophysics · Physics 2023-08-24 Kiyam Lin , Maximilian von Wietersheim-Kramsta , Benjamin Joachimi , Stephen Feeney

Aided by advances in neural density estimation, considerable progress has been made in recent years towards a suite of simulation-based inference (SBI) methods capable of performing flexible, black-box, approximate Bayesian inference for…

Machine Learning · Statistics 2022-09-07 Patrick Cannon , Daniel Ward , Sebastian M. Schmon

Inferring the parameters of a stochastic model based on experimental observations is central to the scientific method. A particularly challenging setting is when the model is strongly indeterminate, i.e. when distinct sets of parameters…

Machine Learning · Statistics 2021-11-10 Pedro L. C. Rodrigues , Thomas Moreau , Gilles Louppe , Alexandre Gramfort

Black-box simulators are widely used in robotics, but optimizing their parameters remains challenging due to inaccessible likelihoods. Simulation-Based Inference (SBI) tackles this issue using simulation-driven approaches, estimating the…

Robotics · Computer Science 2025-10-20 Gahee Kim , Takamitsu Matsubara

Simulation-based inference techniques are indispensable for parameter estimation of mechanistic and simulable models with intractable likelihoods. While traditional statistical approaches like approximate Bayesian computation and Bayesian…

Methodology · Statistics 2024-03-08 Ryan P. Kelly , David J. Nott , David T. Frazier , David J. Warne , Chris Drovandi

Amortized Bayesian inference (ABI) offers fast, scalable approximations to posterior densities by training neural surrogates on data simulated from the statistical model. However, ABI methods are highly sensitive to model misspecification:…

Machine Learning · Statistics 2026-01-27 Šimon Kucharský , Aayush Mishra , Daniel Habermann , Stefan T. Radev , Paul-Christian Bürkner

The large number of strong lenses discoverable in future astronomical surveys will likely enhance the value of strong gravitational lensing as a cosmic probe of dark energy and dark matter. However, leveraging the increased statistical…

Instrumentation and Methods for Astrophysics · Physics 2025-06-03 Jason Poh , Ashwin Samudre , Aleksandra Ćiprijanović , Joshua Frieman , Gourav Khullar , Brian D. Nord

State-of-the-art neural network-based methods for learning summary statistics have delivered promising results for simulation-based likelihood-free parameter inference. Existing approaches require density estimation as a post-processing…

In Bayesian inference prior hyperparameters are chosen subjectively or estimated using empirical Bayes methods. Generalised Bayesian Inference (GBI) also has a learning rate hyperparameter. This is compounded in Semi-Modular Inference…

We develop the framework of Linear Simulation-based Inference (LSBI), an application of simulation-based inference where the likelihood is approximated by a Gaussian linear function of its parameters. We obtain analytical expressions for…

Instrumentation and Methods for Astrophysics · Physics 2025-01-08 Nicolas Mediato-Diaz , Will Handley

Simulation-based inference (SBI) is a method to perform inference on a variety of complex scientific models with challenging inference (inverse) problems. Bayesian Optimal Experimental Design (BOED) aims to efficiently use experimental…

Machine Learning · Statistics 2025-02-13 Vincent D. Zaballa , Elliot E. Hui

Sequential neural posterior estimation (SNPE) techniques have been recently proposed for dealing with simulation-based models with intractable likelihoods. Unlike approximate Bayesian computation, SNPE techniques learn the posterior from…

Machine Learning · Statistics 2025-01-17 Yifei Xiong , Xiliang Yang , Sanguo Zhang , Zhijian He

Simulation-based inference (SBI) is an established approach for performing Bayesian inference on scientific simulators. SBI so far works best on low-dimensional parametric models. However, it is difficult to infer function-valued…

Machine Learning · Computer Science 2025-11-17 Guy Moss , Leah Sophie Muhle , Reinhard Drews , Jakob H. Macke , Cornelius Schröder

The logistic specification has been used extensively in non-Bayesian statistics to model the dependence of discrete outcomes on the values of specified covariates. Because the likelihood function is globally weakly concave estimation by…

Computation · Statistics 2013-04-17 John Geweke , Garland Durham , Huaxin Xu

We propose a posterior for Bayesian Likelihood-Free Inference (LFI) based on generalized Bayesian inference. To define the posterior, we use Scoring Rules (SRs), which evaluate probabilistic models given an observation. In LFI, we can…

Methodology · Statistics 2024-09-24 Lorenzo Pacchiardi , Sherman Khoo , Ritabrata Dutta

Most of the fundamental, emergent, and phenomenological parameters of particle and nuclear physics are determined through parametric template fits. Simulations are used to populate histograms which are then matched to data. This approach is…

High Energy Physics - Phenomenology · Physics 2025-03-12 Benjamin Sluijter , Sascha Diefenbacher , Wahid Bhimji , Benjamin Nachman

Bayesian inference and the use of posterior or posterior predictive probabilities for decision making have become increasingly popular in clinical trials. The current practice in Bayesian clinical trials relies on a hybrid…

Methodology · Statistics 2024-04-30 Shirin Golchi , James Willard

Bayesian posterior distributions naturally represent parameter uncertainty informed by data. However, when the parameter space is complex, as in many nonparametric settings where it is infinite-dimensional or combinatorially large, standard…

Methodology · Statistics 2025-12-22 Nicola Bariletto , Nhat Ho , Alessandro Rinaldo