English
Related papers

Related papers: Estimating Marginal Likelihoods in Likelihood-Free…

200 papers

Bayesian statistics is concerned with conducting posterior inference for the unknown quantities in a given statistical model. Conventional Bayesian inference requires the specification of a probabilistic model for the observed data, and the…

Methodology · Statistics 2023-05-11 David T. Frazier , Christopher Drovandi , David J. Nott

Bayesian inference provides a flexible way of combining data with prior information. However, quantile regression is not equipped with a parametric likelihood, and therefore, Bayesian inference for quantile regression demands careful…

Statistics Theory · Mathematics 2012-07-24 Yunwen Yang , Xuming He

We propose a framework for computing, optimizing and integrating with respect to a smooth marginal likelihood in statistical models that involve high-dimensional parameters/latent variables and continuous low-dimensional hyperparameters.…

Methodology · Statistics 2026-02-10 Omiros Papaspiliopoulos , Timothée Stumpf-Fétizon , Jonathan Weare

In Bayesian statistics, the marginal likelihood, also known as the evidence, is used to evaluate model fit as it quantifies the joint probability of the data under the prior. In contrast, non-Bayesian models are typically compared using…

Methodology · Statistics 2019-09-24 Edwin Fong , Chris Holmes

Computing the marginal likelihood or evidence is one of the core challenges in Bayesian analysis. While there are many established methods for estimating this quantity, they predominantly rely on using a large number of posterior samples…

Computation · Statistics 2021-02-26 Eric Chuu , Debdeep Pati , Anirban Bhattacharya

A central challenge in many areas of science and engineering is to identify model parameters that are consistent with prior knowledge and empirical data. Bayesian inference offers a principled framework for this task, but can be…

The empirical Bayes $g$-modeling approach via the nonparametric maximum likelihood estimator (NPMLE) is widely used for large-scale estimation and inference in the normal means problem, yet theoretical guarantees for uncertainty…

Statistics Theory · Mathematics 2026-03-31 Taehyun Kim , Bodhisattva Sen

Bayesian inference allows expressing the uncertainty of posterior belief under a probabilistic model given prior information and the likelihood of the evidence. Predominantly, the likelihood function is only implicitly established by a…

It has been argued that in supervised classification tasks, in practice it may be more sensible to perform model selection with respect to some more focused model selection score, like the supervised (conditional) marginal likelihood, than…

Machine Learning · Computer Science 2013-01-14 Petri Kontkanen , Petri Myllymaki , Henry Tirri

Simulation-based inference provides a powerful framework for Bayesian inference when the likelihood is analytically intractable or computationally prohibitive. By leveraging machine-learning techniques and neural density estimators, it…

General Relativity and Quantum Cosmology · Physics 2026-01-21 Mattia Emma , Gregory Ashton

How do we compare between hypotheses that are entirely consistent with observations? The marginal likelihood (aka Bayesian evidence), which represents the probability of generating our observations from a prior, provides a distinctive…

Machine Learning · Computer Science 2023-05-03 Sanae Lotfi , Pavel Izmailov , Gregory Benton , Micah Goldblum , Andrew Gordon Wilson

Statistical models are often defined by a generative process for simulating synthetic data, but this can lead to intractable likelihoods. Likelihood free inference (LFI) methods enable Bayesian inference to be performed in this case.…

Methodology · Statistics 2025-06-05 David Chen , Xinwei Li , Eui-Jin Kim , Prateek Bansal , David Nott

Survey data often arises from complex sampling designs, such as stratified or multistage sampling, with unequal inclusion probabilities. When sampling is informative, traditional inference methods yield biased estimators and poor coverage.…

Methodology · Statistics 2025-04-17 Snigdha Das , Dipankar Bandyopadhyay , Debdeep Pati

Simulation-based inference (SBI) offers a flexible and general approach to performing Bayesian inference: In SBI, a neural network is trained on synthetic data simulated from a model and used to rapidly infer posterior distributions for…

Machine Learning · Computer Science 2025-10-28 Julius Vetter , Manuel Gloeckler , Daniel Gedon , Jakob H. Macke

Parametric statistical models that are implicitly defined in terms of a stochastic data generating process are used in a wide range of scientific disciplines because they enable accurate modeling. However, learning the parameters from…

Machine Learning · Statistics 2018-10-24 Traiko Dinev , Michael U. Gutmann

Simulation-based inference (SBI) with neural posterior estimation (NPE) provides rapid X-ray spectral fitting in both Gaussian and Poisson regimes by learning approximate parameter posteriors from simulations. We investigate auto-encoders…

Instrumentation and Methods for Astrophysics · Physics 2026-04-22 Didier Barret , Simon Dupourqué

The inferential models (IM) framework provides prior-free, frequency-calibrated, posterior probabilistic inference. The key is the use of random sets to predict unobservable auxiliary variables connected to the observable data and unknown…

Statistics Theory · Mathematics 2016-01-26 Ryan Martin , Chuanhai Liu

In recent years, there has been a remarkable development of simulation-based inference (SBI) algorithms, and they have now been applied across a wide range of astrophysical and cosmological analyses. There are a number of key advantages to…

Instrumentation and Methods for Astrophysics · Physics 2025-03-18 Noemi Anau Montel , James Alvey , Christoph Weniger

In certain privacy-sensitive scenarios within fields such as clinical trial simulations, federated learning, and distributed learning, researchers often face the challenge of estimating correlations between variables without access to…

Methodology · Statistics 2025-08-05 Longwen Shang , Min Tsao , Xuekui Zhang

This article presents a Bayesian inferential method where the likelihood for a model is unknown but where data can easily be simulated from the model. We discretize simulated (continuous) data to estimate the implicit likelihood in a…