English
Related papers

Related papers: Simulation-efficient marginal posterior estimation…

200 papers

Simulation-based inference has been popular for amortized Bayesian computation. It is typical to have more than one posterior approximation, from different inference algorithms, different architectures, or simply the randomness of…

Methodology · Statistics 2024-03-04 Yuling Yao , Bruno Régaldo-Saint Blancard , Justin Domke

We study parameter inference in simulation-based stochastic models where the analytical form of the likelihood is unknown. The main difficulty is that score evaluation as a ratio of noisy Monte Carlo estimators induces bias and instability,…

Machine Learning · Statistics 2025-10-31 Zehao Li , Zhouchen Lin , Yijie Peng

In recent years, there has been a remarkable development of simulation-based inference (SBI) algorithms, and they have now been applied across a wide range of astrophysical and cosmological analyses. There are a number of key advantages to…

Instrumentation and Methods for Astrophysics · Physics 2025-03-18 Noemi Anau Montel , James Alvey , Christoph Weniger

The growing availability of large and complex datasets has increased interest in temporal stochastic processes that can capture stylized facts such as marginal skewness, non-Gaussian tails, long memory, and even non-Markovian dynamics.…

Machine Learning · Statistics 2025-10-09 Dan Leonte , Raphaël Huser , Almut E. D. Veraart

This paper considers properties of an optimization based sampler for targeting the posterior distribution when the likelihood is intractable and auxiliary statistics are used to summarize information in the data. Our reverse sampler…

Methodology · Statistics 2015-12-02 Jean-Jacques Forneron , Serena Ng

Stochastic simulation algorithms such as likelihood weighting often give fast, accurate approximations to posterior probabilities in probabilistic networks, and are the methods of choice for very large networks. Unfortunately, the special…

Artificial Intelligence · Computer Science 2016-11-26 Keiji Kanazawa , Daphne Koller , Stuart Russell

We consider the problem of parametric statistical inference when likelihood computations are prohibitively expensive but sampling from the model is possible. Several so-called likelihood-free methods have been developed to perform inference…

Machine Learning · Statistics 2020-09-14 Owen Thomas , Ritabrata Dutta , Jukka Corander , Samuel Kaski , Michael U. Gutmann

Simulation-based Bayesian inference (SBI) can be used to estimate the parameters of complex mechanistic models given observed model outputs without requiring access to explicit likelihood evaluations. A prime example for the application of…

Machine Learning · Computer Science 2022-11-28 Jonas Beck , Michael Deistler , Yves Bernaerts , Jakob Macke , Philipp Berens

We present a novel probabilistic programming framework that couples directly to existing large-scale simulators through a cross-platform probabilistic execution protocol, which allows general-purpose inference engines to record and control…

Studying the impact of systematic effects, optimizing survey strategies, assessing tensions between different probes and exploring synergies of different data sets require a large number of simulated likelihood analyses, each of which cost…

Cosmology and Nongalactic Astrophysics · Physics 2022-12-07 Supranta S. Boruah , Tim Eifler , Vivian Miranda , Sai Krishanth P. M

Comparison of appropriate models to describe observational data is a fundamental task of science. The Bayesian model evidence, or marginal likelihood, is a computationally challenging, yet crucial, quantity to estimate to perform Bayesian…

Cosmology and Nongalactic Astrophysics · Physics 2023-11-10 A. Spurio Mancini , M. M. Docherty , M. A. Price , J. D. McEwen

Simulation based inference (SBI) methods enable the estimation of posterior distributions when the likelihood function is intractable, but where model simulation is feasible. Popular neural approaches to SBI are the neural posterior…

Machine Learning · Statistics 2024-04-23 Xiaoyu Wang , Ryan P. Kelly , David J. Warne , Christopher Drovandi

The marginal likelihood, or evidence, plays a central role in Bayesian model selection, yet remains notoriously challenging to compute in likelihood-free settings. While Simulation-Based Inference (SBI) techniques such as Sequential Neural…

Computation · Statistics 2025-07-14 Paul Bastide , Arnaud Estoup , Jean-Michel Marin , Julien Stoehr

The Whittle likelihood is a widely used and computationally efficient pseudo-likelihood. However, it is known to produce biased parameter estimates for large classes of models. We propose a method for de-biasing Whittle estimates for…

Likelihood-free inference methods based on neural conditional density estimation were shown to drastically reduce the simulation burden in comparison to classical methods such as ABC. When applied in the context of any latent variable…

Machine Learning · Statistics 2024-05-06 Sanmitra Ghosh , Paul J. Birrell , Daniela De Angelis

We present Sequential Neural Variational Inference (SNVI), an approach to perform Bayesian inference in models with intractable likelihoods. SNVI combines likelihood-estimation (or likelihood-ratio-estimation) with variational inference to…

Machine Learning · Statistics 2022-10-20 Manuel Glöckler , Michael Deistler , Jakob H. Macke

Several rapid parameter estimation methods have recently been advanced to deal with the computational challenges of the problem of Bayesian inference of the properties of compact binary sources detected in the upcoming science runs of the…

General Relativity and Quantum Cosmology · Physics 2023-12-05 Lalit Pathak , Amit Reza , Anand S. Sengupta

Many machine learning techniques sacrifice convenient computational structures to gain estimation robustness and modeling flexibility. However, by exploring the modeling structures, we find these "sacrifices" do not always require more…

Machine Learning · Computer Science 2019-04-16 Xingguo Li , Haoming Jiang , Jarvis Haupt , Raman Arora , Han Liu , Mingyi Hong , Tuo Zhao

We investigate the efficiency of a marginal likelihood estimator where the product of the marginal posterior distributions is used as an importance-sampling function. The approach is generally applicable to multi-block parameter vector…

Computation · Statistics 2014-07-08 K. Perrakis , I. Ntzoufras , E. G. Tsionas

Bayesian inference methods such as Markov Chain Monte Carlo (MCMC) typically require repeated computations of the likelihood function, but in some scenarios this is infeasible and alternative methods are needed. Simulation-based inference…

Machine Learning · Computer Science 2025-12-10 Linnea M Wolniewicz , Peter Sadowski , Claudio Corti