English
Related papers

Related papers: Amortized Simulation-Based Inference in Generalize…

200 papers

Making inferences about physical properties of the Universe requires knowledge of the data likelihood. A Gaussian distribution is commonly assumed for the uncertainties with a covariance matrix estimated from a set of simulations. The noise…

Cosmology and Nongalactic Astrophysics · Physics 2025-07-09 Jed Homer , Oliver Friedrich , Daniel Gruen

Control policies from imitation learning can often fail to generalize to novel environments due to imperfect demonstrations or the inability of imitation learning algorithms to accurately infer the expert's policies. In this paper, we…

Robotics · Computer Science 2020-12-04 Allen Z. Ren , Sushant Veer , Anirudha Majumdar

In this paper, we develop a generalized Bayesian inference framework for a collection of signal-plus-noise matrix models arising in high-dimensional statistics and many applications. The framework is built upon an asymptotically unbiased…

Statistics Theory · Mathematics 2022-04-01 Fangzheng Xie , Dingbo Wu

Simulation-based inference (SBI) is constantly in search of more expressive and efficient algorithms to accurately infer the parameters of complex simulation models. In line with this goal, we present consistency models for posterior…

Machine Learning · Computer Science 2024-11-05 Marvin Schmitt , Valentin Pratz , Ullrich Köthe , Paul-Christian Bürkner , Stefan T Radev

Statistical inference in physics is often based on samples from a generator (sometimes referred to as a ``forward model") that emulate experimental data and depend on parameters of the underlying theory. Modern machine learning has…

High Energy Physics - Phenomenology · Physics 2025-06-03 Chi Lung Cheng , Ranit Das , Runze Li , Radha Mastandrea , Vinicius Mikuni , Benjamin Nachman , David Shih , Gup Singh

With the next generation of both electromagnetic and gravitational wave observatories beginning to come online, rapid analysis methods for kilonova data are becoming increasingly important in astronomy. Traditional Bayesian parameter…

Instrumentation and Methods for Astrophysics · Physics 2026-05-15 Stephanie M. Brown , Mattia Bulla , Hiranya V. Peiris , Nikhil Sarin , Daniel Mortlock , Stephen Thorp , Gurjeet Jagwani , Stephan Rosswog , Samaya Nissanke

In this work we consider Bayesian inference problems with intractable likelihood functions. We present a method to compute an approximate of the posterior with a limited number of model simulations. The method features an inverse Gaussian…

Computation · Statistics 2021-02-23 Hongqiao Wang , Ziqiao Ao , Tengchao Yu , Jinglai Li

Uncertainty Quantification (UQ) is paramount for inference in engineering. A common inference task is to recover full-field information of physical systems from a small number of noisy observations, a usually highly ill-posed problem.…

Machine Learning · Statistics 2026-05-14 Arnaud Vadeboncoeur , Gregory Duthé , Mark Girolami , Eleni Chatzi

The Laser Interferometer Space Antenna (LISA) data stream will inevitably contain gaps due to maintenance and environmental disturbances, introducing nonstationarities and spectral leakage that compromise standard frequency-domain…

Instrumentation and Methods for Astrophysics · Physics 2025-12-30 Ruiting Mao , Jeong Eun Lee , Matthew C. Edwards

Neural posterior estimation (NPE) and neural likelihood estimation (NLE) are machine learning approaches that provide accurate posterior, and likelihood, approximations in complex modeling scenarios, and in situations where conducting…

Machine Learning · Statistics 2024-11-20 David T. Frazier , Ryan Kelly , Christopher Drovandi , David J. Warne

Variational inference (VI) is a method to approximate the computationally intractable posterior distributions that arise in Bayesian statistics. Typically, VI fits a simple parametric distribution to the target posterior by minimizing an…

Machine Learning · Statistics 2023-07-18 Chirag Modi , Charles Margossian , Yuling Yao , Robert Gower , David Blei , Lawrence Saul

Discrete choice models are fundamental tools in management science, economics, and marketing for understanding and predicting decision-making. Logit-based models are dominant in applied work, largely due to their convenient closed-form…

Methodology · Statistics 2026-04-06 Easton Huch , Michael Keane

While Bayesian inference provides a principled framework for reasoning under uncertainty, its widespread adoption is limited by the intractability of exact posterior computation, necessitating the use of approximate inference. However,…

Machine Learning · Statistics 2026-05-19 George Whittle , Juliusz Ziomek , Jacob Rawling , Maike A. Osborne

While Bayesian methods are extremely popular in statistics and machine learning, their application to massive datasets is often challenging, when possible at all. Indeed, the classical MCMC algorithms are prohibitively slow when both the…

Statistics Theory · Mathematics 2019-04-23 Pierre Alquier , James Ridgway

This paper aims at developing a quasi-Bayesian analysis of the nonparametric instrumental variables model, with a focus on the asymptotic properties of quasi-posterior distributions. In this paper, instead of assuming a distributional…

Statistics Theory · Mathematics 2013-11-21 Kengo Kato

Simulation-based inference (SBI) methods such as approximate Bayesian computation (ABC), synthetic likelihood, and neural posterior estimation (NPE) rely on simulating statistics to infer parameters of intractable likelihood models.…

Machine Learning · Statistics 2023-10-06 Daolang Huang , Ayush Bharti , Amauri Souza , Luigi Acerbi , Samuel Kaski

We propose a general framework for obtaining probabilistic solutions to PDE-based inverse problems. Bayesian methods are attractive for uncertainty quantification but assume knowledge of the likelihood model or data generation process. This…

Methodology · Statistics 2023-09-28 Youngsoo Baek , Wilkins Aquino , Sayan Mukherjee

We propose a novel amortized variational inference scheme for an empirical Bayes meta-learning model, where model parameters are treated as latent variables. We learn the prior distribution over model parameters conditioned on limited…

Machine Learning · Computer Science 2020-08-31 Ekaterina Iakovleva , Jakob Verbeek , Karteek Alahari

We present extensive empirical evidence showing that current Bayesian simulation-based inference algorithms can produce computationally unfaithful posterior approximations. Our results show that all benchmarked algorithms -- (Sequential)…

Machine Learning · Statistics 2022-12-06 Joeri Hermans , Arnaud Delaunoy , François Rozet , Antoine Wehenkel , Volodimir Begy , Gilles Louppe

Most estimates for penalised linear regression can be viewed as posterior modes for an appropriate choice of prior distribution. Bayesian shrinkage methods, particularly the horseshoe estimator, have recently attracted a great deal of…

Methodology · Statistics 2017-11-06 Zemei Xu , Daniel F. Schmidt , Enes Makalic , Guoqi Qian , John L. Hopper