English
Related papers

Related papers: Differentiable Likelihoods for Fast Inversion of '…

200 papers

Modeling complex systems, like neural networks, simple liquids or flocks of birds, often works in reverse to textbook approaches: given data for which averages and correlations are known, we try to find the parameters of a given model…

Statistical Mechanics · Physics 2023-04-25 Tobias Kühn , Frédéric van Wijland

Modeling physical phenomena like heat transport and diffusion is crucially dependent on the numerical solution of partial differential equations (PDEs). A PDE solver finds the solution given coefficients and a boundary condition, whereas an…

Graphics · Computer Science 2022-08-04 Ekrem Fatih Yılmazer , Delio Vicini , Wenzel Jakob

Bayesian inference for high-dimensional inverse problems is computationally costly and requires selecting a suitable prior distribution. Amortized variational inference addresses these challenges via a neural network that approximates the…

Machine Learning · Statistics 2023-01-19 Ali Siahkoohi , Gabrio Rizzuti , Rafael Orozco , Felix J. Herrmann

Diffusion models have made remarkable progress in solving various inverse problems, attributing to the generative modeling capability of the data manifold. Posterior sampling from the conditional score function enable the precious data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jinghao Zhang , Zizheng Yang , Qi Zhu , Feng Zhao

Bayesian inference without the likelihood evaluation, or likelihood-free inference, has been a key research topic in simulation studies for gaining quantitatively validated simulation models on real-world datasets. As the likelihood…

Methodology · Statistics 2022-11-07 Dongjun Kim , Kyungwoo Song , YoonYeong Kim , Yongjin Shin , Wanmo Kang , Il-Chul Moon , Weonyoung Joo

We investigate the use of the Metropolis-Hastings algorithm to sample posterior distribution in a Bayesian inverse problem, where the likelihood function is random. Concretely, we consider the case where one has full field observations of a…

Numerical Analysis · Mathematics 2026-02-20 Emil Løvbak , Sebastian Krumscheid

Conditional density estimation (CDE) models can be useful for many statistical applications, especially because the full conditional density is estimated instead of traditional regression point estimates, revealing more information about…

Methodology · Statistics 2021-07-12 Alex Akira Okuno , Felipe Maia Polo

Parameter identification and comparison of dynamical systems is a challenging task in many fields. Bayesian approaches based on Gaussian process regression over time-series data have been successfully applied to infer the parameters of a…

Machine Learning · Statistics 2019-03-04 Philippe Wenk , Alkis Gotovos , Stefan Bauer , Nico Gorbach , Andreas Krause , Joachim M. Buhmann

Optimal control under uncertainty is a prevailing challenge for many reasons. One of the critical difficulties lies in producing tractable solutions for the underlying stochastic optimization problem. We show how advanced approximate…

Machine Learning · Computer Science 2024-10-28 Joe Watson , Hany Abdulsamad , Rolf Findeisen , Jan Peters

In the bayesian analysis of Inverse Problems most relevant cases the forward maps (FM, or regressor function) are defined in terms of a system of (O, P)DE's with intractable solutions. These necessarily involve a numerical method to find…

Computation · Statistics 2017-08-31 J. Andrés Christen , Marcos A. Capistrán , Miguel Ángel Moreles

We propose a novel approach for solving inverse-problems with high-dimensional inputs and an expensive forward mapping. It leverages joint deep generative modelling to transfer the original problem spaces to a lower dimensional latent…

Methodology · Statistics 2021-04-19 Eliane Maalouf , David Ginsbourger , Niklas Linde

Profile likelihood provides a general framework to infer on a scalar parameter of a statistical model. A confidence interval is obtained by numerically finding the two abscissas where the profile log-likelihood curve intersects an…

Computation · Statistics 2024-04-04 Yves Deville

Stochastic inverse problems considered in this article consist of estimating the probability distributions of intrinsically random inputs of computer models. These estimations are based on observable outputs affected by model noise, and…

Statistics Theory · Mathematics 2025-03-17 Nicolas Bousquet , Mélanie Blazère , Thomas Cerbelaud

We propose a dimension reduction technique for Bayesian inverse problems with nonlinear forward operators, non-Gaussian priors, and non-Gaussian observation noise. The likelihood function is approximated by a ridge function, i.e., a map…

Probability · Mathematics 2022-01-31 Olivier Zahm , Tiangang Cui , Kody Law , Alessio Spantini , Youssef Marzouk

Performing inference over simulators is generally intractable as their runtime means we cannot compute a marginal likelihood. We develop a likelihood-free inference method to infer parameters for a cardiac simulator, which replicates…

Machine Learning · Statistics 2017-12-12 Adam McCarthy , Blanca Rodriguez , Ana Minchole

Bayesian likelihood-free methods implement Bayesian inference using simulation of data from the model to substitute for intractable likelihood evaluations. Most likelihood-free inference methods replace the full data set with a summary…

Methodology · Statistics 2020-10-16 Yinan Mao , Xueou Wang , David J. Nott , Michael Evans

We reconsider a nonparametric density model based on Gaussian processes. By augmenting the model with latent P\'olya--Gamma random variables and a latent marked Poisson process we obtain a new likelihood which is conjugate to the model's…

Machine Learning · Statistics 2018-05-30 Christian Donner , Manfred Opper

Recent developments in generative modeling have utilized score-based methods coupled with stochastic differential equations to sample from complex probability distributions. However, these and other performant sampling methods generally…

Machine Learning · Computer Science 2025-06-03 Bryan Riel , Tobias Bischoff

Drawing from the theory of stochastic differential equations, we introduce a novel sampling method for known distributions and a new algorithm for diffusion generative models with unknown distributions. Our approach is inspired by the…

Statistics Theory · Mathematics 2024-07-12 Xicheng Zhang

Complex simulator-based models are now routinely used to perform inference across the sciences and engineering, but existing inference methods are often unable to account for outliers and other extreme values in data which occur due to…

Machine Learning · Statistics 2026-02-18 Ayush Bharti , Charita Dellaporta , Yuga Hikida , François-Xavier Briol