English
Related papers

Related papers: Differentiable Likelihoods for Fast Inversion of '…

200 papers

There is resurging interest, in statistics and machine learning, in solvers for ordinary differential equations (ODEs) that return probability measures instead of point estimates. Recently, Conrad et al. introduced a sampling-based class of…

Numerical Analysis · Computer Science 2018-11-06 Hans Kersting , Philipp Hennig

Bayesian inference in complex generative models is often obstructed by the absence of tractable likelihoods and the infeasibility of computing gradients of high-dimensional simulators. Existing likelihood-free methods for generalized…

Applications · Statistics 2026-01-05 Diksha Bhandari , Sebastian Reich

In this paper, we study efficient approximate sampling for probability distributions known up to normalization constants. We specifically focus on a problem class arising in Bayesian inference for large-scale inverse problems in science and…

Machine Learning · Computer Science 2024-10-14 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

Inverse problems are ubiquitous because they formalize the integration of data with mathematical models. In many scientific applications the forward model is expensive to evaluate, and adjoint computations are difficult to employ; in this…

Dynamical Systems · Mathematics 2021-11-05 G. A. Pavliotis , A. M. Stuart , U. Vaes

Our paper deals with inferring simulator-based statistical models given some observed data. A simulator-based model is a parametrized mechanism which specifies how data are generated. It is thus also referred to as generative model. We…

Machine Learning · Statistics 2016-01-01 Michael U. Gutmann , Jukka Corander

In recent years we have witnessed a growth in mathematics for deep learning, which has been used to solve inverse problems of partial differential equations (PDEs). However, most deep learning-based inversion methods either require paired…

Numerical Analysis · Mathematics 2024-04-23 Enze Jiang , Jishen Peng , Zheng Ma , Xiong-Bin Yan

Bayesian inverse problems use data to update a prior probability distribution on uncertain parameter values to a posterior distribution. Such problems arise in many structural engineering applications, but computational solution of Bayesian…

Numerical Analysis · Mathematics 2026-05-26 Jakob Scheffels , Elizabeth Qian , Iason Papaioannou , Elisabeth Ullmann

In this paper, we propose a progressive Bayesian procedure, where the measurement information is continuously included into the given prior estimate (although we perform observations at discrete time steps). The key idea is to derive a…

Systems and Control · Computer Science 2012-04-03 Uwe D. Hanebeck , Jannik Steinbring

Most ordinary differential equation (ODE) models used to describe biological or physical systems must be solved approximately using numerical methods. Perniciously, even those solvers which seem sufficiently accurate for the forward…

Statistical models can involve implicitly defined quantities, such as solutions to nonlinear ordinary differential equations (ODEs), that unavoidably need to be numerically approximated in order to evaluate the model. The approximation…

Computation · Statistics 2024-09-16 Juho Timonen , Nikolas Siccha , Ben Bales , Harri Lähdesmäki , Aki Vehtari

This paper develops meshless methods for probabilistically describing discretisation error in the numerical solution of partial differential equations. This construction enables the solution of Bayesian inverse problems while accounting for…

Methodology · Statistics 2017-12-20 Jon Cockayne , Chris Oates , Tim Sullivan , Mark Girolami

Generative models based on flow matching have attracted significant attention for their simplicity and superior performance in high-resolution image synthesis. By leveraging the instantaneous change-of-variables formula, one can directly…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Yasi Zhang , Peiyu Yu , Yaxuan Zhu , Yingshan Chang , Feng Gao , Ying Nian Wu , Oscar Leong

Often, when solving forward, inverse or data assimilation problems, only a part of the solution is needed. As a model, we consider the stationary diffusion problem. We demonstrate an algorithm that can compute only a part or a functional of…

Numerical Analysis · Mathematics 2020-08-06 Alexander Litvinenko

Some statistical models are specified via a data generating process for which the likelihood function cannot be computed in closed form. Standard likelihood-based inference is then not feasible but the model parameters can be inferred by…

Computation · Statistics 2015-02-20 Michael U. Gutmann , Jukka Corander , Ritabrata Dutta , Samuel Kaski

Identifying a low-dimensional informed parameter subspace offers a viable path to alleviating the dimensionality challenge in the sampled-based solution to large-scale Bayesian inverse problems. This paper introduces a novel gradient-based…

Computation · Statistics 2023-03-07 Tiangang Cui , Olivier Zahm

Zero-shot diffusion posterior sampling offers a flexible framework for inverse problems by accommodating arbitrary degradation operators at test time, but incurs high computational cost due to repeated likelihood-guided updates. In…

Machine Learning · Statistics 2026-02-10 Léon Zheng , Thomas Hirtz , Yazid Janati , Eric Moulines

Likelihood-free methods, such as approximate Bayesian computation, are powerful tools for practical inference problems with intractable likelihood functions. Markov chain Monte Carlo and sequential Monte Carlo variants of approximate…

Computation · Statistics 2019-02-26 David J. Warne , Ruth E. Baker , Matthew J. Simpson

Likelihood-free inference provides a rigorous approach to preform Bayesian analysis using forward simulations only. The main advantage of likelihood-free methods is its ability to account for complex physical processes and observational…

Cosmology and Nongalactic Astrophysics · Physics 2022-02-09 Sut-Ieng Tam , Keiichi Umetsu , Adam Amara

This paper is concerned with the approximation of probability distributions known up to normalization constants, with a focus on Bayesian inference for large-scale inverse problems in scientific computing. In this context, key challenges…

Machine Learning · Computer Science 2025-06-10 Baojun Che , Yifan Chen , Zhenghao Huan , Daniel Zhengyu Huang , Weijie Wang

Parameter estimation and associated uncertainty quantification is an important problem in dynamical systems characterized by ordinary differential equation (ODE) models that are often nonlinear. Typically, such models have analytically…

Computation · Statistics 2024-03-26 Wai Meng Kwok , Sarat Chandra Dass , George Streftaris