English
Related papers

Related papers: Differentiable Likelihoods for Fast Inversion of '…

200 papers

This paper presents an intrinsic approach for addressing control problems with systems governed by linear ordinary differential equations (ODEs). We use computer algebra to constrain a Gaussian Process on solutions of ODEs. We obtain…

Optimization and Control · Mathematics 2025-04-18 Andreas Besginow , Markus Lange-Hegermann , Jörn Tebbe

Many statistical models can be simulated forwards but have intractable likelihoods. Approximate Bayesian Computation (ABC) methods are used to infer properties of these models from data. Traditionally these methods approximate the posterior…

Machine Learning · Statistics 2018-04-03 George Papamakarios , Iain Murray

A recently-introduced class of probabilistic (uncertainty-aware) solvers for ordinary differential equations (ODEs) applies Gaussian (Kalman) filtering to initial value problems. These methods model the true solution $x$ and its first $q$…

Numerical Analysis · Mathematics 2020-07-20 Hans Kersting , T. J. Sullivan , Philipp Hennig

Likelihood-free inference involves inferring parameter values given observed data and a simulator model. The simulator is computer code which takes parameters, performs stochastic calculations, and outputs simulated data. In this work, we…

Computation · Statistics 2023-01-30 Dennis Prangle , Cecilia Viscardi

Many cosmological models have only a finite number of parameters of interest, but a very expensive data-generating process and an intractable likelihood function. We address the problem of performing likelihood-free Bayesian inference from…

Cosmology and Nongalactic Astrophysics · Physics 2018-09-14 Florent Leclercq

Beyond their impressive sampling capabilities, score-based diffusion models offer a powerful analysis tool in the form of unbiased density estimation of a query sample under the training data distribution. In this work, we investigate the…

Machine Learning · Computer Science 2023-10-12 Marius Arvinte , Cory Cornelius , Jason Martin , Nageen Himayat

We consider the problem of making nonparametric inference in a class of multi-dimensional diffusions in divergence form, from low-frequency data. Statistical analysis in this setting is notoriously challenging due to the intractability of…

Methodology · Statistics 2025-01-23 Matteo Giordano , Sven Wang

We describe a set of Gaussian Process based approaches that can be used to solve non-linear Ordinary Differential Equations. We suggest an explicit probabilistic solver and two implicit methods, one analogous to Picard iteration and the…

Methodology · Statistics 2014-08-19 David Barber

Flow matching is a recent state-of-the-art framework for generative modeling based on ordinary differential equations (ODEs). While closely related to diffusion models, it provides a more general perspective on generative modeling. Although…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Jeongsol Kim , Bryan Sangwoo Kim , Jong Chul Ye

Filtering-based probabilistic numerical solvers for ordinary differential equations (ODEs), also known as ODE filters, have been established as efficient methods for quantifying numerical uncertainty in the solution of ODEs. In practical…

Machine Learning · Statistics 2025-10-02 Dingling Yao , Filip Tronarp , Nathanael Bosch

Increasingly complex generative models are being used across disciplines as they allow for realistic characterization of data, but a common difficulty with them is the prohibitively large computational cost to evaluate the likelihood…

Computation · Statistics 2017-03-06 Michael U. Gutmann , Ritabrata Dutta , Samuel Kaski , Jukka Corander

Diffusion models have exhibited excellent performance in various domains. The probability flow ordinary differential equation (ODE) of diffusion models (i.e., diffusion ODEs) is a particular case of continuous normalizing flows (CNFs),…

Machine Learning · Computer Science 2024-04-09 Kaiwen Zheng , Cheng Lu , Jianfei Chen , Jun Zhu

Bayesian posterior distributions arising in modern applications, including inverse problems in partial differential equation models in tomography and subsurface flow, are often computationally intractable due to the large computational cost…

Machine Learning · Statistics 2023-02-10 Tapio Helin , Andrew Stuart , Aretha Teckentrup , Konstantinos Zygalakis

In this paper, we present a novel derivative-free optimization framework for solving unconstrained stochastic optimization problems. Many problems in fields ranging from simulation optimization to reinforcement learning involve settings…

Optimization and Control · Mathematics 2024-04-19 Raghu Bollapragada , Cem Karamanli , Stefan M. Wild

Estimating the parameters of ordinary differential equations (ODEs) is of fundamental importance in many scientific applications. While ODEs are typically approximated with deterministic algorithms, new research on probabilistic solvers…

Machine Learning · Statistics 2023-12-08 Mohan Wu , Martin Lysy

Likelihood-free inference (LFI) methods, such as approximate Bayesian computation, have become commonplace for conducting inference in complex models. Many approaches are based on summary statistics or discrepancies derived from synthetic…

Methodology · Statistics 2025-06-06 David T. Frazier , Christopher Drovandi , Lucas Kock , David J. Nott

In applications of Gaussian processes where quantification of uncertainty is of primary interest, it is necessary to accurately characterize the posterior distribution over covariance parameters. This paper proposes an adaptation of the…

Methodology · Statistics 2015-09-04 Maurizio Filippone , Raphael Engler

Diffusion probabilistic models generate samples by learning to reverse a noise-injection process that transforms data into noise. A key development is the reformulation of the reverse sampling process as a deterministic probability flow…

Machine Learning · Computer Science 2025-08-15 Daniel Zhengyu Huang , Jiaoyang Huang , Zhengjiang Lin

Simulators often provide the best description of real-world phenomena. However, they also lead to challenging inverse problems because the density they implicitly define is often intractable. We present a new suite of simulation-based…

Machine Learning · Statistics 2020-02-25 Johann Brehmer , Gilles Louppe , Juan Pavez , Kyle Cranmer

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov