English
Related papers

Related papers: Ensemble Kalman Inversion: A Derivative-Free Techn…

200 papers

We consider the Ensemble Kalman Inversion which has been recently introduced as an efficient, gradient-free optimisation method to estimate unknown parameters in an inverse setting. In the case of large data sets, the Ensemble Kalman…

Numerical Analysis · Mathematics 2023-12-05 Matei Hanu , Jonas Latz , Claudia Schillings

The ensemble Kalman filter is a well-known and celebrated data assimilation algorithm. It is of particular relevance as it used for high-dimensional problems, by updating an ensemble of particles through a sample mean and covariance…

Numerical Analysis · Mathematics 2022-07-27 Neil K. Chada

This work presents new results and understanding of the Ensemble Kalman filter (EnKF) for inverse problems. In particular, using a Lagrangian dual perspective we show that EnKF can be derived from the sample average approximation (SAA) of…

Numerical Analysis · Mathematics 2026-01-27 C G Krishnanunni , Jonathan Wittmer , Tan Bui-Thanh , Quoc P. Nguyen

The ensemble Kalman inversion (EKI) for the solution of Bayesian inverse problems of type $y = A u +\varepsilon$, with $u$ being an unknown parameter, $y$ a given datum, and $\varepsilon$ measurement noise, is a powerful tool usually…

Numerical Analysis · Mathematics 2023-03-16 Leon Bungert , Philipp Wacker

The unscented Kalman inversion (UKI) method presented in [1] is a general derivative-free approach for the inverse problem. UKI is particularly suitable for inverse problems where the forward model is given as a black box and may not be…

Numerical Analysis · Mathematics 2021-04-23 Daniel Z. Huang , Jiaoyang Huang

Although the governing equations of many systems, when derived from first principles, may be viewed as known, it is often too expensive to numerically simulate all the interactions they describe. Therefore researchers often seek simpler…

Computation · Statistics 2021-05-03 Tapio Schneider , Andrew M. Stuart , Jin-Long Wu

Ensemble Kalman Inversion (EKI) has been a very popular algorithm used in Bayesian inverse problems. It samples particles from a prior distribution, and introduces a motion to move the particles around in pseudo-time. As the pseudo-time…

Numerical Analysis · Mathematics 2025-03-07 Zhiyan Ding , Qin Li

Ensemble Kalman inversion is a parallelizable derivative-free method to solve inverse problems. The method uses an ensemble that follows the Kalman update formula iteratively to solve an optimization problem. The ensemble size is crucial to…

Numerical Analysis · Mathematics 2021-05-25 Yoonsang Lee

When solving inverse problems, one increasingly popular approach is to use pre-trained diffusion models as plug-and-play priors. This framework can accommodate different forward models without re-training while preserving the generative…

Machine Learning · Computer Science 2025-06-04 Hongkai Zheng , Wenda Chu , Austin Wang , Nikola Kovachki , Ricardo Baptista , Yisong Yue

In recent years, operator learning, particularly the DeepONet, has received much attention for efficiently learning complex mappings between input and output functions across diverse fields. However, in practical scenarios with limited and…

Machine Learning · Computer Science 2024-03-07 Andrew Pensoneault , Xueyu Zhu

The ensemble Kalman filter (EnKF) is a Monte Carlo approximation of the Kalman filter for high dimensional linear Gaussian state space models. EnKF methods have also been developed for parameter inference of static Bayesian models with a…

Inverse problems are ubiquitous because they formalize the integration of data with mathematical models. In many scientific applications the forward model is expensive to evaluate, and adjoint computations are difficult to employ; in this…

Dynamical Systems · Mathematics 2021-11-05 G. A. Pavliotis , A. M. Stuart , U. Vaes

This work proposes ensemble Kalman randomized maximum likelihood estimation, a new derivative-free method for performing randomized maximum likelihood estimation, which is a method that can be used to generate approximate samples from…

Numerical Analysis · Mathematics 2025-07-08 Pavlos Stavrinides , Elizabeth Qian

The interaction between the foundation structures and the soil has been developed for many engineering applications. For the determination of the stress in foundation structure it is needed to determine the influence of the stiffness of…

Numerical Analysis · Mathematics 2022-05-17 Leonardo Scandurra

Many parameter estimation problems arising in applications are best cast in the framework of Bayesian inversion. This allows not only for an estimate of the parameters, but also for the quantification of uncertainties in the estimates.…

Computation · Statistics 2020-10-28 Emmet Cleary , Alfredo Garbuno-Inigo , Shiwei Lan , Tapio Schneider , Andrew M Stuart

Ensemble Kalman Inversion (EKI) has been proposed as an efficient method for the approximate solution of Bayesian inverse problems with expensive forward models. However, when applied to the Bayesian inverse problem EKI is only exact in the…

Computation · Statistics 2024-11-19 Richard D. P. Grumitt , Minas Karamanis , Uroš Seljak

Numerical models of geothermal reservoirs typically depend on hundreds or thousands of unknown parameters, which must be estimated using sparse, noisy data. However, these models capture complex physical processes, which frequently results…

In this paper, we introduce the Ensemble Kalman-Stein Gradient Descent (EnKSGD) class of algorithms. The EnKSGD class of algorithms builds on the ensemble Kalman filter (EnKF) line of work, applying techniques from sequential data…

Optimization and Control · Mathematics 2024-06-24 Brian Irwin , Sebastian Reich

We study the variational inference problem of minimizing a regularized R\'enyi divergence over an exponential family. We propose to solve this problem with a Bregman proximal gradient algorithm. We propose a sampling-based algorithm to…

Statistics Theory · Mathematics 2024-10-17 Thomas Guilmeau , Emilie Chouzenoux , Víctor Elvira

In the geophysical joint inversion, the gradient and Bayesian Markov Chain Monte Carlo (MCMC) sampling-based methods are widely used owing to their fast convergences or global optimality. However, these methods either require the…

Geophysics · Physics 2022-08-04 Longlong Wang , Yun Chen , Youshan Liu , Nanqiao Du , Wei Li , Junliu Suwen