English
Related papers

Related papers: Subsampling in ensemble Kalman inversion

200 papers

Ensemble Kalman inversion is a parallelizable derivative-free method to solve inverse problems. The method uses an ensemble that follows the Kalman update formula iteratively to solve an optimization problem. The ensemble size is crucial to…

Numerical Analysis · Mathematics 2021-05-25 Yoonsang Lee

The ensemble Kalman inversion is widely used in practice to estimate unknown parameters from noisy measurement data. Its low computational costs, straightforward implementation, and non-intrusive nature makes the method appealing in various…

Numerical Analysis · Mathematics 2019-09-04 Dirk Blömker , Claudia Schillings , Philipp Wacker , Simon Weissmann

This work proposes ensemble Kalman randomized maximum likelihood estimation, a new derivative-free method for performing randomized maximum likelihood estimation, which is a method that can be used to generate approximate samples from…

Numerical Analysis · Mathematics 2025-07-08 Pavlos Stavrinides , Elizabeth Qian

The Bayesian approach to inverse problems is widely used in practice to infer unknown parameters from noisy observations. In this framework, the ensemble Kalman inversion has been successfully applied for the quantification of uncertainties…

Numerical Analysis · Mathematics 2019-10-15 Neil K. Chada , Claudia Schillings , Simon Weissmann

This paper provides a unified perspective of iterative ensemble Kalman methods, a family of derivative-free algorithms for parameter reconstruction and other related tasks. We identify, compare and develop three subfamilies of ensemble…

Numerical Analysis · Mathematics 2020-10-27 Neil K. Chada , Yuming Chen , Daniel Sanz-Alonso

Data assimilation provides algorithms for widespread applications in various fields. It is of practical use to deal with a large amount of information in the complex system that is hard to estimate. Weather forecasting is one of the…

Optimization and Control · Mathematics 2023-03-23 Yihua Yang

We study the use of novel techniques arising in machine learning for inverse problems. Our approach replaces the complex forward model by a neural network, which is trained simultaneously in a one-shot sense when estimating the unknown…

Numerical Analysis · Mathematics 2020-09-15 Philipp A. Guth , Claudia Schillings , Simon Weissmann

The use of ensemble methods to solve inverse problems is attractive because it is a derivative-free methodology which is also well-adapted to parallelization. In its basic iterative form the method produces an ensemble of solutions which…

Numerical Analysis · Mathematics 2018-05-09 Neil K. Chada , Marco A. Iglesias , Lassi Roininen , Andrew M. Stuart

Gaussian process regression is a machine learning approach which has been shown its power for estimation of unknown functions. However, Gaussian processes suffer from high computational complexity, as in a basic form they scale cubically…

Machine Learning · Statistics 2018-09-10 Danil Kuzin , Le Yang , Olga Isupova , Lyudmila Mihaylova

Many modern algorithms for inverse problems and data assimilation rely on ensemble Kalman updates to blend prior predictions with observed data. Ensemble Kalman methods often perform well with a small ensemble size, which is essential in…

Machine Learning · Statistics 2024-01-05 Omar Al Ghattas , Daniel Sanz-Alonso

We investigate the application of ensemble transform approaches to Bayesian inference of logistic regression problems. Our approach relies on appropriate extensions of the popular ensemble Kalman filter and the feedback particle filter to…

Numerical Analysis · Mathematics 2021-09-27 Jakiw Pidstrigach , Sebastian Reich

Filtering is concerned with online estimation of the state of a dynamical system from partial and noisy observations. In applications where the state of the system is high dimensional, ensemble Kalman filters are often the method of choice.…

Systems and Control · Electrical Eng. & Systems 2024-07-30 Omar Al Ghattas , Jiajun Bao , Daniel Sanz-Alonso

We propose a new class of filtering and smoothing methods for inference in high-dimensional, nonlinear, non-Gaussian, spatio-temporal state-space models. The main idea is to combine the ensemble Kalman filter and smoother, developed in the…

Methodology · Statistics 2019-03-22 Matthias Katzfuss , Jonathan R. Stroud , Christopher K. Wikle

Recent developments in generative modeling have utilized score-based methods coupled with stochastic differential equations to sample from complex probability distributions. However, these and other performant sampling methods generally…

Machine Learning · Computer Science 2025-06-03 Bryan Riel , Tobias Bischoff

Ensemble Kalman methods were initially developed to solve nonlinear data assimilation problems in oceanography, but are now popular in applications far beyond their original use cases. Of particular interest is climate model calibration. As…

Data Analysis, Statistics and Probability · Physics 2025-11-21 Rebecca Gjini , Matthias Morzfeld , Oliver R. A. Dunbar , Tapio Schneider

We introduce Kalman Gradient Descent, a stochastic optimization algorithm that uses Kalman filtering to adaptively reduce gradient variance in stochastic gradient descent by filtering the gradient estimates. We present both a theoretical…

Machine Learning · Statistics 2018-10-30 James Vuckovic

Many parameter estimation problems arising in applications are best cast in the framework of Bayesian inversion. This allows not only for an estimate of the parameters, but also for the quantification of uncertainties in the estimates.…

Computation · Statistics 2020-10-28 Emmet Cleary , Alfredo Garbuno-Inigo , Shiwei Lan , Tapio Schneider , Andrew M Stuart

The standard probabilistic perspective on machine learning gives rise to empirical risk-minimization tasks that are frequently solved by stochastic gradient descent (SGD) and variants thereof. We present a formulation of these tasks as…

Machine Learning · Computer Science 2019-09-04 Nikola B. Kovachki , Andrew M. Stuart

The Ensemble Kalman inversion (EKI) method is a method for the estimation of unknown parameters in the context of (Bayesian) inverse problems. The method approximates the underlying measure by an ensemble of particles and iteratively…

Numerical Analysis · Mathematics 2021-08-02 Dirk Blömker , Claudia Schillings , Philipp Wacker , Simon Weissmann

The Ensemble Kalman Inversion (EKI) method is widely used for solving inverse problems, leveraging ensemble-based techniques to iteratively refine parameter estimates. Despite its versatility, the accuracy of EKI is constrained by the…

Numerical Analysis · Mathematics 2025-03-17 Ruben Harris , Claudia Schillings
‹ Prev 1 2 3 10 Next ›