English
Related papers

Related papers: Sampling error correction in ensemble Kalman inver…

200 papers

Gaussian process regression is a machine learning approach which has been shown its power for estimation of unknown functions. However, Gaussian processes suffer from high computational complexity, as in a basic form they scale cubically…

Machine Learning · Statistics 2018-09-10 Danil Kuzin , Le Yang , Olga Isupova , Lyudmila Mihaylova

Ensemble-based data assimilation (DA) methods have become increasingly popular due to their inherent ability to address nonlinear dynamic problems. However, these methods often face a trade-off between analysis accuracy and computational…

Machine Learning · Computer Science 2026-05-26 Zhilin Li , Zhou Yao , Xianglong Li , Zeng Liu , Zhaokuan Lu , Shanlin Xu , Seungnam Kim , Guangyao Wang

We consider the problem of performing Bayesian inference for logistic regression using appropriate extensions of the ensemble Kalman filter. Two interacting particle systems are proposed that sample from an approximate posterior and prove…

Machine Learning · Statistics 2024-07-02 Diksha Bhandari , Jakiw Pidstrigach , Sebastian Reich

We propose a new regularisation strategy for the classical ensemble Kalman inversion (EKI) framework. The strategy consists of: (i) an adaptive choice for the regularisation parameter in the update formula in EKI, and (ii) criteria for the…

Numerical Analysis · Mathematics 2020-09-24 Marco Iglesias , Yuchen Yang

Data assimilation is the task to combine evolution models and observational data in order to produce reliable predictions. In this paper, we focus on ensemble-based recursive data assimilation problems. Our main contribution is a hybrid…

Numerical Analysis · Mathematics 2016-02-26 Nawinda Chustagulprom , Sebastian Reich , Maria Reinhardt

Sampling of sharp posteriors in high dimensions is a challenging problem, especially when gradients of the likelihood are unavailable. In low to moderate dimensions, affine-invariant methods, a class of ensemble-based gradient-free methods,…

Methodology · Statistics 2022-02-23 Matthew M. Dunlop , Georg Stadler

Nonlinear Bayesian update for a prior ensemble is proposed to extend traditional ensemble Kalman filtering to settings characterized by non-Gaussian priors and nonlinear measurement operators. In this framework, the observed component is…

Machine Learning · Statistics 2025-03-20 Yoonsang Lee

Data assimilation (DA) integrates numerical model forecasts with observations to achieve the optimal state estimation. Ensemble-based methods, such as the ensemble Kalman filter (EnKF), are widely used for state estimation for…

Atmospheric and Oceanic Physics · Physics 2026-05-25 Zhou Yao , Zhilin Li , Li Zhao , Zeng Liu , Zhaokuan Lu , Seungnam Kim , Guangyao Wang

We consider Bayesian inference for large scale inverse problems, where computational challenges arise from the need for repeated evaluations of an expensive forward model. This renders most Markov chain Monte Carlo approaches infeasible,…

Numerical Analysis · Mathematics 2022-08-12 Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

The Ensemble Kalman methodology in an inverse problems setting can be viewed as an iterative scheme, which is a weakly tamed discretization scheme for a certain stochastic differential equation (SDE). Assuming a suitable approximation…

Probability · Mathematics 2018-06-19 Dirk Blömker , Claudia Schillings , Philipp Wacker

This paper uses a probabilistic approach to analyze the converge of an ensemble Kalman filter solution to an exact Kalman filter solution in the simplest possible setting, the scalar case, as it allows us to build upon a rich literature of…

Optimization and Control · Mathematics 2020-03-31 Andrey A Popov , Adrian Sandu

Uncertainty quantification by ensemble learning is explored in terms of an application from computational optical form measurements. The application requires to solve a large-scale, nonlinear inverse problem. Ensemble learning is used to…

Machine Learning · Computer Science 2021-03-03 Lara Hoffmann , Ines Fortmeier , Clemens Elster

Ill-posed inverse problems are ubiquitous in applications. Under- standing of algorithms for their solution has been greatly enhanced by a deep understanding of the linear inverse problem. In the applied communities ensemble-based filtering…

Statistics Theory · Mathematics 2015-12-08 Marco A. Iglesias , Kui Lin , Shuai Lu , Andrew M. Stuart

The Ensemble Kalman filter and Ensemble square root filters are data assimilation methods used to combine high dimensional nonlinear models with observed data. These methods have proved to be indispensable tools in science and engineering…

Probability · Mathematics 2015-07-31 Xin T Tong , Andrew J Majda , David Kelly

Subsampling algorithms for various parametric regression models with massive data have been extensively investigated in recent years. However, all existing studies on subsampling heavily rely on clean massive data. In practical…

Statistics Theory · Mathematics 2025-06-11 Jiangshan Ju , Mingqiu Wang , Shengli Zhao

Seismic inversion is essential for geophysical exploration and geological assessment, but it is inherently subject to significant uncertainty. This uncertainty stems primarily from the limited information provided by observed seismic data,…

Geophysics · Physics 2024-09-12 Luping Qu , Mauricio Araya-Polo , Laurent Demanet

This paper is focused on the optimization approach to the solution of inverse problems. We introduce a stochastic dynamical system in which the parameter-to-data map is embedded, with the goal of employing techniques from nonlinear Kalman…

Numerical Analysis · Mathematics 2022-04-29 Daniel Zhengyu Huang , Tapio Schneider , Andrew M. Stuart

The sample covariance matrix of a random vector is a good estimate of the true covariance matrix if the sample size is much larger than the length of the vector. In high-dimensional problems, this condition is never met. As a result, in…

Data Analysis, Statistics and Probability · Physics 2024-11-12 Michael Tsyrulnikov , Arseniy Sotskiy

Many applications, such as intermittent data assimilation, lead to a recursive application of Bayesian inference within a Monte Carlo context. Popular data assimilation algorithms include sequential Monte Carlo methods and ensemble Kalman…

Numerical Analysis · Mathematics 2013-01-15 Sebastian Reich

Using observation data to estimate unknown parameters in computational models is broadly important. This task is often challenging because solutions are non-unique due to the complexity of the model and limited observation data. However,…

Methodology · Statistics 2018-12-18 Jiacheng Wu , Jian-Xun Wang , Shawn C. Shadden