English
Related papers

Related papers: A multi-model ensemble Kalman filter for data assi…

200 papers

State-of-the-art ensemble Kalman filtering (EnKF) algorithms require incorporating localization techniques to cope with the rank deficiency and the inherited spurious correlations in their error covariance matrices. Localization techniques…

Atmospheric and Oceanic Physics · Physics 2026-03-05 Boujemaa Ait-El-Fquih , Ibrahim Hoteit

Artificial intelligence (AI)-based weather prediction research is growing rapidly and has shown to be competitive with the advanced dynamic numerical weather prediction models. However, research combining AI-based weather prediction models…

Machine Learning · Computer Science 2025-10-16 Shunji Kotsuki , Kenta Shiraishi , Atsushi Okazaki

This paper tackles the intricate task of jointly estimating state and parameters in data assimilation for stochastic dynamical systems that are affected by noise and observed only partially. While the concept of ``optimal filtering'' serves…

Optimization and Control · Mathematics 2023-12-19 Feng Bao , Guannan Zhang , Zezhong Zhang

We introduce a new multilevel ensemble Kalman filter method (MLEnKF) which consists of a hierarchy of independent samples of ensemble Kalman filters (EnKF). This new MLEnKF method is fundamentally different from the preexisting method…

Numerical Analysis · Mathematics 2020-09-22 Håkon Hoel , Gaukhar Shaimerdenova , Raúl Tempone

The ensemble Kalman filter (EnKF) is widely used to sample a probability density function (pdf) generated by a stochastic model conditioned by noisy data. This pdf can be either a joint posterior that describes the evolution of the state of…

Data Analysis, Statistics and Probability · Physics 2016-08-08 Matthias Morzfeld , Daniel Hodyss

The Ensemble Kalman Filter (EnKF) has achieved great successes in data assimilation in atmospheric and oceanic sciences, but its failure in convergence to the right filtering distribution precludes its use for uncertainty quantification. We…

Methodology · Statistics 2021-05-13 Peiyi Zhang , Qifan Song , Faming Liang

Heavy tails is a common feature of filtering distributions that results from the nonlinear dynamical and observation processes as well as the uncertainty from physical sensors. In these settings, the Kalman filter and its ensemble version -…

Computation · Statistics 2023-10-16 Mathieu Le Provost , Ricardo Baptista , Jeff D. Eldredge , Youssef Marzouk

This paper investigates an approximation scheme of the optimal nonlinear Bayesian filter based on the Gaussian mixture representation of the state probability distribution function. The resulting filter is similar to the particle filter,…

Data Analysis, Statistics and Probability · Physics 2015-05-30 Ibrahim Hoteit , Xiaodong Luo , Dinh-Tuan Pham

Over the years data assimilation methods have been developed to obtain estimations of uncertain model parameters by taking into account a few observations of a model state. The most reliable methods of MCMC are computationally expensive.…

Applications · Statistics 2018-11-14 Sangeetika Ruchi , Svetlana Dubinkina

Accurate knowledge of time-variation in meridional flow-speed and profile is crucial for estimating a solar cycle's features, which are ultimately responsible for causing space climate variations. However, no consensus has been reached yet…

Solar and Stellar Astrophysics · Physics 2014-08-22 Mausumi Dikpati , Jeffrey L. Anderson , Dhrubaditya Mitra

Ensemble methods, such as the ensemble Kalman filter (EnKF), the local ensemble transform Kalman filter (LETKF), and the ensemble Kalman smoother (EnKS) are widely used in sequential data assimilation, where state vectors are of huge…

Probability · Mathematics 2019-01-03 El houcine Bergou , Serge Gratton , Jan Mandel

Filtering - the task of estimating the conditional distribution for states of a dynamical system given partial and noisy observations - is important in many areas of science and engineering, including weather and climate prediction.…

Machine Learning · Computer Science 2025-03-25 Eviatar Bach , Ricardo Baptista , Enoch Luk , Andrew Stuart

The ensemble random forest filter (ERFF) is presented as an alternative to the ensemble Kalman filter (EnKF) for the purpose of inverse modeling. The EnKF is a data assimilation approach that forecasts and updates parameter estimates…

Machine Learning · Computer Science 2022-07-11 Vanessa A. Godoy , Gian F. Napa-García , J. Jaime Gómez-Hernández

The intersection between classical data assimilation methods and novel machine learning techniques has attracted significant interest in recent years. Here we explore another promising solution in which diffusion models are used to…

Mathematical Physics · Physics 2024-04-02 Feng Bao , Hristo G. Chipilski , Siming Liang , Guannan Zhang , Jeffrey S. Whitaker

Working with a two-stage ice sheet model, we explore how statistical data assimilation methods can be used to improve predictions of glacier melt and relatedly, sea level rise. We find that the EnKF improves model runs initialized using…

Dynamical Systems · Mathematics 2023-05-23 Emily Corcoran , Logan Knudsen , Talea Mayo , Hannah Park-Kaufmann , Alexander Robel

The ability of ensemble Kalman filter (EnKF) algorithms to extract information from observations is analyzed with the aid of the concept of the degrees of freedom for signal (DFS). A simple mathematical argument shows that DFS for EnKF is…

Data Analysis, Statistics and Probability · Physics 2021-03-26 Daisuke Hotta , Yoichiro Ota

The Bootstrap Particle Filter (BPF) and the Ensemble Kalman Filter (EnKF) are two widely used methods for sequential Bayesian filtering: the BPF is asymptotically exact but can suffer from weight degeneracy, while the EnKF scales well in…

Methodology · Statistics 2026-01-28 Ilja Klebanov , Claudia Schillings , Dana Wrischnig

We propose a Dynamical Low-Rank Ensemble Kalman Filter (DLR-ENKF) for efficient joint state-parameter estimation in high-dimensional dynamical systems. The method extends the DLR-ENKF formulation of arXiv:2509.11210 to the augmented…

Numerical Analysis · Mathematics 2026-02-09 Fabio Nobile , Sébastien Riffaud , Thomas Trigo Trindade

The iterative ensemble Kalman filter (IEnKF) is widely used in inverse problems to estimate system parameters from limited observations. However, the IEnKF, when applied to nonlinear systems, can be plagued by poor convergence. Here we…

Optimization and Control · Mathematics 2019-10-11 Jiacheng Wu , Jian-Xun Wang , Shawn C. Shadden

Ensemble Kalman Inversion (EnKI) and Ensemble Square Root Filter (EnSRF) are popular sampling methods for obtaining a target posterior distribution. They can be seem as one step (the analysis step) in the data assimilation method Ensemble…

Numerical Analysis · Mathematics 2025-03-07 Zhiyan Ding , Qin Li , Jianfeng Lu