English
Related papers

Related papers: A non-parametric ensemble transform method for Bay…

200 papers

Accurate modeling and prediction of complex physical systems often rely on data assimilation techniques to correct errors inherent in model simulations. Traditional methods like the Ensemble Kalman Filter (EnKF) and its variants as well as…

Machine Learning · Computer Science 2024-09-12 Phillip Si , Peng Chen

The ensemble Kalman filter (EnKF) has become a standard methodology for state estimation in high-dimensional systems, yet its various stochastic and deterministic formulations often appear conceptually disconnected. In this paper, a unified…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Jin Won Kim

We present a novel sampling-based method for estimating probabilities of rare or failure events. Our approach is founded on the Ensemble Kalman filter (EnKF) for inverse problems. Therefore, we reformulate the rare event problem as an…

Numerical Analysis · Mathematics 2021-12-15 Fabian Wagner , Iason Papaioannou , Elisabeth Ullmann

We consider filtering in high-dimensional non-Gaussian state-space models with intractable transition kernels, nonlinear and possibly chaotic dynamics, and sparse observations in space and time. We propose a novel filtering methodology that…

Methodology · Statistics 2022-04-07 Alessio Spantini , Ricardo Baptista , Youssef Marzouk

The iterative ensemble Kalman filter (IEnKF) in a deterministic framework was introduced in Sakov et al. (2012) to extend the ensemble Kalman filter (EnKF) and improve its performance in mildly up to strongly nonlinear cases. However, the…

Atmospheric and Oceanic Physics · Physics 2018-10-17 Pavel Sakov , Jean-Matthieu Haussaire , Marc Bocquet

Ensemble Kalman Filtering (EnKF) is a popular technique for data assimilation, with far ranging applications. However, the vanilla EnKF framework is not well-defined when perturbations are nonlinear. We study two non-linear extensions of…

Machine Learning · Statistics 2024-09-24 Zachariah Malik , Romit Maulik

Parameter estimation has a high importance in the geosciences. The ensemble Kalman filter (EnKF) allows parameter estimation for large, time-dependent systems. For large systems, the EnKF is applied using small ensembles, which may lead to…

Applications · Statistics 2021-08-05 Johannes Keller , Harrie-Jan Hendricks Franssen , Wolfgang Nowak

State-of-the-art ensemble Kalman filtering (EnKF) algorithms require incorporating localization techniques to cope with the rank deficiency and the inherited spurious correlations in their error covariance matrices. Localization techniques…

Atmospheric and Oceanic Physics · Physics 2026-03-05 Boujemaa Ait-El-Fquih , Ibrahim Hoteit

Ensemble Kalman filter (EnKF) is an important data assimilation method for high dimensional geophysical systems. Efficient implementation of EnKF in practice often involves the localization technique, which updates each component using only…

Probability · Mathematics 2018-04-04 Xin T. Tong

The intersection between classical data assimilation methods and novel machine learning techniques has attracted significant interest in recent years. Here we explore another promising solution in which diffusion models are used to…

Mathematical Physics · Physics 2024-04-02 Feng Bao , Hristo G. Chipilski , Siming Liang , Guannan Zhang , Jeffrey S. Whitaker

Ensemble transform Kalman filtering (ETKF) data assimilation is often used to combine available observations with numerical simulations to obtain statistically accurate and reliable state representations in dynamical systems. However, it is…

Numerical Analysis · Mathematics 2024-03-07 Tongtong Li , Anne Gelb , Yoonsang Lee

The ensemble Kalman filter (EnKF) is an efficient algorithm for many data assimilation problems. In certain circumstances, however, divergence of the EnKF might be spotted. In previous studies, the authors proposed an…

Atmospheric and Oceanic Physics · Physics 2014-08-19 Xiaodong Luo , Ibrahim Hoteit

Ensemble Kalman filter (EnKF) has been widely used in state estimation and parameter estimation for the dynamic system where observational data is obtained sequentially in time. To reduce uncertainty and accelerate posterior inference, a…

Numerical Analysis · Mathematics 2018-11-14 Yuming Ba , Lijian Jiang , Na Ou

Artificial neural networks (ANNs) are widely used in modeling sentence processing but often exhibit deterministic behavior, contrasting with human sentence comprehension, which manages uncertainty during ambiguous or unexpected inputs. This…

Computation and Language · Computer Science 2025-05-06 Diksha Bhandari , Alessandro Lopopolo , Milena Rabovsky , Sebastian Reich

Ensemble Kalman filtering (EnKF) is an efficient approach to addressing uncertainties in subsurface groundwater models. The EnKF sequentially integrates field data into simulation models to obtain a better characterization of the model's…

Data Analysis, Statistics and Probability · Physics 2015-11-09 Boujemaa Ait-El-Fquih , Mohamad El Gharamti , Ibrahim Hoteit

In this work we combine ideas from multi-index Monte Carlo and ensemble Kalman filtering (EnKF) to produce a highly efficient filtering method called multi-index EnKF (MIEnKF). MIEnKF is based on independent samples of four-coupled EnKF…

Numerical Analysis · Mathematics 2022-09-07 Håkon Hoel , Gaukhar Shaimerdenova , Raúl Tempone

Over the years data assimilation methods have been developed to obtain estimations of uncertain model parameters by taking into account a few observations of a model state. The most reliable methods of MCMC are computationally expensive.…

Applications · Statistics 2018-11-14 Sangeetika Ruchi , Svetlana Dubinkina

The Ensemble Kalman Filter (EnKF), as a fundamental data assimilation approach, has been widely used in many fields of the sciences and engineering. When the state variable is of high dimensional accompanied with high resolution…

Methodology · Statistics 2025-09-18 Shouxia Wang , Hao-Xuan Sun , Song Xi Chen

The iterative ensemble Kalman filter (IEnKF) is widely used in inverse problems to estimate system parameters from limited observations. However, the IEnKF, when applied to nonlinear systems, can be plagued by poor convergence. Here we…

Optimization and Control · Mathematics 2019-10-11 Jiacheng Wu , Jian-Xun Wang , Shawn C. Shadden

The Ensemble Kalman Filter (EnKF) has achieved great successes in data assimilation in atmospheric and oceanic sciences, but its failure in convergence to the right filtering distribution precludes its use for uncertainty quantification. We…

Methodology · Statistics 2021-05-13 Peiyi Zhang , Qifan Song , Faming Liang