English
Related papers

Related papers: Penalized Ensemble Kalman Filters for High Dimensi…

200 papers

We present a practical implementation of the ensemble Kalman (EnKF) filter based on an iterative Sherman-Morrison formula. The new direct method exploits the special structure of the ensemble-estimated error covariance matrices in order to…

Numerical Analysis · Computer Science 2015-02-03 Elias D. Nino-Ruiz , Adrian Sandu , Jeffrey Anderson

The use of model order reduction techniques in combination with ensemble-based methods for estimating the state of systems described by nonlinear partial differential equations has been of great interest in recent years in the data…

Numerical Analysis · Mathematics 2024-12-18 Francesco A. B. Silva , Cecilia Pagliantini , Karen Veroy

We design and analyse the performance of a multilevel ensemble Kalman filter method (MLEnKF) for filtering settings where the underlying state-space model is an infinite-dimensional spatio-temporal process. We consider underlying models…

Numerical Analysis · Mathematics 2020-03-11 Alexey Chernov , Håkon Hoel , Kody J. H. Law , Fabio Nobile , Raul Tempone

We propose a new type of the Ensemble Kalman Filter (EnKF), which uses the Fast Fourier Transform (FFT) for covariance estimation from a very small ensemble with automatic tapering, and for a fast computation of the analysis ensemble by…

Atmospheric and Oceanic Physics · Physics 2011-08-01 Jan Mandel , Jonathan D. Beezley , Volodymyr Y. Kondratenko

Ensemble Kalman filter (EnKF) has been widely used in state estimation and parameter estimation for the dynamic system where observational data is obtained sequentially in time. To reduce uncertainty and accelerate posterior inference, a…

Numerical Analysis · Mathematics 2018-11-14 Yuming Ba , Lijian Jiang , Na Ou

A modification scheme to the ensemble Kalman filter (EnKF) is introduced based on the concept of the unscented transform (Julier et al., 2000; Julier and Uhlmann, 2004), which therefore will be called the ensemble unscented Kalman filter…

Atmospheric and Oceanic Physics · Physics 2009-11-30 X. Luo , I. M. Moroz

The Ensemble Kalman Filter (EnKF) belongs to the class of iterative particle filtering methods and can be used for solving control--to--observable inverse problems. In this context, the EnKF is known as Ensemble Kalman Inversion (EKI). In…

Numerical Analysis · Mathematics 2022-02-17 Dieter Armbruster , Michael Herty , Giuseppe Visconti

Although data assimilation originates from control theory, the relationship between modern data assimilation methods in geoscience and model predictive control has not been extensively explored. In the present paper, I discuss that the…

Geophysics · Physics 2024-10-21 Yohei Sawada

Many data-science problems can be formulated as an inverse problem, where the parameters are estimated by minimizing a proper loss function. When complicated black-box models are involved, derivative-free optimization tools are often…

Numerical Analysis · Mathematics 2021-10-19 Neil K. Chada , Xin T. Tong

This paper uses a probabilistic approach to analyze the converge of an ensemble Kalman filter solution to an exact Kalman filter solution in the simplest possible setting, the scalar case, as it allows us to build upon a rich literature of…

Optimization and Control · Mathematics 2020-03-31 Andrey A Popov , Adrian Sandu

Ensemble Kalman Filtering (EnKF) is a popular technique for data assimilation, with far ranging applications. However, the vanilla EnKF framework is not well-defined when perturbations are nonlinear. We study two non-linear extensions of…

Machine Learning · Statistics 2024-09-24 Zachariah Malik , Romit Maulik

Data assimilation (DA) aims to optimally combine model forecasts and observations that are both partial and noisy. Multi-model DA generalizes the variational or Bayesian formulation of the Kalman filter, and we prove that it is also the…

Methodology · Statistics 2023-01-23 Eviatar Bach , Michael Ghil

In a recent methodological paper, we showed how to learn chaotic dynamics along with the state trajectory from sequentially acquired observations, using local ensemble Kalman filters. Here, we more systematically investigate the possibility…

Machine Learning · Statistics 2022-10-19 Quentin Malartic , Alban Farchi , Marc Bocquet

The ensemble Kalman filter (EnKF) is a Monte Carlo approximation of the Kalman filter for high dimensional linear Gaussian state space models. EnKF methods have also been developed for parameter inference of static Bayesian models with a…

This work develops a new multifidelity ensemble Kalman filter (MFEnKF) algorithm based on linear control variate framework. The approach allows for rigorous multifidelity extensions of the EnKF, where the uncertainty in coarser fidelities…

Numerical Analysis · Mathematics 2020-07-03 Andrey A Popov , Changhong Mou , Traian Iliescu , Adrian Sandu

Data assimilation provides algorithms for widespread applications in various fields. It is of practical use to deal with a large amount of information in the complex system that is hard to estimate. Weather forecasting is one of the…

Optimization and Control · Mathematics 2023-03-23 Yihua Yang

In this work, we study the emergence of sparsity and multiway structures in second-order statistical characterizations of dynamical processes governed by partial differential equations (PDEs). We consider several state-of-the-art multiway…

Machine Learning · Statistics 2021-12-09 Yu Wang , Alfred Hero

We present a new type of the EnKF for data assimilation in spatial models that uses diagonal approximation of the state covariance in the wavelet space to achieve adaptive localization. The efficiency of the new method is demonstrated on an…

Dynamical Systems · Mathematics 2011-03-01 Jonathan D. Beezley , Jan Mandel , Loren Cobb

In this work, we present the ensemble-marginalized Kalman filter (EnMKF), a sequential algorithm analogous to our previously proposed approach [1,2], for estimating the state and parameters of linear parabolic partial differential equations…

Computation · Statistics 2018-05-15 Marco Iglesias , Zaid Sawlan , Marco Scavino , Raul Tempone , Christopher Wood

This paper develops an efficient implementation of the ensemble Kalman filter based on a modified Cholesky decomposition for inverse covariance matrix estimation. This implementation is named EnKF-MC. Background errors corresponding to…

Statistics Theory · Mathematics 2016-05-31 Elias D. Nino , Adrian Sandu , Xinwei Deng