English
Related papers

Related papers: A Machine Learning Approach to Adaptive Covariance…

200 papers

The ability of ensemble Kalman filter (EnKF) algorithms to extract information from observations is analyzed with the aid of the concept of the degrees of freedom for signal (DFS). A simple mathematical argument shows that DFS for EnKF is…

Data Analysis, Statistics and Probability · Physics 2021-03-26 Daisuke Hotta , Yoichiro Ota

The Ensemble Kalman filter (EnKF) was introduced by Evensen in 1994 [10] as a novel method for data assimilation: state estimation for noisily observed time-dependent problems. Since that time it has had enormous impact in many application…

Optimization and Control · Mathematics 2013-04-08 Marco A. Iglesias , Kody J. H. Law , Andrew M. Stuart

We propose a new type of the Ensemble Kalman Filter (EnKF), which uses the Fast Fourier Transform (FFT) for covariance estimation from a very small ensemble with automatic tapering, and for a fast computation of the analysis ensemble by…

Atmospheric and Oceanic Physics · Physics 2011-08-01 Jan Mandel , Jonathan D. Beezley , Volodymyr Y. Kondratenko

Extended Kalman Filter (EKF) has been a popular approach to localization a mobile robot. However, the performance of the EKF and the quality of the estimation depends on the correct a priori knowledge of process and measurement noise…

Other Computer Science · Computer Science 2010-04-20 Ramazan Havangi , Mohammad Ali Nekoui , Mohammad Teshnehlab

The ensemble Kalman filter is a well-known and celebrated data assimilation algorithm. It is of particular relevance as it used for high-dimensional problems, by updating an ensemble of particles through a sample mean and covariance…

Numerical Analysis · Mathematics 2022-07-27 Neil K. Chada

The ensemble Kalman filter (EnKF) is an efficient algorithm for many data assimilation problems. In certain circumstances, however, divergence of the EnKF might be spotted. In previous studies, the authors proposed an…

Atmospheric and Oceanic Physics · Physics 2014-08-19 Xiaodong Luo , Ibrahim Hoteit

Data assimilation (DA) for compressible flows with shocks is challenging because many classical DA methods generate spurious oscillations and nonphysical features near uncertain shocks. We focus here on the ensemble Kalman filter (EnKF). We…

Data assimilation provides algorithms for widespread applications in various fields. It is of practical use to deal with a large amount of information in the complex system that is hard to estimate. Weather forecasting is one of the…

Optimization and Control · Mathematics 2023-03-23 Yihua Yang

Ever since its inception, the Ensemble Kalman Filter has elicited many heuristic methods that sought to correct it. One such method is localization---the thought that `nearby' variables should be highly correlated with `far away' variable…

Numerical Analysis · Computer Science 2019-07-24 Andrey A Popov , Adrian Sandu

The ensemble Kalman filter (EnKF) is a method for combining a dynamical model with data in a sequential fashion. Despite its widespread use, there has been little analysis of its theoretical properties. Many of the algorithmic innovations…

Probability · Mathematics 2015-06-17 D. T. B. Kelly , K. J. H. Law , A. M. Stuart

Several variations of the Kalman filter algorithm, such as the extended Kalman filter (EKF) and the unscented Kalman filter (UKF), are widely used in science and engineering applications. In this paper, we introduce two algorithms of…

Optimization and Control · Mathematics 2018-10-11 Wei Kang , Liang Xu

This paper presents the machine learning-based ensemble conditional mean filter (ML-EnCMF) -- a filtering method based on the conditional mean filter (CMF) previously introduced in the literature. The updated mean of the CMF matches that of…

Machine Learning · Computer Science 2022-08-02 Truong-Vinh Hoang , Sebastian Krumscheid , Hermann G. Matthies , Raúl Tempone

We explore the potential of Data-Assimilation (DA) within the multi-scale framework of a shell model of turbulence, with a focus on the Ensemble Kalman Filter (EnKF). The central objective is to understand how measuring mesoscales (i.e.,…

Fluid Dynamics · Physics 2026-01-15 Francesco Fossella , Luca Biferale , Alberto Carrassi , Massimo Cencini , Vikrant Gupta

The ensemble Kalman filter (EnKF) is a reliable data assimilation tool for high-dimensional meteorological problems. On the other hand, the EnKF can be interpreted as a particle filter, and particle filters collapse in high-dimensional…

Numerical Analysis · Mathematics 2016-06-01 Matthias Morzfeld , Daniel Hodyss , Chris Snyder

We present a novel sampling-based method for estimating probabilities of rare or failure events. Our approach is founded on the Ensemble Kalman filter (EnKF) for inverse problems. Therefore, we reformulate the rare event problem as an…

Numerical Analysis · Mathematics 2021-12-15 Fabian Wagner , Iason Papaioannou , Elisabeth Ullmann

Filtering - the task of estimating the conditional distribution for states of a dynamical system given partial and noisy observations - is important in many areas of science and engineering, including weather and climate prediction.…

Machine Learning · Computer Science 2025-03-25 Eviatar Bach , Ricardo Baptista , Enoch Luk , Andrew Stuart

Because of physical assumptions and numerical approximations, low-order models are affected by uncertainties in the state and parameters, and by model biases. Model biases, also known as model errors or systematic errors, are difficult to…

Methodology · Statistics 2024-10-10 Andrea Nóvoa , Alberto Racca , Luca Magri

Over the years data assimilation methods have been developed to obtain estimations of uncertain model parameters by taking into account a few observations of a model state. The most reliable methods of MCMC are computationally expensive.…

Applications · Statistics 2018-11-14 Sangeetika Ruchi , Svetlana Dubinkina

This paper develops an efficient implementation of the ensemble Kalman filter based on a modified Cholesky decomposition for inverse covariance matrix estimation. This implementation is named EnKF-MC. Background errors corresponding to…

Statistics Theory · Mathematics 2016-05-31 Elias D. Nino , Adrian Sandu , Xinwei Deng

Quantifying forecast uncertainty is a key aspect of state-of-the-art numerical weather prediction and data assimilation systems. Ensemble-based data assimilation systems incorporate state-dependent uncertainty quantification based on…

Atmospheric and Oceanic Physics · Physics 2023-05-17 Maximiliano A. Sacco , Manuel Pulido , Juan J. Ruiz , Pierre Tandeo