English
Related papers

Related papers: Multilevel ensemble Kalman filtering for spatio-te…

200 papers

The sample covariance matrix of a random vector is a good estimate of the true covariance matrix if the sample size is much larger than the length of the vector. In high-dimensional problems, this condition is never met. As a result, in…

Data Analysis, Statistics and Probability · Physics 2024-11-12 Michael Tsyrulnikov , Arseniy Sotskiy

This paper uses a probabilistic approach to analyze the converge of an ensemble Kalman filter solution to an exact Kalman filter solution in the simplest possible setting, the scalar case, as it allows us to build upon a rich literature of…

Optimization and Control · Mathematics 2020-03-31 Andrey A Popov , Adrian Sandu

Deep Learners (DLs) are the state-of-art predictive mechanism with applications in many fields requiring complex high dimensional data processing. Although conventional DLs get trained via gradient descent with back-propagation, Kalman…

Machine Learning · Statistics 2023-07-21 Ved Piyush , Yuchen Yan , Yuzhen Zhou , Yanbin Yin , Souparno Ghosh

Many applications, such as intermittent data assimilation, lead to a recursive application of Bayesian inference within a Monte Carlo context. Popular data assimilation algorithms include sequential Monte Carlo methods and ensemble Kalman…

Numerical Analysis · Mathematics 2013-01-15 Sebastian Reich

The high dimensionality and computational constraints associated with filtering problems in large-scale geophysical applications are particularly challenging for the Particle Filter (PF). Approximate but efficient methods such as the…

Computation · Statistics 2016-12-23 Sylvain Robert , Hans R. Künsch

The ensemble Kalman filter (EnKF) is a recursive filter suitable for problems with a large number of variables, such as discretizations of partial differential equations in geophysical models. The EnKF originated as a version of the Kalman…

Atmospheric and Oceanic Physics · Physics 2009-01-26 Jan Mandel

In this article, a robust ensemble Kalman filter (EnKF) called MC-EnKF is proposed for nonlinear state-space model to deal with filtering problems with non-Gaussian observation noises. Our MC-EnKF is derived based on maximum correntropy…

Systems and Control · Electrical Eng. & Systems 2023-08-21 Yangtianze Tao , Jiayi Kang , Stephen Shing-Toung Yau

This paper develops efficient ensemble Kalman filter (EnKF) implementations based on shrinkage covariance estimation. The forecast ensemble members at each step are used to estimate the background error covariance matrix via the…

Statistics Theory · Mathematics 2015-02-03 Elias D. Nino-Ruiz , Adrian Sandu

This study considers the data assimilation problem in coupled systems, which consists of two components (sub-systems) interacting with each other through certain coupling terms. A straightforward way to tackle the assimilation problem in…

Atmospheric and Oceanic Physics · Physics 2015-06-22 Xiaodong Luo , Ibrahim Hoteit

Ensemble data assimilation methods such as the Ensemble Kalman Filter (EnKF) are a key component of probabilistic weather forecasting. They represent the uncertainty in the initial conditions by an ensemble which incorporates information…

Applications · Statistics 2018-10-17 Sylvain Robert , Daniel Leuenberger , Hans R. Künsch

Parameter estimation has a high importance in the geosciences. The ensemble Kalman filter (EnKF) allows parameter estimation for large, time-dependent systems. For large systems, the EnKF is applied using small ensembles, which may lead to…

Applications · Statistics 2021-08-05 Johannes Keller , Harrie-Jan Hendricks Franssen , Wolfgang Nowak

This work introduces a new, distributed implementation of the Ensemble Kalman Filter (EnKF) that allows for non-sequential assimilation of large datasets in high-dimensional problems. The traditional EnKF algorithm is computationally…

Machine Learning · Statistics 2023-11-23 Cédric Travelletti , Jörg Franke , David Ginsbourger , Stefan Brönnimann

In this paper, stochastic optimal control problems in continuous time and space are considered. In recent years, such problems have received renewed attention from the lens of reinforcement learning (RL) which is also one of our motivation.…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Anant A. Joshi , Amirhossein Taghvaei , Prashant G. Mehta , Sean P. Meyn

The ensemble Kalman filter (EnKF) has become a standard methodology for state estimation in high-dimensional systems, yet its various stochastic and deterministic formulations often appear conceptually disconnected. In this paper, a unified…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Jin Won Kim

The ensemble Kalman filter (EnKF) is widely used to sample a probability density function (pdf) generated by a stochastic model conditioned by noisy data. This pdf can be either a joint posterior that describes the evolution of the state of…

Data Analysis, Statistics and Probability · Physics 2016-08-08 Matthias Morzfeld , Daniel Hodyss

The accuracy of Earth system models is compromised by unknown and/or unresolved dynamics, making the quantification of systematic model errors essential. While a model parameter estimation, which allows parameters to change…

Methodology · Statistics 2023-10-04 Yohei Sawada , Le Duc

The Ensemble Kalman filter (EnKF) was introduced by Evensen in 1994 [10] as a novel method for data assimilation: state estimation for noisily observed time-dependent problems. Since that time it has had enormous impact in many application…

Optimization and Control · Mathematics 2013-04-08 Marco A. Iglesias , Kody J. H. Law , Andrew M. Stuart

Contemporary data assimilation often involves more than a million prediction variables. Ensemble Kalman filters (EnKF) have been developed by geoscientists. They are successful indispensable tools in science and engineering, because they…

Probability · Mathematics 2017-05-26 Andrew J. Majda , Xin T. Tong

In this paper, we propose and develop a methodology for nonlinear systems health monitoring by modeling the damage and degradation mechanism dynamics as "slow" states that are augmented with the system "fast" dynamical states. This…

Systems and Control · Computer Science 2017-10-17 Najmeh Daroogheh , Nader Meskin , Khashayar Khorasani

We propose a new class of filtering and smoothing methods for inference in high-dimensional, nonlinear, non-Gaussian, spatio-temporal state-space models. The main idea is to combine the ensemble Kalman filter and smoother, developed in the…

Methodology · Statistics 2019-03-22 Matthias Katzfuss , Jonathan R. Stroud , Christopher K. Wikle