English
Related papers

Related papers: Latent-EnSF: A Latent Ensemble Score Filter for Hi…

200 papers

Data assimilation provides algorithms for widespread applications in various fields. It is of practical use to deal with a large amount of information in the complex system that is hard to estimate. Weather forecasting is one of the…

Optimization and Control · Mathematics 2023-03-23 Yihua Yang

An Ensemble Kalman Filter (EnKF, the predictor) is used make a large change in the state, followed by a Particle Filer (PF, the corrector) which assigns importance weights to describe non-Gaussian distribution. The weights are obtained by…

Computation · Statistics 2009-07-20 Jan Mandel , Jonathan D. Beezley

Data assimilation is an iterative approach to the problem of estimating the state of a dynamical system using both current and past observations of the system together with a model for the system's time evolution. Rather than solving the…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Brian R. Hunt , Eric J. Kostelich , Istvan Szunyogh

The ensemble Kalman filter (EnKF) is a widely used methodology for state estimation in partial, noisily observed dynamical systems, and for parameter estimation in inverse problems. Despite its widespread use in the geophysical sciences,…

Numerical Analysis · Mathematics 2016-09-21 Claudia Schillings , Andrew M. Stuart

Machine learning techniques have seen a tremendous rise in popularity in weather and climate sciences. Data assimilation (DA), which combines observations and numerical models, has great potential to incorporate machine learning and…

Machine Learning · Computer Science 2024-03-20 Feiyu Lu

The ensemble Kalman filter (EnKF) is a Monte Carlo based implementation of the Kalman filter (KF) for extremely high-dimensional, possibly nonlinear and non-Gaussian state estimation problems. Its ability to handle state dimensions in the…

Methodology · Statistics 2018-02-12 Michael Roth , Gustaf Hendeby , Carsten Fritsche , Fredrik Gustafsson

Nonlinear/non-Gaussian filtering has broad applications in many areas of life sciences where either the dynamic is nonlinear and/or the probability density function of uncertain state is non-Gaussian. In such problems, the accuracy of the…

Computation · Statistics 2012-08-02 Hatef Monajemi , Peter K. Kitanidis

Data-driven modelling techniques provide a method for deriving models of dynamical systems directly from complicated data streams. However, tracking and forecasting such data streams poses a significant challenge to most methods, as they…

Dynamical Systems · Mathematics 2025-03-25 Stephen A Falconer , David J. B. Lloyd , Naratip Santitissadeekorn

We address the problem of observation noise misspecification in Bayesian filtering of dynamical systems via recent advances in generalised Bayesian inference. Mis-match in tail decay between the true data generating process and an assumed…

Statistics Theory · Mathematics 2026-05-27 Hans Reimann , Sebastian Reich

Ensemble data assimilation in flood forecasting depends strongly on the density, frequency and statistics of errors associated with the observation network. This work focuses on the assimilation of 2D flood extent data, expressed in terms…

Image and Video Processing · Electrical Eng. & Systems 2023-05-24 Thanh Huy Nguyen , Sophie Ricci , Andrea Piacentini , Raquel Rodriguez Suquet , Gwendoline Blanchet , Santiago Pena Luque , Peter Kettig

In this work, we study the emergence of sparsity and multiway structures in second-order statistical characterizations of dynamical processes governed by partial differential equations (PDEs). We consider several state-of-the-art multiway…

Machine Learning · Statistics 2021-12-09 Yu Wang , Alfred Hero

We consider filtering in high-dimensional non-Gaussian state-space models with intractable transition kernels, nonlinear and possibly chaotic dynamics, and sparse observations in space and time. We propose a novel filtering methodology that…

Methodology · Statistics 2022-04-07 Alessio Spantini , Ricardo Baptista , Youssef Marzouk

We explore the potential of Data-Assimilation (DA) within the multi-scale framework of a shell model of turbulence, with a focus on the Ensemble Kalman Filter (EnKF). The central objective is to understand how measuring mesoscales (i.e.,…

Fluid Dynamics · Physics 2026-01-15 Francesco Fossella , Luca Biferale , Alberto Carrassi , Massimo Cencini , Vikrant Gupta

The ensemble Kalman filter (EnKF) is widely used for nonlinear and high-dimensional state estimation because it replaces complex covariance propagation with simple ensemble statistics. However, conventional EnKF implementations can become…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Shida Jiang , Shengyu Tao , Zihe Liu , Scott Moura

Data assimilation methods aim at estimating the state of a system by combining observations with a physical model. When sequential data assimilation is considered, the joint distribution of the latent state and the observations is described…

Methodology · Statistics 2018-04-23 Thi Tuyet Trang Chau , Pierre Ailliot , Valérie Monbet , Pierre Tandeo

The Ensemble Kalman Filter (EnKF) is a widely used method for data assimilation in high-dimensional systems, with an ensemble update step equivalent to an empirical version of the Matheron update popular in Gaussian process regression -- a…

Machine Learning · Computer Science 2025-09-19 Dan MacKinlay

Ensemble methods, such as the ensemble Kalman filter (EnKF), the local ensemble transform Kalman filter (LETKF), and the ensemble Kalman smoother (EnKS) are widely used in sequential data assimilation, where state vectors are of huge…

Probability · Mathematics 2019-01-03 El houcine Bergou , Serge Gratton , Jan Mandel

We propose a new type of the Ensemble Kalman Filter (EnKF), which uses the Fast Fourier Transform (FFT) for covariance estimation from a very small ensemble with automatic tapering, and for a fast computation of the analysis ensemble by…

Atmospheric and Oceanic Physics · Physics 2011-08-01 Jan Mandel , Jonathan D. Beezley , Volodymyr Y. Kondratenko

State-of-the-art ensemble Kalman filtering (EnKF) algorithms require incorporating localization techniques to cope with the rank deficiency and the inherited spurious correlations in their error covariance matrices. Localization techniques…

Atmospheric and Oceanic Physics · Physics 2026-03-05 Boujemaa Ait-El-Fquih , Ibrahim Hoteit

Data assimilation is a Bayesian inference process that obtains an enhanced understanding of a physical system of interest by fusing information from an inexact physics-based model, and from noisy sparse observations of reality. The…

Optimization and Control · Mathematics 2021-03-12 Andrey A Popov , Adrian Sandu