English
Related papers

Related papers: Coupling techniques for nonlinear ensemble filteri…

200 papers

We propose a new class of filtering and smoothing methods for inference in high-dimensional, nonlinear, non-Gaussian, spatio-temporal state-space models. The main idea is to combine the ensemble Kalman filter and smoother, developed in the…

Methodology · Statistics 2019-03-22 Matthias Katzfuss , Jonathan R. Stroud , Christopher K. Wikle

Ensemble methods such as the Ensemble Kalman Filter (EnKF) are widely used for data assimilation in large-scale geophysical applications, as for example in numerical weather prediction (NWP). There is a growing interest for physical models…

Applications · Statistics 2018-08-01 Sylvain Robert , Hans R. Künsch

Ensemble transform Kalman filtering (ETKF) data assimilation is often used to combine available observations with numerical simulations to obtain statistically accurate and reliable state representations in dynamical systems. However, it is…

Numerical Analysis · Mathematics 2024-03-07 Tongtong Li , Anne Gelb , Yoonsang Lee

The Ensemble Kalman Filter (EnKF), as a fundamental data assimilation approach, has been widely used in many fields of the sciences and engineering. When the state variable is of high dimensional accompanied with high resolution…

Methodology · Statistics 2025-09-18 Shouxia Wang , Hao-Xuan Sun , Song Xi Chen

The intersection between classical data assimilation methods and novel machine learning techniques has attracted significant interest in recent years. Here we explore another promising solution in which diffusion models are used to…

Mathematical Physics · Physics 2024-04-02 Feng Bao , Hristo G. Chipilski , Siming Liang , Guannan Zhang , Jeffrey S. Whitaker

Data assimilation combines dynamical models with observations to improve state estimates. Ensemble filters sequentially assimilate observations by updating a set of samples over time, alternating between a forecast and an analysis step.…

Computation · Statistics 2026-05-26 Mathieu Le Provost , Jan Glaubitz , Youssef Marzouk

We propose a generalised framework for the updating of a prior ensemble to a posterior ensemble, an essential yet challenging part in ensemble-based filtering methods. The proposed framework is based on a generalised and fully Bayesian view…

Methodology · Statistics 2021-03-29 Margrethe Kvale Loe , Håkon Tjelmeland

Ensemble Kalman Filtering (EnKF) is a popular technique for data assimilation, with far ranging applications. However, the vanilla EnKF framework is not well-defined when perturbations are nonlinear. We study two non-linear extensions of…

Machine Learning · Statistics 2024-09-24 Zachariah Malik , Romit Maulik

The filtering distribution captures the statistics of the state of a dynamical system from partial and noisy observations. Classical particle filters provably approximate this distribution in quite general settings; however they behave…

Statistics Theory · Mathematics 2025-02-10 Edoardo Calvello , Pierre Monmarché , Andrew M. Stuart , Urbain Vaes

In this paper, we propose and develop a methodology for nonlinear systems health monitoring by modeling the damage and degradation mechanism dynamics as "slow" states that are augmented with the system "fast" dynamical states. This…

Systems and Control · Computer Science 2017-10-17 Najmeh Daroogheh , Nader Meskin , Khashayar Khorasani

Nonlinear Bayesian update for a prior ensemble is proposed to extend traditional ensemble Kalman filtering to settings characterized by non-Gaussian priors and nonlinear measurement operators. In this framework, the observed component is…

Machine Learning · Statistics 2025-03-20 Yoonsang Lee

Although data assimilation originates from control theory, the relationship between modern data assimilation methods in geoscience and model predictive control has not been extensively explored. In the present paper, I discuss that the…

Geophysics · Physics 2024-10-21 Yohei Sawada

The ensemble Kalman filter (EnKF) is a Monte Carlo based implementation of the Kalman filter (KF) for extremely high-dimensional, possibly nonlinear and non-Gaussian state estimation problems. Its ability to handle state dimensions in the…

Methodology · Statistics 2018-02-12 Michael Roth , Gustaf Hendeby , Carsten Fritsche , Fredrik Gustafsson

Contemporary data assimilation often involves more than a million prediction variables. Ensemble Kalman filters (EnKF) have been developed by geoscientists. They are successful indispensable tools in science and engineering, because they…

Probability · Mathematics 2017-05-26 Andrew J. Majda , Xin T. Tong

Many dynamical systems are subjected to stochastic influences, such as random excitations, noise, and unmodeled behavior. Tracking the system's state and parameters based on a physical model is a common task for which filtering algorithms,…

Signal Processing · Electrical Eng. & Systems 2024-07-03 Jan Grashorn , Matteo Broggi , Ludovic Chamoin , Michael Beer

Many applications, such as intermittent data assimilation, lead to a recursive application of Bayesian inference within a Monte Carlo context. Popular data assimilation algorithms include sequential Monte Carlo methods and ensemble Kalman…

Numerical Analysis · Mathematics 2013-01-15 Sebastian Reich

We generalize the popular ensemble Kalman filter to an ensemble transform filter where the prior distribution can take the form of a Gaussian mixture or a Gaussian kernel density estimator. The design of the filter is based on a continuous…

Probability · Mathematics 2015-05-27 Sebastian Reich

The sample covariance matrix of a random vector is a good estimate of the true covariance matrix if the sample size is much larger than the length of the vector. In high-dimensional problems, this condition is never met. As a result, in…

Data Analysis, Statistics and Probability · Physics 2024-11-12 Michael Tsyrulnikov , Arseniy Sotskiy

Filtering - the task of estimating the conditional distribution for states of a dynamical system given partial and noisy observations - is important in many areas of science and engineering, including weather and climate prediction.…

Machine Learning · Computer Science 2025-03-25 Eviatar Bach , Ricardo Baptista , Enoch Luk , Andrew Stuart

The Ensemble Kalman Filter (EnKF) is a widely used method for data assimilation in high-dimensional systems, with an ensemble update step equivalent to an empirical version of the Matheron update popular in Gaussian process regression -- a…

Machine Learning · Computer Science 2025-09-19 Dan MacKinlay