English
Related papers

Related papers: An Improved Data Assimilation Scheme for High Dime…

200 papers

A modification scheme to the ensemble Kalman filter (EnKF) is introduced based on the concept of the unscented transform (Julier et al., 2000; Julier and Uhlmann, 2004), which therefore will be called the ensemble unscented Kalman filter…

Atmospheric and Oceanic Physics · Physics 2009-11-30 X. Luo , I. M. Moroz

Many recent advances in sequential assimilation of data into nonlinear high-dimensional models are modifications to particle filters which employ efficient searches of a high-dimensional state space. In this work, we present a complementary…

Dynamical Systems · Mathematics 2020-12-10 John Maclean , Elaine T Spiller

Contemporary data assimilation often involves more than a million prediction variables. Ensemble Kalman filters (EnKF) have been developed by geoscientists. They are successful indispensable tools in science and engineering, because they…

Probability · Mathematics 2017-05-26 Andrew J. Majda , Xin T. Tong

Recently developed particle flow algorithms provide an alternative to importance sampling for drawing particles from a posterior distribution, and a number of particle filters based on this principle have been proposed. Samples are drawn…

Computation · Statistics 2014-12-01 Pete Bunch , Simon Godsill

We propose a nonparametric density estimator based on the Gaussian process (GP) and derive three novel closed form learning algorithms based on Fisher divergence (FD) score matching. The density estimator is formed by multiplying a base…

Machine Learning · Computer Science 2025-11-17 John Paisley , Wei Zhang , Brian Barr

Gaussian-process state-space models (GP-SSMs) provide a flexible nonparametric alternative for modeling time-series dynamics that are nonlinear or difficult to specify parametrically. While the Kalman filter is effective for linear-Gaussian…

Methodology · Statistics 2025-12-02 Genshiro Kitagawa

The ensemble Kalman filter is widely used in applications because, for high dimensional filtering problems, it has a robustness that is not shared for example by the particle filter; in particular it does not suffer from weight collapse.…

Optimization and Control · Mathematics 2024-08-29 J. A. Carrillo , F. Hoffmann , A. M. Stuart , U. Vaes

This paper proposes two practical implementations of Four-Dimensional Variational (4D-Var) Ensemble Kalman Filter (4D-EnKF) methods for non-linear data assimilation. Our formulations' main idea is to avoid the intrinsic need for adjoint…

Applications · Statistics 2023-05-05 Elias Nin-Ruiz , Jairo Diaz-Rodriguez

Compressed Estimation approaches, such as the Generalised Compressed Kalman Filter (GCKF), reduce the computational cost and complexity of high dimensional and high frequency data assimilation problems; usually without sacrificing…

Systems and Control · Computer Science 2018-11-21 Karan Narula , Jose Guivant

An incremental/online state dynamic learning method is proposed for identification of the nonlinear Gaussian state space models. The method embeds the stochastic variational sparse Gaussian process as the probabilistic state dynamic model…

Machine Learning · Statistics 2016-08-31 Vahid Bastani , Lucio Marcenaro , Carlo Regazzoni

Estimating the state of a dynamical system from partial and noisy observations is a ubiquitous problem in a large number of applications, such as probabilistic weather forecasting and prediction of epidemics. Particle filters are a widely…

Statistics Theory · Mathematics 2025-03-21 E. Calvello , J. A. Carrillo , F. Hoffmann , P. Monmarché , A. M. Stuart , U. Vaes

The Ensemble Score Filter (EnSF) has emerged as a promising approach to leverage score-based diffusion models for solving high-dimensional and nonlinear data assimilation problems. While initial applications of EnSF to the Lorenz-96 model…

Numerical Analysis · Mathematics 2025-10-24 Zezhong Zhang , Feng Bao , Guannan Zhang

Heavy tails is a common feature of filtering distributions that results from the nonlinear dynamical and observation processes as well as the uncertainty from physical sensors. In these settings, the Kalman filter and its ensemble version -…

Computation · Statistics 2023-10-16 Mathieu Le Provost , Ricardo Baptista , Jeff D. Eldredge , Youssef Marzouk

The Kalman filter (KF) provides optimal recursive state estimates for linear-Gaussian systems and underpins applications in control, signal processing, and others. However, it is vulnerable to outliers in the measurements and process noise.…

Systems and Control · Electrical Eng. & Systems 2025-07-02 Alan Yang , Stephen Boyd

The ensemble Kalman filter (EnKF) is widely used to sample a probability density function (pdf) generated by a stochastic model conditioned by noisy data. This pdf can be either a joint posterior that describes the evolution of the state of…

Data Analysis, Statistics and Probability · Physics 2016-08-08 Matthias Morzfeld , Daniel Hodyss

A data-driven investigation of the flow around a high-rise building is performed combining heterogeneous experimental samples and RANS CFD. The coupling is performed using techniques based on the Ensemble Kalman Filter (EnKF), including…

Fluid Dynamics · Physics 2023-01-27 Lucas Villanueva , Miguel Martinez Valero , Anina Sarkic Glumac , Marcello Meldi

Data assimilation is the process of estimating the state of a dynamical system over time by combining model predictions with measurements. This task becomes challenging when the system is nonlinear and high-dimensional. To address this,…

Machine Learning · Statistics 2026-05-22 Eunbi Yoon , Won Chang , Donghan Kim , Dae Wook Kim

State-of-the-art ensemble Kalman filtering (EnKF) algorithms require incorporating localization techniques to cope with the rank deficiency and the inherited spurious correlations in their error covariance matrices. Localization techniques…

Atmospheric and Oceanic Physics · Physics 2026-03-05 Boujemaa Ait-El-Fquih , Ibrahim Hoteit

In this paper, the problem of state estimation, in the context of both filtering and smoothing, for nonlinear state-space models is considered. Due to the nonlinear nature of the models, the state estimation problem is generally intractable…

Machine Learning · Statistics 2021-11-24 Jarrad Courts , Adrian Wills , Thomas B. Schön

State estimation for nonlinear state space models (SSMs) is a challenging task. Existing assimilation methodologies predominantly assume Gaussian posteriors on physical space, where true posteriors become inevitably non-Gaussian. We propose…

Machine Learning · Computer Science 2025-06-02 Yuta Tarumi , Keisuke Fukuda , Shin-ichi Maeda
‹ Prev 1 3 4 5 6 7 10 Next ›