English
Related papers

Related papers: Adjoint-Free 4D-Var Methods Via Line Search Optimi…

200 papers

Parameter estimation has a high importance in the geosciences. The ensemble Kalman filter (EnKF) allows parameter estimation for large, time-dependent systems. For large systems, the EnKF is applied using small ensembles, which may lead to…

Applications · Statistics 2021-08-05 Johannes Keller , Harrie-Jan Hendricks Franssen , Wolfgang Nowak

Ensemble Kalman methods were initially developed to solve nonlinear data assimilation problems in oceanography, but are now popular in applications far beyond their original use cases. Of particular interest is climate model calibration. As…

Data Analysis, Statistics and Probability · Physics 2025-11-21 Rebecca Gjini , Matthias Morzfeld , Oliver R. A. Dunbar , Tapio Schneider

This work develops a new multifidelity ensemble Kalman filter (MFEnKF) algorithm based on linear control variate framework. The approach allows for rigorous multifidelity extensions of the EnKF, where the uncertainty in coarser fidelities…

Numerical Analysis · Mathematics 2020-07-03 Andrey A Popov , Changhong Mou , Traian Iliescu , Adrian Sandu

Accurate data assimilation (DA) for systems with piecewise-smooth or discontinuous state variables remains a significant challenge, as conventional covariance-based ensemble Kalman filter approaches often fail to effectively balance…

Numerical Analysis · Mathematics 2025-10-09 Tongtong Li , Anne Gelb , Yoonsang Lee

The Kalman filter (KF) is one of the most widely used tools for data assimilation and sequential estimation. In this work, we show that the state estimates from the KF in a standard linear dynamical system setting are equivalent to those…

Methodology · Statistics 2021-08-04 Maria Jahja , David C. Farrow , Roni Rosenfeld , Ryan J. Tibshirani

Ensemble Kalman Filtering (EnKF) is a popular technique for data assimilation, with far ranging applications. However, the vanilla EnKF framework is not well-defined when perturbations are nonlinear. We study two non-linear extensions of…

Machine Learning · Statistics 2024-09-24 Zachariah Malik , Romit Maulik

State estimation in multi-layer turbulent flow fields with only a single layer of partial observation remains a challenging yet practically important task. Applications include inferring the state of the deep ocean by exploiting surface…

Fluid Dynamics · Physics 2025-09-30 Zhongrui Wang , Nan Chen , Di Qi

A newly introduced stochastic data assimilation method, the Ensemble Kalman Filter Semi-Qualitative (EnKF-SQ) is applied to a realistic coupled ice-ocean model of the Arctic, the TOPAZ4 configuration, in a twin experiment framework. The…

Applications · Statistics 2020-01-08 Abhishek Shah , Laurent Bertino , Francois Counillon , Mohamad El Gharamti , Jiping Xie

This paper tackles the intricate task of jointly estimating state and parameters in data assimilation for stochastic dynamical systems that are affected by noise and observed only partially. While the concept of ``optimal filtering'' serves…

Optimization and Control · Mathematics 2023-12-19 Feng Bao , Guannan Zhang , Zezhong Zhang

This paper presents a data-driven approach for designing state observers for continuous-time nonlinear systems, where an extended dynamic mode decomposition (EDMD) procedure is used to identify an approximate linear lifted model. Since such…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Xiuzhen Ye , Wentao Tang

Data assimilation methods aim at estimating the state of a system by combining observations with a physical model. When sequential data assimilation is considered, the joint distribution of the latent state and the observations is described…

Methodology · Statistics 2018-04-23 Thi Tuyet Trang Chau , Pierre Ailliot , Valérie Monbet , Pierre Tandeo

We propose a Dynamical Low-Rank Ensemble Kalman Filter (DLR-ENKF) for efficient joint state-parameter estimation in high-dimensional dynamical systems. The method extends the DLR-ENKF formulation of arXiv:2509.11210 to the augmented…

Numerical Analysis · Mathematics 2026-02-09 Fabio Nobile , Sébastien Riffaud , Thomas Trigo Trindade

The ensemble Kalman filter (EnKF) is a popular technique for performing inference in state-space models (SSMs), particularly when the dynamic process is high-dimensional. Unlike reweighting methods such as sequential Monte Carlo (SMC, i.e.…

A key a priori information used in 4DVar is the knowledge of the system's evolution equations. In this paper we propose a method for taking full advantage of the knowledge of the system's dynamical instabilities in order to improve the…

Chaotic Dynamics · Physics 2009-11-18 Anna Trevisan , Massimo D'Isidoro , Olivier Talagrand

Ensemble Kalman inversion is a parallelizable derivative-free method to solve inverse problems. The method uses an ensemble that follows the Kalman update formula iteratively to solve an optimization problem. The ensemble size is crucial to…

Numerical Analysis · Mathematics 2021-05-25 Yoonsang Lee

Ensemble Kalman filter techniques are widely used to assimilate observations into dynamical models. The phase space dimension is typically much larger than the number of ensemble members which leads to inaccurate results in the computed…

Numerical Analysis · Mathematics 2010-01-22 Kay Bergemann , Sebastian Reich

Over the years data assimilation methods have been developed to obtain estimations of uncertain model parameters by taking into account a few observations of a model state. The most reliable methods of MCMC are computationally expensive.…

Applications · Statistics 2018-11-14 Sangeetika Ruchi , Svetlana Dubinkina

It was recently found with the aid of machine learning that for a variety of toy data assimilation systems with chaotic Lorenz-96 model it is possible to achieve a nearly-optimal data assimilation without carrying the state error covariance…

Chaotic Dynamics · Physics 2025-01-24 Pavel Sakov

We introduce cooperative sequential state space estimation in the domain of augmented complex statistics, whereby nodes in a network collaborate locally to estimate noncircular complex signals. For rigour, a distributed augmented (widely…

Systems and Control · Computer Science 2013-11-19 Dahir H. Dini , Sithan Kanna , Danilo P. Mandic

The intersection between classical data assimilation methods and novel machine learning techniques has attracted significant interest in recent years. Here we explore another promising solution in which diffusion models are used to…

Mathematical Physics · Physics 2024-04-02 Feng Bao , Hristo G. Chipilski , Siming Liang , Guannan Zhang , Jeffrey S. Whitaker