English
Related papers

Related papers: Latent Autoencoder Ensemble Kalman Filter for Nonl…

200 papers

The ensemble Kalman filter (EnKF) is a widely used methodology for state estimation in partial, noisily observed dynamical systems, and for parameter estimation in inverse problems. Despite its widespread use in the geophysical sciences,…

Numerical Analysis · Mathematics 2016-09-21 Claudia Schillings , Andrew M. Stuart

Machine learning techniques have seen a tremendous rise in popularity in weather and climate sciences. Data assimilation (DA), which combines observations and numerical models, has great potential to incorporate machine learning and…

Machine Learning · Computer Science 2024-03-20 Feiyu Lu

The intersection between classical data assimilation methods and novel machine learning techniques has attracted significant interest in recent years. Here we explore another promising solution in which diffusion models are used to…

Mathematical Physics · Physics 2024-04-02 Feng Bao , Hristo G. Chipilski , Siming Liang , Guannan Zhang , Jeffrey S. Whitaker

Accurate structural response prediction forms a main driver for structural health monitoring and control applications. This often requires the proposed model to adequately capture the underlying dynamics of complex structural systems. In…

Machine Learning · Computer Science 2023-07-04 Wei Liu , Zhilu Lai , Kiran Bacsa , Eleni Chatzi

The ensemble Kalman filter (EnKF) is a popular technique for performing inference in state-space models (SSMs), particularly when the dynamic process is high-dimensional. Unlike reweighting methods such as sequential Monte Carlo (SMC, i.e.…

Data assimilation is a Bayesian inference process that obtains an enhanced understanding of a physical system of interest by fusing information from an inexact physics-based model, and from noisy sparse observations of reality. The…

Optimization and Control · Mathematics 2021-03-12 Andrey A Popov , Adrian Sandu

Although data assimilation originates from control theory, the relationship between modern data assimilation methods in geoscience and model predictive control has not been extensively explored. In the present paper, I discuss that the…

Geophysics · Physics 2024-10-21 Yohei Sawada

The ensemble Kalman filter (EnKF) is an efficient algorithm for many data assimilation problems. In certain circumstances, however, divergence of the EnKF might be spotted. In previous studies, the authors proposed an…

Atmospheric and Oceanic Physics · Physics 2014-08-19 Xiaodong Luo , Ibrahim Hoteit

Data assimilation (DA) for compressible flows with shocks is challenging because many classical DA methods generate spurious oscillations and nonphysical features near uncertain shocks. We focus here on the ensemble Kalman filter (EnKF). We…

Ensemble methods such as the Ensemble Kalman Filter (EnKF) are widely used for data assimilation in large-scale geophysical applications, as for example in numerical weather prediction (NWP). There is a growing interest for physical models…

Applications · Statistics 2018-08-01 Sylvain Robert , Hans R. Künsch

The ensemble Kalman filter (EnKF) is a method for combining a dynamical model with data in a sequential fashion. Despite its widespread use, there has been little analysis of its theoretical properties. Many of the algorithmic innovations…

Probability · Mathematics 2015-06-17 D. T. B. Kelly , K. J. H. Law , A. M. Stuart

The iterative ensemble Kalman filter (IEnKF) is widely used in inverse problems to estimate system parameters from limited observations. However, the IEnKF, when applied to nonlinear systems, can be plagued by poor convergence. Here we…

Optimization and Control · Mathematics 2019-10-11 Jiacheng Wu , Jian-Xun Wang , Shawn C. Shadden

Data assimilation plays a key role in large-scale atmospheric weather forecasting, where the state of the physical system is estimated from model outputs and observations, and is then used as initial condition to produce accurate future…

Methodology · Statistics 2018-02-13 Azam Moosavi , Ahmed Attia , Adrian Sandu

Ensemble Kalman Filtering (EnKF) is a popular technique for data assimilation, with far ranging applications. However, the vanilla EnKF framework is not well-defined when perturbations are nonlinear. We study two non-linear extensions of…

Machine Learning · Statistics 2024-09-24 Zachariah Malik , Romit Maulik

The ensemble Kalman filter (EnKF) is a Monte Carlo based implementation of the Kalman filter (KF) for extremely high-dimensional, possibly nonlinear and non-Gaussian state estimation problems. Its ability to handle state dimensions in the…

Methodology · Statistics 2018-02-12 Michael Roth , Gustaf Hendeby , Carsten Fritsche , Fredrik Gustafsson

This paper tackles the intricate task of jointly estimating state and parameters in data assimilation for stochastic dynamical systems that are affected by noise and observed only partially. While the concept of ``optimal filtering'' serves…

Optimization and Control · Mathematics 2023-12-19 Feng Bao , Guannan Zhang , Zezhong Zhang

We present a new type of the EnKF for data assimilation in spatial models that uses diagonal approximation of the state covariance in the wavelet space to achieve adaptive localization. The efficiency of the new method is demonstrated on an…

Dynamical Systems · Mathematics 2011-03-01 Jonathan D. Beezley , Jan Mandel , Loren Cobb

Data assimilation (DA) aims to optimally combine model forecasts and observations that are both partial and noisy. Multi-model DA generalizes the variational or Bayesian formulation of the Kalman filter, and we prove that it is also the…

Methodology · Statistics 2023-01-23 Eviatar Bach , Michael Ghil

Performing Data Assimilation (DA) at a low cost is of prime concern in Earth system modeling, particularly at the time of big data where huge quantities of observations are available. Capitalizing on the ability of Neural Networks…

Machine Learning · Computer Science 2021-11-24 Mathis Peyron , Anthony Fillion , Selime Gürol , Victor Marchais , Serge Gratton , Pierre Boudier , Gael Goret

State-of-the-art ensemble Kalman filtering (EnKF) algorithms require incorporating localization techniques to cope with the rank deficiency and the inherited spurious correlations in their error covariance matrices. Localization techniques…

Atmospheric and Oceanic Physics · Physics 2026-03-05 Boujemaa Ait-El-Fquih , Ibrahim Hoteit