English
Related papers

Related papers: Nonlinear ensemble filtering with diffusion models…

200 papers

We propose an ensemble score filter (EnSF) for solving high-dimensional nonlinear filtering problems with superior accuracy. A major drawback of existing filtering methods, e.g., particle filters or ensemble Kalman filters, is the low…

Machine Learning · Statistics 2024-08-14 Feng Bao , Zezhong Zhang , Guannan Zhang

Data assimilation plays a pivotal role in understanding and predicting turbulent systems within geoscience and weather forecasting, where data assimilation is used to address three fundamental challenges, i.e., high-dimensionality,…

Atmospheric and Oceanic Physics · Physics 2025-01-23 Siming Liang , Hoang Tran , Feng Bao , Hristo G. Chipilski , Peter Jan van Leeuwen , Guannan Zhang

Data assimilation combines information from models, measurements, and priors to estimate the state of a dynamical system such as the atmosphere. The Ensemble Kalman filter (EnKF) is a family of ensemble-based data assimilation approaches…

Computational Engineering, Finance, and Science · Computer Science 2014-12-09 Ahmed Attia , Adrian Sandu

Accurate modeling and prediction of complex physical systems often rely on data assimilation techniques to correct errors inherent in model simulations. Traditional methods like the Ensemble Kalman Filter (EnKF) and its variants as well as…

Machine Learning · Computer Science 2024-09-12 Phillip Si , Peng Chen

Ensemble methods such as the Ensemble Kalman Filter (EnKF) are widely used for data assimilation in large-scale geophysical applications, as for example in numerical weather prediction (NWP). There is a growing interest for physical models…

Applications · Statistics 2018-08-01 Sylvain Robert , Hans R. Künsch

This work introduces a new, distributed implementation of the Ensemble Kalman Filter (EnKF) that allows for non-sequential assimilation of large datasets in high-dimensional problems. The traditional EnKF algorithm is computationally…

Machine Learning · Statistics 2023-11-23 Cédric Travelletti , Jörg Franke , David Ginsbourger , Stefan Brönnimann

Ensemble Kalman Filtering (EnKF) is a popular technique for data assimilation, with far ranging applications. However, the vanilla EnKF framework is not well-defined when perturbations are nonlinear. We study two non-linear extensions of…

Machine Learning · Statistics 2024-09-24 Zachariah Malik , Romit Maulik

The Ensemble Score Filter (EnSF) has emerged as a promising approach to leverage score-based diffusion models for solving high-dimensional and nonlinear data assimilation problems. While initial applications of EnSF to the Lorenz-96 model…

Numerical Analysis · Mathematics 2025-10-24 Zezhong Zhang , Feng Bao , Guannan Zhang

Ensemble data assimilation methods such as the Ensemble Kalman Filter (EnKF) are a key component of probabilistic weather forecasting. They represent the uncertainty in the initial conditions by an ensemble which incorporates information…

Applications · Statistics 2018-10-17 Sylvain Robert , Daniel Leuenberger , Hans R. Künsch

The ensemble Kalman filter (EnKF) is widely used for data assimilation in high-dimensional systems, but its performance often deteriorates for strongly nonlinear dynamics due to the structural mismatch between the Kalman update and the…

Machine Learning · Computer Science 2026-04-30 Xin T. Tong , Yanyan Wang , Liang Yan

Data assimilation (DA) is a key component of many forecasting models in science and engineering. DA allows one to estimate better initial conditions using an imperfect dynamical model of the system and noisy/sparse observations available…

Machine Learning · Computer Science 2023-02-01 Ashesh Chattopadhyay , Ebrahim Nabizadeh , Eviatar Bach , Pedram Hassanzadeh

The Gaussian process state-space models (GPSSMs) represent a versatile class of data-driven nonlinear dynamical system models. However, the presence of numerous latent variables in GPSSM incurs unresolved issues for existing variational…

Machine Learning · Computer Science 2024-07-23 Zhidi Lin , Yiyong Sun , Feng Yin , Alexandre Hoang Thiéry

We study the ensemble Kalman filter (EnKF) algorithm for sequential data assimilation in a general situation, that is, for nonlinear forecast and measurement models with non-additive and non-Gaussian noises. Such applications traditionally…

Methodology · Statistics 2018-08-17 Weixuan Li , W. Steven Rosenthal , Guang Lin

Numerical modeling and simulation of two-phase flow in porous media is challenging due to the uncertainties in key parameters, such as permeability. To address these challenges, we propose a computational framework by utilizing the novel…

Numerical Analysis · Mathematics 2025-05-13 Ruoyu Hu , Sanjeeb Poudel , Feng Bao , Sanghyun Lee

The ensemble Kalman filter (EnKF) is a data assimilation technique that uses an ensemble of models, updated with data, to track the time evolution of a usually non-linear system. It does so by using an empirical approximation to the…

Applications · Statistics 2021-03-12 Elizabeth Hou , Earl Lawrence , Alfred O. Hero

Over the years data assimilation methods have been developed to obtain estimations of uncertain model parameters by taking into account a few observations of a model state. The most reliable methods of MCMC are computationally expensive.…

Applications · Statistics 2018-11-14 Sangeetika Ruchi , Svetlana Dubinkina

Data assimilation (DA) for compressible flows with shocks is challenging because many classical DA methods generate spurious oscillations and nonphysical features near uncertain shocks. We focus here on the ensemble Kalman filter (EnKF). We…

Ensemble transform Kalman filtering (ETKF) data assimilation is often used to combine available observations with numerical simulations to obtain statistically accurate and reliable state representations in dynamical systems. However, it is…

Numerical Analysis · Mathematics 2024-03-07 Tongtong Li , Anne Gelb , Yoonsang Lee

Ensemble Kalman filter (EnKF) is an important data assimilation method for high dimensional geophysical systems. Efficient implementation of EnKF in practice often involves the localization technique, which updates each component using only…

Probability · Mathematics 2018-04-04 Xin T. Tong

We introduce a score-filter-enhanced data assimilation framework designed to reduce predictive uncertainty in machine learning (ML) models for data-driven dynamical system forecasting. Machine learning serves as an efficient numerical model…

Dynamical Systems · Mathematics 2026-03-17 Jingqiao Tang , Ryan Bausback , Feng Bao , Guannan Zhang , Phuoc-Toan Huynh
‹ Prev 1 2 3 10 Next ›