English
Related papers

Related papers: Ensemble score filter with image inpainting for da…

200 papers

Accurate modeling and prediction of complex physical systems often rely on data assimilation techniques to correct errors inherent in model simulations. Traditional methods like the Ensemble Kalman Filter (EnKF) and its variants as well as…

Machine Learning · Computer Science 2024-09-12 Phillip Si , Peng Chen

Accurate estimation and forecasting of energy consumption are important for power-system operation, planning, and demand-side management. In practice, however, complete and timely measurements may not always be available, and the observed…

Machine Learning · Computer Science 2026-05-29 Ruoyu Hu , Dahai Yu , Feng Bao , Guang Wang , Guannan Zhang

The intersection between classical data assimilation methods and novel machine learning techniques has attracted significant interest in recent years. Here we explore another promising solution in which diffusion models are used to…

Mathematical Physics · Physics 2024-04-02 Feng Bao , Hristo G. Chipilski , Siming Liang , Guannan Zhang , Jeffrey S. Whitaker

We introduce a score-filter-enhanced data assimilation framework designed to reduce predictive uncertainty in machine learning (ML) models for data-driven dynamical system forecasting. Machine learning serves as an efficient numerical model…

Dynamical Systems · Mathematics 2026-03-17 Jingqiao Tang , Ryan Bausback , Feng Bao , Guannan Zhang , Phuoc-Toan Huynh

The Ensemble Score Filter (EnSF) has emerged as a promising approach to leverage score-based diffusion models for solving high-dimensional and nonlinear data assimilation problems. While initial applications of EnSF to the Lorenz-96 model…

Numerical Analysis · Mathematics 2025-10-24 Zezhong Zhang , Feng Bao , Guannan Zhang

Numerical modeling and simulation of two-phase flow in porous media is challenging due to the uncertainties in key parameters, such as permeability. To address these challenges, we propose a computational framework by utilizing the novel…

Numerical Analysis · Mathematics 2025-05-13 Ruoyu Hu , Sanjeeb Poudel , Feng Bao , Sanghyun Lee

Data assimilation techniques are crucial for accurately tracking complex dynamical systems by integrating observational data with numerical forecasts. Recently, score-based data assimilation methods emerged as powerful tools for…

Machine Learning · Statistics 2026-03-03 Pengpeng Xiao , Phillip Si , Peng Chen

We propose an ensemble score filter (EnSF) for solving high-dimensional nonlinear filtering problems with superior accuracy. A major drawback of existing filtering methods, e.g., particle filters or ensemble Kalman filters, is the low…

Machine Learning · Statistics 2024-08-14 Feng Bao , Zezhong Zhang , Guannan Zhang

Data assimilation (DA) estimates a dynamical system's state from noisy observations. Recent generative models like the ensemble score filter (EnSF) improve DA in high-dimensional nonlinear settings but are computationally expensive. We…

Machine Learning · Statistics 2025-09-30 Taos Transue , Bohan Chen , So Takao , Bao Wang

Data assimilation combines information from models, measurements, and priors to estimate the state of a dynamical system such as the atmosphere. The Ensemble Kalman filter (EnKF) is a family of ensemble-based data assimilation approaches…

Computational Engineering, Finance, and Science · Computer Science 2014-12-09 Ahmed Attia , Adrian Sandu

Ensemble methods such as the Ensemble Kalman Filter (EnKF) are widely used for data assimilation in large-scale geophysical applications, as for example in numerical weather prediction (NWP). There is a growing interest for physical models…

Applications · Statistics 2018-08-01 Sylvain Robert , Hans R. Künsch

Data assimilation (DA) is a key component of many forecasting models in science and engineering. DA allows one to estimate better initial conditions using an imperfect dynamical model of the system and noisy/sparse observations available…

Machine Learning · Computer Science 2023-02-01 Ashesh Chattopadhyay , Ebrahim Nabizadeh , Eviatar Bach , Pedram Hassanzadeh

Ensemble data assimilation methods such as the Ensemble Kalman Filter (EnKF) are a key component of probabilistic weather forecasting. They represent the uncertainty in the initial conditions by an ensemble which incorporates information…

Applications · Statistics 2018-10-17 Sylvain Robert , Daniel Leuenberger , Hans R. Künsch

A hybrid data assimilation algorithm is developed for complex dynamical systems with partial observations. The method starts with applying a spectral decomposition to the entire spatiotemporal fields, followed by creating a machine learning…

Computational Physics · Physics 2022-12-27 Changhong Mou , Leslie M. Smith , Nan Chen

This paper tackles the intricate task of jointly estimating state and parameters in data assimilation for stochastic dynamical systems that are affected by noise and observed only partially. While the concept of ``optimal filtering'' serves…

Optimization and Control · Mathematics 2023-12-19 Feng Bao , Guannan Zhang , Zezhong Zhang

The Ensemble Kalman filter assumes the observations to be Gaussian random variables with a pre-specified mean and variance. In practice, observations may also have detection limits, for instance when a gauge has a minimum or maximum value.…

Optimization and Control · Mathematics 2018-11-14 Abhishek Shah , Mohamad El Gharamti , Laurent Bertino

Data assimilation plays a key role in large-scale atmospheric weather forecasting, where the state of the physical system is estimated from model outputs and observations, and is then used as initial condition to produce accurate future…

Methodology · Statistics 2018-02-13 Azam Moosavi , Ahmed Attia , Adrian Sandu

Ensemble data assimilation in flood forecasting depends strongly on the density, frequency and statistics of errors associated with the observation network. This work focuses on the assimilation of 2D flood extent data, expressed in terms…

Image and Video Processing · Electrical Eng. & Systems 2023-05-24 Thanh Huy Nguyen , Sophie Ricci , Andrea Piacentini , Raquel Rodriguez Suquet , Gwendoline Blanchet , Santiago Pena Luque , Peter Kettig

Ensemble transform Kalman filtering (ETKF) data assimilation is often used to combine available observations with numerical simulations to obtain statistically accurate and reliable state representations in dynamical systems. However, it is…

Numerical Analysis · Mathematics 2024-03-07 Tongtong Li , Anne Gelb , Yoonsang Lee

Data assimilation (DA) integrates numerical model forecasts with observations to achieve the optimal state estimation. Ensemble-based methods, such as the ensemble Kalman filter (EnKF), are widely used for state estimation for…

Atmospheric and Oceanic Physics · Physics 2026-05-25 Zhou Yao , Zhilin Li , Li Zhao , Zeng Liu , Zhaokuan Lu , Seungnam Kim , Guangyao Wang
‹ Prev 1 2 3 10 Next ›