English
Related papers

Related papers: Comparing an Ensemble Kalman Filter to a 4DVAR Dat…

200 papers

A novel method, based on the combination of data assimilation and machine learning is introduced. The new hybrid approach is designed for a two-fold scope: (i) emulating hidden, possibly chaotic, dynamics and (ii) predicting their future…

Machine Learning · Statistics 2020-07-27 Julien Brajard , Alberto Carassi , Marc Bocquet , Laurent Bertino

We address the problem of observation noise misspecification in Bayesian filtering of dynamical systems via recent advances in generalised Bayesian inference. Mis-match in tail decay between the true data generating process and an assumed…

Statistics Theory · Mathematics 2026-05-27 Hans Reimann , Sebastian Reich

Prediction of spatio-temporal chaotic systems is important in various fields, such as Numerical Weather Prediction (NWP). While data assimilation methods have been applied in NWP, machine learning techniques, such as Reservoir Computing…

Machine Learning · Computer Science 2020-06-26 Futo Tomizawa , Yohei Sawada

Accurate estimation and forecasting of energy consumption are important for power-system operation, planning, and demand-side management. In practice, however, complete and timely measurements may not always be available, and the observed…

Machine Learning · Computer Science 2026-05-29 Ruoyu Hu , Dahai Yu , Feng Bao , Guang Wang , Guannan Zhang

The Ensemble Kalman filter assumes the observations to be Gaussian random variables with a pre-specified mean and variance. In practice, observations may also have detection limits, for instance when a gauge has a minimum or maximum value.…

Optimization and Control · Mathematics 2018-11-14 Abhishek Shah , Mohamad El Gharamti , Laurent Bertino

In this study, two classes of methods including statistical and variational data assimilation algorithms will be described. In statistical methods, the model state is updated sequentially based on the previous estimate. Variational methods,…

Systems and Control · Electrical Eng. & Systems 2021-10-25 Loc Luong

Many modern algorithms for inverse problems and data assimilation rely on ensemble Kalman updates to blend prior predictions with observed data. Ensemble Kalman methods often perform well with a small ensemble size, which is essential in…

Machine Learning · Statistics 2024-01-05 Omar Al Ghattas , Daniel Sanz-Alonso

Data assimilation techniques are widely used to predict complex dynamical systems with uncertainties, based on time-series observation data. Error covariance matrices modelling is an important element in data assimilation algorithms which…

Machine Learning · Computer Science 2021-11-15 Sibo Cheng , Mingming Qiu

State estimation is a fundamental problem in control and signal processing, for which the Kalman Filter provides an optimal solution under linear dynamics, Gaussian noise, and known noise covariances. However, these assumptions often fail…

Machine Learning · Computer Science 2026-05-27 Vasileios Saketos , Ming Xiao

Data assimilation, consisting in the combination of a dynamical model with a set of noisy and incomplete observations in order to infer the state of a system over time, involves uncertainty in most settings. Building upon an existing…

Machine Learning · Computer Science 2026-03-02 Anthony Frion , David S Greenberg

Artificial intelligence (AI)-based weather prediction research is growing rapidly and has shown to be competitive with the advanced dynamic numerical weather prediction models. However, research combining AI-based weather prediction models…

Machine Learning · Computer Science 2025-10-16 Shunji Kotsuki , Kenta Shiraishi , Atsushi Okazaki

Data assimilation (DA) is a key component of many forecasting models in science and engineering. DA allows one to estimate better initial conditions using an imperfect dynamical model of the system and noisy/sparse observations available…

Machine Learning · Computer Science 2023-02-01 Ashesh Chattopadhyay , Ebrahim Nabizadeh , Eviatar Bach , Pedram Hassanzadeh

Data assimilation is the task to combine evolution models and observational data in order to produce reliable predictions. In this paper, we focus on ensemble-based recursive data assimilation problems. Our main contribution is a hybrid…

Numerical Analysis · Mathematics 2016-02-26 Nawinda Chustagulprom , Sebastian Reich , Maria Reinhardt

Data assimilation is a method that combines observations (that is, real world data) of a state of a system with model output for that system in order to improve the estimate of the state of the system and thereby the model output. The model…

Numerical Analysis · Mathematics 2020-05-18 Melina A. Freitag

This work introduces a new class of four-dimensional variational data assimilation (4D-Var) methods grounded in data-consistent inversion (DCI) theory. The methods extend classical 4D-Var by incorporating a predictability-aware…

Numerical Analysis · Mathematics 2025-11-04 Rylan Spence , Troy Butler , Clint Dawson

Data assimilation techniques are often confronted with challenges handling complex high dimensional physical systems, because high precision simulation in complex high dimensional physical systems is computationally expensive and the exact…

Mathematical Software · Computer Science 2024-09-04 Sibo Cheng , Jinyang Min , Che Liu , Rossella Arcucci

Estimating the state of a dynamical system from partial and noisy observations is a ubiquitous problem in a large number of applications, such as probabilistic weather forecasting and prediction of epidemics. Particle filters are a widely…

Statistics Theory · Mathematics 2025-03-21 E. Calvello , J. A. Carrillo , F. Hoffmann , P. Monmarché , A. M. Stuart , U. Vaes

In this paper we consider filtering and smoothing of partially observed chaotic dynamical systems that are discretely observed, with an additive Gaussian noise in the observation. These models are found in a wide variety of real…

Methodology · Statistics 2018-02-27 Daniel Paulin , Ajay Jasra , Dan Crisan , Alexandros Beskos

Ensemble data assimilation in flood forecasting depends strongly on the density, frequency and statistics of errors associated with the observation network. This work focuses on the assimilation of 2D flood extent data, expressed in terms…

Image and Video Processing · Electrical Eng. & Systems 2023-05-24 Thanh Huy Nguyen , Sophie Ricci , Andrea Piacentini , Raquel Rodriguez Suquet , Gwendoline Blanchet , Santiago Pena Luque , Peter Kettig

Accurate knowledge of time-variation in meridional flow-speed and profile is crucial for estimating a solar cycle's features, which are ultimately responsible for causing space climate variations. However, no consensus has been reached yet…

Solar and Stellar Astrophysics · Physics 2014-08-22 Mausumi Dikpati , Jeffrey L. Anderson , Dhrubaditya Mitra