English
Related papers

Related papers: Efficient high-dimensional variational data assimi…

200 papers

Data Assimilation is a cornerstone of atmospheric system modeling, tasked with reconstructing system states by integrating sparse, noisy observations with prior estimation. While traditional approaches like variational and ensemble Kalman…

Machine Learning · Computer Science 2025-11-04 Hao Wang , Zixuan Weng , Jindong Han , Wei Fan , Hao Liu

Data-Augmentation (DA) is known to improve performance across tasks and datasets. We propose a method to theoretically analyze the effect of DA and study questions such as: how many augmented samples are needed to correctly estimate the…

Machine Learning · Computer Science 2022-02-18 Randall Balestriero , Ishan Misra , Yann LeCun

Data Assimilation (DA) and Uncertainty quantification (UQ) are extensively used in analysing and reducing error propagation in high-dimensional spatial-temporal dynamics. Typical applications span from computational fluid dynamics (CFD) to…

The idea of using machine learning (ML) methods to reconstruct the dynamics of a system is the topic of recent studies in the geosciences, in which the key output is a surrogate model meant to emulate the dynamical model. In order to treat…

Machine Learning · Statistics 2021-09-22 Alban Farchi , Patrick Laloyaux , Massimo Bonavita , Marc Bocquet

Advances in data assimilation (DA) methods have greatly improved the accuracy of Earth system predictions. To fuse multi-source data and reconstruct the nonlinear evolution missing from observations, geoscientists are developing…

Atmospheric and Oceanic Physics · Physics 2024-12-19 Qingyu Zheng , Guijun Han , Wei Li , Lige Cao , Gongfu Zhou , Haowen Wu , Qi Shao , Ru Wang , Xiaobo Wu , Xudong Cui , Hong Li , Xuan Wang

We apply two data assimilation (DA) methods, a smoother and a filter, and a model-free machine learning (ML) shallow network to forecast two weakly turbulent systems. We analyse the effect of the spatial sparsity of observations on accuracy…

Fluid Dynamics · Physics 2024-07-16 Vikrant Gupta , Yuanqing Chen , Minping Wan

Data assimilation of observational data into full atmospheric states is essential for weather forecast model initialization. Recently, methods for deep generative data assimilation have been proposed which allow for using new input data…

This paper is a contribution in the context of variational data assimilation combined with statistical learning. The framework of data assimilation traditionally uses data collected at sensor locations in order to bring corrections to a…

Numerical Analysis · Mathematics 2023-05-09 Amina Benaceur , Barbara Verfürth

Long-range geophysical forecasts are fundamentally limited by chaotic dynamics and numerical errors. While data assimilation can mitigate these issues, classical variational smoothers require computationally expensive tangent-linear and…

Machine Learning · Computer Science 2026-02-24 Phillip Si , Peng Chen

Data assimilation (DA) methods combine model predictions with observational data to improve state estimation in dynamical systems, inspiring their increasingly prominent role in geophysical and climate applications. Classical DA methods…

Numerical Analysis · Mathematics 2025-10-23 Lizuo Liu , Tongtong Li , Anne Gelb

We commonly refer to state-estimation theory in geosciences as data assimilation. This term encompasses the entire sequence of operations that, starting from the observations of a system, and from additional statistical and dynamical…

Atmospheric and Oceanic Physics · Physics 2018-06-11 Alberto Carrassi , Marc Bocquet , Laurent Bertino , Geir Evensen

Prediction of the state evolution of complex high-dimensional nonlinear systems is challenging due to the nonlinear sensitivity of the evolution to small inaccuracies in the model. Data Assimilation (DA) techniques improve state estimates…

Data Analysis, Statistics and Probability · Physics 2023-07-10 Aishah Albarakati , Marko Budisic , Erik Van Vleck

Continuous data assimilation (CDA) is successfully implemented for the first time for efficient dynamical downscaling of a global atmospheric reanalysis. A comparison of the performance of CDA with the standard grid and spectral nudging…

Atmospheric and Oceanic Physics · Physics 2019-07-31 Srinivas Desamsetti , Hari Prasad Dasari , Sabique Langodan , Edriss S Titi , Omar Knio , Ibrahim Hoteit

Data assimilation is a fundamental task in updating forecasting models upon observing new data, with applications ranging from weather prediction to online reinforcement learning. Deep generative forecasting models (DGFMs) have shown…

Machine Learning · Statistics 2025-11-25 Shreya Sinha-Roy , Richard G. Everitt , Christian P. Robert , Ritabrata Dutta

Data assimilation (DA) integrates observations with a dynamical model to estimate states of PDE-governed systems. Model-driven methods (e.g., Kalman, particle) presuppose full knowledge of the true dynamics, which is not always satisfied in…

Signal Processing · Electrical Eng. & Systems 2025-06-06 Siyi Chen , Yixuan Jia , Qing Qu , He Sun , Jeffrey A Fessler

Data assimilation (DA) addresses the problem of sequentially estimating the state of a dynamical system from noisy and incomplete observations. In this work, we employ a diffusion model as a world model to simulate and predict the system's…

Machine Learning · Statistics 2026-05-26 Lifu Wei , Yinuo Ren , Naichen Shi , Yiping Lu

The use of machine learning (ML) models in meteorology has attracted significant attention for their potential to improve weather forecasting efficiency and accuracy. GraphCast and NeuralGCM, two promising ML-based weather models, are at…

Atmospheric and Oceanic Physics · Physics 2024-11-25 Xiaoxu Tian , Daniel Holdaway , Daryl Kleist

Data assimilation (DA) combines partial observations with dynamical models to improve state estimation. Filter-based DA uses only past and present data and is the prerequisite for real-time forecasts. Smoother-based DA exploits both past…

Systems and Control · Electrical Eng. & Systems 2026-01-21 Marios Andreou , Nan Chen , Yingda Li

Domain adaptation (DA) is the task of classifying an unlabeled dataset (target) using a labeled dataset (source) from a related domain. The majority of successful DA methods try to directly match the distributions of the source and target…

Machine Learning · Statistics 2018-03-22 Twan van Laarhoven , Elena Marchiori

Variational data assimilation is a technique for combining measured data with dynamical models. It is a key component of Earth system state estimation and is commonly used in weather and ocean forecasting. The approach involves a…

Numerical Analysis · Mathematics 2026-04-30 I. Daužickaitė , M. A. Freitag , S. Gürol , A. S. Lawless , A. Ramage , J. A. Scott , J. M. Tabeart