English
Related papers

Related papers: AI-based data assimilation: Learning the functiona…

200 papers

In recent years, Artificial Intelligence Weather Prediction (AIWP) models have achieved performance comparable to, or even surpassing, traditional Numerical Weather Prediction (NWP) models by leveraging reanalysis data. However, a…

Atmospheric and Oceanic Physics · Physics 2024-12-25 Pengcheng Zhao , Jiang Bian , Zekun Ni , Weixin Jin , Jonathan Weyn , Zuliang Fang , Siqi Xiang , Haiyu Dong , Bin Zhang , Hongyu Sun , Kit Thambiratnam , Qi Zhang

We identify a strong equivalence between neural network based machine learning (ML) methods and the formulation of statistical data assimilation (DA), known to be a problem in statistical physics. DA, as used widely in physical and…

Machine Learning · Computer Science 2017-10-23 H. D. I. Abarbanel , P. J. Rozdeba , S. Shirman

The Data Assimilation (DA) community has been developing various diagnostics to understand the importance of the observing system in accurately forecasting the weather. They usually rely on the ability to compute the derivatives of the…

Atmospheric and Oceanic Physics · Physics 2025-11-03 Patrick Laloyaux , Mihai Alexe , Eulalie Boucher , Peter Lean , Ewan Pinnington , Simon Lang , Tobias Necker , Anthony McNally

Variational data assimilation and deep learning share many algorithmic aspects in common. While the former focuses on system state estimation, the latter provides great inductive biases to learn complex relationships. We here design a…

Machine Learning · Computer Science 2022-11-18 Arthur Filoche , Julien Brajard , Anastase Charantonis , Dominique Béréziat

Four-dimensional variational data assimilation (4D-Var) on a seasonal-to-interdecadal time scale under the existence of unstable modes can be viewed as an optimization problem of synchronized, coupled chaotic systems. The problem is tackled…

Data Analysis, Statistics and Probability · Physics 2015-11-17 Nozomi Sugiura , Shuhei Masuda , Yosuke Fujii , Masafumi Kamachi , Yoichi Ishikawa , Toshiyuki Awaji

Data-driven prediction and physics-agnostic machine-learning methods have attracted increased interest in recent years achieving forecast horizons going well beyond those to be expected for chaotic dynamical systems. In a separate strand of…

Data Analysis, Statistics and Probability · Physics 2021-05-19 Georg A. Gottwald , Sebastian Reich

An essential component of therapeutic drug/biomarker monitoring (TDM) is to combine patient data with prior knowledge for model-based predictions of therapy outcomes. Current Bayesian forecasting tools typically rely only on the most…

Quantitative Methods · Quantitative Biology 2019-09-23 Corinna Maier , Niklas Hartung , Jana de Wiljes , Charlotte Kloft , Wilhelm Huisinga

A non-intrusive data assimilation methodology is developed to improve the statistical predictions of large-eddy simulations (LES). The ensemble-variational (EnVar) approach aims to minimize a cost function that is defined as the discrepancy…

Fluid Dynamics · Physics 2021-09-28 Vincent Mons , Yifan Du , Tamer A. Zaki

This paper presents a reduced-order approach for four-dimensional variational data assimilation, based on a prior EO F analysis of a model trajectory. This method implies two main advantages: a natural model-based definition of a mul…

Data assimilation (DA) plays a pivotal role in diverse applications, ranging from climate predictions and weather forecasts to trajectory planning for autonomous vehicles. A prime example is the widely used ensemble Kalman filter (EnKF),…

Dynamical Systems · Mathematics 2024-01-03 Mohamad Abed El Rahman Hammoud , Naila Raboudi , Edriss S. Titi , Omar Knio , Ibrahim Hoteit

We present the mathematical framework of a Domain Decomposition (DD) aproach based on Parallel-in-Time methods (PinT-based approach) for solving the 4D-Var Data Assimilation (DA) model. The main outcome of the proposed DD PinT-based…

Numerical Analysis · Mathematics 2018-07-20 Luisa D'Amore , Rosalba Cacciapuoti

The weather and climate domains are undergoing a significant transformation thanks to advances in AI-based foundation models such as FourCastNet, GraphCast, ClimaX and Pangu-Weather. While these models show considerable potential, they are…

Machine Learning · Computer Science 2024-07-18 Junqi Yin , Siming Liang , Siyan Liu , Feng Bao , Hristo G. Chipilski , Dan Lu , Guannan Zhang

Data assimilation (DA) estimates the state of an evolving dynamical system from noisy, partial observations, and is widely used in scientific simulation as well as weather and climate science. In practice, filtering methods rely on…

Image and Video Processing · Electrical Eng. & Systems 2026-05-15 Yixuan Jia , Siyi Chen , Yida Pan , Xiao Li , Lianghe Shi , Chanyong Jung , Haijie Yuan , Ismail Alkhouri , Yue Cynthia Wu , Saiprasad Ravishankar , Jeffrey A Fessler , Qing Qu

Modern deep learning techniques, which mimic traditional numerical weather prediction (NWP) models and are derived from global atmospheric reanalysis data, have caused a significant revolution within a few years. In this new paradigm, our…

Artificial Intelligence · Computer Science 2024-02-14 Minjong Cheon , Daehyun Kang , Yo-Hwan Choi , Seon-Yu Kang

Data assimilation method consists in combining all available pieces of information about a system to obtain optimal estimates of initial states. The different sources of information are weighted according to their accuracy by the means of…

Data Analysis, Statistics and Probability · Physics 2014-04-30 Angélique Ponçot , Jean-Philippe Argaud , Bertrand Bouriquet , Patrick Erhard , Serge Gratton , Olivier Thual

Data assimilation (DA) plays a pivotal role in numerical weather prediction by systematically integrating sparse observations with model forecasts to estimate optimal atmospheric initial condition for forthcoming forecasts. Traditional…

Atmospheric and Oceanic Physics · Physics 2025-10-28 Jing-An Sun , Hang Fan , Junchao Gong , Ben Fei , Kun Chen , Fenghua Ling , Wenlong Zhang , Wanghan Xu , Li Yan , Pierre Gentine , Lei Bai

Data assimilation addresses the general problem of how to combine model-based predictions with partial and noisy observations of the process in an optimal manner. This survey focuses on sequential data assimilation techniques using…

Numerical Analysis · Mathematics 2019-08-15 Sebastian Reich

Satellite observation operators play an essential role in atmospheric data assimilation by translating model state variables into observation space. Previous work has shown that deep-learned emulators can effectively predict the outputs of…

Advances in data assimilation (DA) methods have greatly improved the accuracy of Earth system predictions. To fuse multi-source data and reconstruct the nonlinear evolution missing from observations, geoscientists are developing…

Atmospheric and Oceanic Physics · Physics 2024-12-19 Qingyu Zheng , Guijun Han , Wei Li , Lige Cao , Gongfu Zhou , Haowen Wu , Qi Shao , Ru Wang , Xiaobo Wu , Xudong Cui , Hong Li , Xuan Wang

Recent advances in data assimilation (DA) have focused on developing more flexible approaches that can better accommodate nonlinearities in models and observations. However, it remains unclear how the performance of these advanced methods…

Atmospheric and Oceanic Physics · Physics 2025-05-08 Zixiang Xiong , Siming Liang , Feng Bao , Guannan Zhang , Hristo G. Chipilski