English
Related papers

Related papers: FlowDAS: A Stochastic Interpolant-based Framework …

200 papers

Data Assimilation is a cornerstone of atmospheric system modeling, tasked with reconstructing system states by integrating sparse, noisy observations with prior estimation. While traditional approaches like variational and ensemble Kalman…

Machine Learning · Computer Science 2025-11-04 Hao Wang , Zixuan Weng , Jindong Han , Wei Fan , Hao Liu

Data assimilation (DA) aims to estimate the full state of a dynamical system by combining partial and noisy observations with a prior model forecast, commonly referred to as the background. In atmospheric applications, this problem is…

Atmospheric and Oceanic Physics · Physics 2025-05-29 Jing-An Sun , Hang Fan , Junchao Gong , Ben Fei , Kun Chen , Fenghua Ling , Wenlong Zhang , Wanghan Xu , Li Yan , Pierre Gentine , Lei Bai

Data assimilation aims to estimate the states of a dynamical system by optimally combining sparse and noisy observations of the physical system with uncertain forecasts produced by a computational model. The states of many dynamical systems…

Optimization and Control · Mathematics 2024-05-08 Amit N. Subrahmanya , Andrey A. Popov , Reid J. Gomillion , Adrian Sandu

Robust integration of physical knowledge and data is key to improve computational simulations, such as Earth system models. Data assimilation is crucial for achieving this goal because it provides a systematic framework to calibrate model…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Yongquan Qu , Juan Nathaniel , Shuolin Li , Pierre Gentine

Data assimilation, in its most comprehensive form, addresses the Bayesian inverse problem of identifying plausible state trajectories that explain noisy or incomplete observations of stochastic dynamical systems. Various approaches have…

Machine Learning · Computer Science 2023-11-01 François Rozet , Gilles Louppe

Data assimilation (DA) combines partial observations with dynamical models to improve state estimation. Filter-based DA uses only past and present data and is the prerequisite for real-time forecasts. Smoother-based DA exploits both past…

Systems and Control · Electrical Eng. & Systems 2026-01-21 Marios Andreou , Nan Chen , Yingda Li

We propose closed-form conditional diffusion models for data assimilation. Diffusion models use data to learn the score function (defined as the gradient of the log-probability density of a data distribution), allowing them to generate new…

Machine Learning · Statistics 2026-04-02 Brianna Binder , Agnimitra Dasgupta , Assad Oberai

Data assimilation has become a key technique for combining physical models with observational data to estimate state variables. However, classical assimilation algorithms often struggle with the high nonlinearity present in both physical…

Machine Learning · Computer Science 2025-07-22 Zhuoyuan Li , Bin Dong , Pingwen Zhang

The generation of initial conditions via accurate data assimilation is crucial for weather forecasting and climate modeling. We propose DiffDA as a denoising diffusion model capable of assimilating atmospheric variables using predicted…

Computational Engineering, Finance, and Science · Computer Science 2024-06-11 Langwen Huang , Lukas Gianinazzi , Yuejiang Yu , Peter D. Dueben , Torsten Hoefler

Chaos is ubiquitous in physical systems. The associated sensitivity to initial conditions is a significant obstacle in forecasting the weather and other geophysical fluid flows. Data assimilation is the process whereby the uncertainty in…

Data Analysis, Statistics and Probability · Physics 2020-11-03 Alberto Carrassi , Marc Bocquet , Jonathan Demaeyer , Colin Grudzien , Patrick Raanes , Stephane Vannitsem

We investigate the ability to discover data assimilation (DA) schemes meant for chaotic dynamics with deep learning. The focus is on learning the analysis step of sequential DA, from state trajectories and their observations, using a simple…

Data Assimilation (DA) is a computational tool that uses value from the model and the real measurement to arrive to an optimally acceptable value. Rather, this technique relies on the idea of Kalman gain. We point out that DA has two…

Optimization and Control · Mathematics 2020-12-15 Mohammad N. Murshed , Zarin Subah , M. Monir Uddin

State estimation in multi-layer turbulent flow fields with only a single layer of partial observation remains a challenging yet practically important task. Applications include inferring the state of the deep ocean by exploiting surface…

Fluid Dynamics · Physics 2025-09-30 Zhongrui Wang , Nan Chen , Di Qi

Data assimilation, consisting in the combination of a dynamical model with a set of noisy and incomplete observations in order to infer the state of a system over time, involves uncertainty in most settings. Building upon an existing…

Machine Learning · Computer Science 2026-03-02 Anthony Frion , David S Greenberg

Data assimilation (DA) aims at optimally merging observational data and model outputs to create a coherent statistical and dynamical picture of the system under investigation. Indeed, DA aims at minimizing the effect of observational and…

Data Analysis, Statistics and Probability · Physics 2022-01-05 Yumeng Chen , Alberto Carrassi , Valerio Lucarini

Data assimilation (DA) integrates observations with model forecasts to produce optimized atmospheric states, whose physical consistency is critical for stable weather forecasting and reliable climate research. Traditional Bayesian DA…

Atmospheric and Oceanic Physics · Physics 2026-03-05 Hang Fan , Lei Bai , Ben Fei , Yi Xiao , Kun Chen , Yubao Liu , Yongquan Qu , Fenghua Ling , Pierre Gentine

Approaches based on Koopman operators have shown great promise in forecasting time series data generated by complex nonlinear dynamical systems (NLDS). Although such approaches are able to capture the latent state representation of a NLDS,…

Machine Learning · Computer Science 2024-10-01 Ashutosh Singh , Ashish Singh , Tales Imbiriba , Deniz Erdogmus , Ricardo Borsoi

The accuracy of simulation-based forecasting in chaotic systems is heavily dependent on high-quality estimates of the system state at the time the forecast is initialized. Data assimilation methods are used to infer these initial conditions…

Machine Learning · Computer Science 2021-11-02 Michael McCabe , Jed Brown

Prediction of chaotic systems relies on a floating fusion of sensor data (observations) with a numerical model to decide on a good system trajectory and to compensate nonlinear feedback effects. Ensemble-based data assimilation (DA) is a…

Computational Engineering, Finance, and Science · Computer Science 2020-11-26 Sebastian Friedemann , Bruno Raffin

Collecting real-world optical flow datasets is a formidable challenge due to the high cost of labeling. A shortage of datasets significantly constrains the real-world performance of optical flow models. Building virtual datasets that…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Miaojie Feng , Longliang Liu , Hao Jia , Gangwei Xu , Xin Yang