English
Related papers

Related papers: Exploring the structure of time-correlated model e…

200 papers

Data assimilation of atmospheric observations traditionally relies on variational and Kalman filter methods. Here, an alternative neural-network data assimilation (NNDA) with variational autoencoder (VAE) is proposed. The three-dimensional…

Atmospheric and Oceanic Physics · Physics 2024-04-29 Boštjan Melinc , Žiga Zaplotnik

Data assimilation (DA) is a fundamental component of modern weather prediction, yet it remains a major computational bottleneck in machine learning (ML)-based forecasting pipelines due to reliance on traditional variational methods. Recent…

Machine Learning · Computer Science 2026-02-09 Ran Cheng , Lailai Zhu

The understanding of nonlinear, high dimensional flows, e.g, atmospheric and ocean flows, is critical to address the impacts of global climate change. Data Assimilation techniques combine physical models and observational data, often in a…

Deep tabular models have demonstrated remarkable success on i.i.d. data, excelling in a variety of structured data tasks. However, their performance often deteriorates under temporal distribution shifts, where trends and periodic patterns…

Machine Learning · Computer Science 2025-12-04 Hao-Run Cai , Han-Jia Ye

Data assimilation (DA) integrates numerical model forecasts with observations to achieve the optimal state estimation. Ensemble-based methods, such as the ensemble Kalman filter (EnKF), are widely used for state estimation for…

Atmospheric and Oceanic Physics · Physics 2026-05-25 Zhou Yao , Zhilin Li , Li Zhao , Zeng Liu , Zhaokuan Lu , Seungnam Kim , Guangyao Wang

This paper addresses variational data assimilation from a learning point of view. Data assimilation aims to reconstruct the time evolution of some state given a series of observations, possibly noisy and irregularly-sampled. Using automatic…

Computational Physics · Physics 2021-11-10 Ronan Fablet , Bertrand Chapron , Lucas. Drumetz , Etienne Memin , Olivier Pannekoucke , Francois Rousseau

Data assimilation leads naturally to a Bayesian formulation in which the posterior probability distribution of the system state, given the observations, plays a central conceptual role. The aim of this paper is to use this Bayesian…

Data Analysis, Statistics and Probability · Physics 2013-01-01 K. J. H. Law , A. M. Stuart

Data assimilation (DA) aims at forecasting the state of a dynamical system by combining a mathematical representation of the system with noisy observations taking into account their uncertainties. State of the art methods are based on the…

Machine Learning · Computer Science 2023-05-26 Pierre Boudier , Anthony Fillion , Serge Gratton , Selime Gürol , Sixin Zhang

Real-time forecasting is important to the society. It uses continuous data streams to update forecasts for sustained accuracy. But the data source is vulnerable to attacks or accidents and the dynamics of forecasting failure and recovery…

Data Analysis, Statistics and Probability · Physics 2022-09-09 Sicheng Wu , Ruo-Qian Wang

In atmospheric and turbulent flow modeling, Large Eddy Simulation (LES) is often used to reduce computational cost, while observational data typically originates from the underlying physical system. Motivated by this setting, we study a…

Analysis of PDEs · Mathematics 2025-08-12 Adam Larios , Ali Pakzad , Nicholas White

An influential step in weather forecasting was the introduction of ensemble forecasts in operational use due to their capability to account for the uncertainties in the future state of the atmosphere. However, ensemble weather forecasts are…

Applications · Statistics 2023-05-25 Mária Lakatos , Sebastian Lerch , Stephan Hemri , Sándor Baran

Data assimilation (DA) is widely used to combine physical knowledge and observations. It is nowadays commonly used in geosciences to perform parametric calibration. In a context of climate change, old calibrations can not necessarily be…

Machine Learning · Statistics 2021-06-23 Rem-Sophia Mouradi , Cédric Goeury , Olivier Thual , Fabrice Zaoui , Pablo Tassi

Accurate estimation and forecasting of energy consumption are important for power-system operation, planning, and demand-side management. In practice, however, complete and timely measurements may not always be available, and the observed…

Machine Learning · Computer Science 2026-05-29 Ruoyu Hu , Dahai Yu , Feng Bao , Guang Wang , Guannan Zhang

Data assimilation is often viewed as a framework for correcting short-term error growth in dynamical climate model forecasts. When viewed on the time scales of climate however, these short-term corrections, or analysis increments, can…

Atmospheric and Oceanic Physics · Physics 2023-10-02 William Gregory , Mitchell Bushuk , Alistair Adcroft , Yongfei Zhang , Laure Zanna

The generation of initial conditions via accurate data assimilation is crucial for weather forecasting and climate modeling. We propose DiffDA as a denoising diffusion model capable of assimilating atmospheric variables using predicted…

Computational Engineering, Finance, and Science · Computer Science 2024-06-11 Langwen Huang , Lukas Gianinazzi , Yuejiang Yu , Peter D. Dueben , Torsten Hoefler

The accuracy of simulation-based forecasting in chaotic systems is heavily dependent on high-quality estimates of the system state at the time the forecast is initialized. Data assimilation methods are used to infer these initial conditions…

Machine Learning · Computer Science 2021-11-02 Michael McCabe , Jed Brown

Data assimilation (DA) plays a pivotal role in diverse applications, ranging from climate predictions and weather forecasts to trajectory planning for autonomous vehicles. A prime example is the widely used ensemble Kalman filter (EnKF),…

Dynamical Systems · Mathematics 2024-01-03 Mohamad Abed El Rahman Hammoud , Naila Raboudi , Edriss S. Titi , Omar Knio , Ibrahim Hoteit

Relevant comprehension of flood hazards has emerged as a crucial necessity, especially as the severity and the occurrence of flood events intensify with climate changes. Flood simulation and forecast capability have been greatly improved…

Image and Video Processing · Electrical Eng. & Systems 2022-11-18 Thanh Huy Nguyen , Anthéa Delmotte , Christophe Fatras , Peter Kettig , Andrea Piacentini , Sophie Ricci

While the formulation of most data assimilation schemes assumes an unbiased observation model error, in real applications, model error with nontrivial biases is unavoidable. A practical example is the error in the radiative transfer model…

Methodology · Statistics 2016-11-17 John Harlim , Tyrus Berry

An important class of nonlinear weighted least-squares problems arises from the assimilation of observations in atmospheric and ocean models. In variational data assimilation, inverse error covariance matrices define the weighting matrices…

Numerical Analysis · Mathematics 2022-12-06 Olivier Goux , Selime Gürol , Anthony T. Weaver , Oliver Guillet , Youssef Diouane