English
Related papers

Related papers: Predictability of weakly turbulent systems from sp…

200 papers

Data assimilation (DA) is a fundamental component of modern weather prediction, yet it remains a major computational bottleneck in machine learning (ML)-based forecasting pipelines due to reliance on traditional variational methods. Recent…

Machine Learning · Computer Science 2026-02-09 Ran Cheng , Lailai Zhu

Marine biogeochemistry models are critical for forecasting, as well as estimating ecosystem responses to climate change and human activities. Data assimilation (DA) improves these models by aligning them with real-world observations, but…

Atmospheric and Oceanic Physics · Physics 2025-04-08 Ieuan Higgs , Ross Bannister , Jozef Skákala , Alberto Carrassi , Stefano Ciavatta

In this article we develop algorithms for data assimilation based upon a computational time dependent stable/unstable splitting. Our particular method is based upon shadowing refinement and synchronization techniques and is motivated by…

Dynamical Systems · Mathematics 2017-07-31 Bart de Leeuw , Svetlana Dubinkina , Jason Frank , Andrew Steyer , Xuemin Tu , Erik Van Vleck

We identify a strong equivalence between neural network based machine learning (ML) methods and the formulation of statistical data assimilation (DA), known to be a problem in statistical physics. DA, as used widely in physical and…

Machine Learning · Computer Science 2017-10-23 H. D. I. Abarbanel , P. J. Rozdeba , S. Shirman

In recent years, machine learning (ML) has been proposed to devise data-driven parametrisations of unresolved processes in dynamical numerical models. In most cases, the ML training leverages high-resolution simulations to provide a dense,…

Computational Physics · Physics 2020-12-09 Julien Brajard , Alberto Carrassi , Marc Bocquet , Laurent Bertino

Data assimilation addresses the problem of identifying plausible state trajectories of dynamical systems given noisy or incomplete observations. In geosciences, it presents challenges due to the high-dimensionality of geophysical dynamical…

Machine Learning · Statistics 2023-11-03 François Rozet , Gilles Louppe

The accuracy of simulation-based forecasting in chaotic systems is heavily dependent on high-quality estimates of the system state at the time the forecast is initialized. Data assimilation methods are used to infer these initial conditions…

Machine Learning · Computer Science 2021-11-02 Michael McCabe , Jed Brown

Data assimilation (DA) aims to estimate the full state of a dynamical system by combining partial and noisy observations with a prior model forecast, commonly referred to as the background. In atmospheric applications, this problem is…

Atmospheric and Oceanic Physics · Physics 2025-05-29 Jing-An Sun , Hang Fan , Junchao Gong , Ben Fei , Kun Chen , Fenghua Ling , Wenlong Zhang , Wanghan Xu , Li Yan , Pierre Gentine , Lei Bai

Data assimilation (DA) aims at forecasting the state of a dynamical system by combining a mathematical representation of the system with noisy observations taking into account their uncertainties. State of the art methods are based on the…

Machine Learning · Computer Science 2023-05-26 Pierre Boudier , Anthony Fillion , Serge Gratton , Selime Gürol , Sixin Zhang

Data assimilation (DA) integrates observations with a dynamical model to estimate states of PDE-governed systems. Model-driven methods (e.g., Kalman, particle) presuppose full knowledge of the true dynamics, which is not always satisfied in…

Signal Processing · Electrical Eng. & Systems 2025-06-06 Siyi Chen , Yixuan Jia , Qing Qu , He Sun , Jeffrey A Fessler

Data assimilation (DA) plays a pivotal role in numerical weather prediction by systematically integrating sparse observations with model forecasts to estimate optimal atmospheric initial condition for forthcoming forecasts. Traditional…

Atmospheric and Oceanic Physics · Physics 2025-10-28 Jing-An Sun , Hang Fan , Junchao Gong , Ben Fei , Kun Chen , Fenghua Ling , Wenlong Zhang , Wanghan Xu , Li Yan , Pierre Gentine , Lei Bai

Obtaining accurate high-resolution representations of model outputs is essential to describe the system dynamics. In general, however, only spatially- and temporally-coarse observations of the system states are available. These observations…

Dynamical Systems · Mathematics 2022-11-08 Mohamad Abed El Rahman Hammoud , Olivier LeMaitre , Edriss S. Titi , Ibrahim Hoteit , Omar Knio

We propose two new methods based/inspired by machine learning for tabular data and distance-free localization to enhance the covariance estimations in an ensemble data assimilation. The main goal is to enhance the data assimilation results…

Machine Learning · Computer Science 2025-07-31 Vinicius L. S. Silva , Gabriel S. Seabra , Alexandre A. Emerick

Using a very cheap Data Assimilation (DA) method, I show an alternative approach to classical DA for numerical climate models which produce a large amount of "big data". The problematic features of state-of-the-art high resolution Regional…

Applications · Statistics 2016-10-12 Bijan Fallah

Machine/deep learning models have been widely adopted for predicting the configuration performance of software systems. However, a crucial yet unaddressed challenge is how to cater for the sparsity inherited from the configuration…

Software Engineering · Computer Science 2024-11-21 Jingzhi Gong , Tao Chen , Rami Bahsoon

We investigate the ability to discover data assimilation (DA) schemes meant for chaotic dynamics with deep learning. The focus is on learning the analysis step of sequential DA, from state trajectories and their observations, using a simple…

Reduced-order modelling and low-dimensional surrogate models generated using machine learning algorithms have been widely applied in high-dimensional dynamical systems to improve the algorithmic efficiency. In this paper, we develop a…

Data-driven prediction and physics-agnostic machine-learning methods have attracted increased interest in recent years achieving forecast horizons going well beyond those to be expected for chaotic dynamical systems. In a separate strand of…

Data Analysis, Statistics and Probability · Physics 2021-05-19 Georg A. Gottwald , Sebastian Reich

Data assimilation is a central problem in many geophysical applications, such as weather forecasting. It aims to estimate the state of a potentially large system, such as the atmosphere, from sparse observations, supplemented by prior…

Machine Learning · Computer Science 2024-06-24 Matthieu Blanke , Ronan Fablet , Marc Lelarge

This paper studies the role of sparse regularization in a properly chosen basis for variational data assimilation (VDA) problems. Specifically, it focuses on data assimilation of noisy and down-sampled observations while the state variable…

Data Analysis, Statistics and Probability · Physics 2014-06-25 A. M. Ebtehaj , M. Zupanski , G. Lerman , E. Foufoula-Georgiou