English
Related papers

Related papers: Machine Learning as Statistical Data Assimilation

200 papers

We formulate a strong equivalence between machine learning, artificial intelligence methods and the formulation of statistical data assimilation as used widely in physical and biological sciences. The correspondence is that layer number in…

Artificial Intelligence · Computer Science 2017-07-06 Henry Abarbanel , Paul Rozdeba , Sasha Shirman

In recent years, machine learning (ML) has been proposed to devise data-driven parametrisations of unresolved processes in dynamical numerical models. In most cases, the ML training leverages high-resolution simulations to provide a dense,…

Computational Physics · Physics 2020-12-09 Julien Brajard , Alberto Carrassi , Marc Bocquet , Laurent Bertino

The recent surge in machine learning (ML) methods for geophysical modeling has raised the question of how these methods might be applied to data assimilation (DA). We focus on diffusion modeling (a form of generative artificial…

Atmospheric and Oceanic Physics · Physics 2025-08-29 Daniel Hodyss , Matthias Morzfeld

Data assimilation is a method that combines observations (that is, real world data) of a state of a system with model output for that system in order to improve the estimate of the state of the system and thereby the model output. The model…

Numerical Analysis · Mathematics 2020-05-18 Melina A. Freitag

A novel strategy is proposed to improve the accuracy of state estimation and reconstruction from low-fidelity models and sparse data from sensors. This strategy combines ensemble Data Assimilation (DA) and Machine Learning (ML) tools,…

Fluid Dynamics · Physics 2025-01-31 Miguel M. Valero , Marcello Meldi

Marine biogeochemistry models are critical for forecasting, as well as estimating ecosystem responses to climate change and human activities. Data assimilation (DA) improves these models by aligning them with real-world observations, but…

Atmospheric and Oceanic Physics · Physics 2025-04-08 Ieuan Higgs , Ross Bannister , Jozef Skákala , Alberto Carrassi , Stefano Ciavatta

Data assimilation (DA) aims at forecasting the state of a dynamical system by combining a mathematical representation of the system with noisy observations taking into account their uncertainties. State of the art methods are based on the…

Machine Learning · Computer Science 2023-05-26 Pierre Boudier , Anthony Fillion , Serge Gratton , Selime Gürol , Sixin Zhang

Data assimilation (DA) integrates observations with model forecasts to produce optimized atmospheric states, whose physical consistency is critical for stable weather forecasting and reliable climate research. Traditional Bayesian DA…

Atmospheric and Oceanic Physics · Physics 2026-03-05 Hang Fan , Lei Bai , Ben Fei , Yi Xiao , Kun Chen , Yubao Liu , Yongquan Qu , Fenghua Ling , Pierre Gentine

A method of data assimilation (DA) is employed to estimate electrophysiological parameters of neurons simultaneously with their synaptic connectivity in a small model biological network. The DA procedure is cast as an optimization, with a…

Neurons and Cognition · Quantitative Biology 2020-02-05 Eve Armstrong

Data Assimilation (DA) and Uncertainty quantification (UQ) are extensively used in analysing and reducing error propagation in high-dimensional spatial-temporal dynamics. Typical applications span from computational fluid dynamics (CFD) to…

Data assimilation (DA) enables hydrologic models to update their internal states using near-real-time observations for more accurate forecasts. With deep neural networks like long short-term memory (LSTM), using either lagged observations…

Fluid Dynamics · Physics 2025-02-25 Amirmoez Jamaat , Yalan Song , Farshid Rahmani , Jiangtao Liu , Kathryn Lawson , Chaopeng Shen

Data-driven methods have demonstrated strong predictive capabilities in fluid mechanics, yet most current applications still focus on simplified configurations, often characterised by statistical stationarity or limited temporal…

Fluid Dynamics · Physics 2025-11-21 Miguel M. Valero , Marcello Meldi

Data assimilation (DA) is integrated with machine learning in order to perform entirely data-driven online state estimation. To achieve this, recurrent neural networks (RNNs) are implemented as surrogate models to replace key components of…

Data assimilation (DA) in the geophysical sciences remains the cornerstone of robust forecasts from numerical models. Indeed, DA plays a crucial role in the quality of numerical weather prediction, and is a crucial building block that has…

Deep Learning (DL) is considered the state-of-the-art in computer vision, speech recognition and natural language processing. Until recently, it was also widely accepted that DL is irrelevant for learning tasks on tabular data, especially…

Machine Learning · Computer Science 2021-06-30 Karim Lounici , Katia Meziani , Benjamin Riu

Deep learning (DL) techniques are highly effective for defect detection from images. Training DL classification models, however, requires vast amounts of labeled data which is often expensive to collect. In many cases, not only the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Adrian Shuai Li , Elisa Bertino , Rih-Teng Wu , Ting-Yan Wu

Data assimilation (DA) aims to estimate the full state of a dynamical system by combining partial and noisy observations with a prior model forecast, commonly referred to as the background. In atmospheric applications, this problem is…

Atmospheric and Oceanic Physics · Physics 2025-05-29 Jing-An Sun , Hang Fan , Junchao Gong , Ben Fei , Kun Chen , Fenghua Ling , Wenlong Zhang , Wanghan Xu , Li Yan , Pierre Gentine , Lei Bai

Data assimilation is a central problem in many geophysical applications, such as weather forecasting. It aims to estimate the state of a potentially large system, such as the atmosphere, from sparse observations, supplemented by prior…

Machine Learning · Computer Science 2024-06-24 Matthieu Blanke , Ronan Fablet , Marc Lelarge

This paper is a contribution in the context of variational data assimilation combined with statistical learning. The framework of data assimilation traditionally uses data collected at sensor locations in order to bring corrections to a…

Numerical Analysis · Mathematics 2023-05-09 Amina Benaceur , Barbara Verfürth

In statistical data assimilation (SDA) and supervised machine learning (ML), we wish to transfer information from observations to a model of the processes underlying those observations. For SDA, the model consists of a set of differential…

Data Analysis, Statistics and Probability · Physics 2020-01-22 Zheng Fang , Adrian S. Wong , Kangbo Hao , Alexander J. A. Ty , Henry D. I. Abarbanel
‹ Prev 1 2 3 10 Next ›