English
Related papers

Related papers: Machine Learning as Statistical Data Assimilation

200 papers

Starting from limited measurements of a turbulent flow, data assimilation (DA) attempts to estimate all the spatio-temporal scales of motion. Success is dependent on whether the system is observable from the measurements, or how much of the…

Fluid Dynamics · Physics 2026-02-16 Andrew Cleary , Qi Wang , Tamer A. Zaki

Data assimilation (DA) is a fundamental computational technique that integrates numerical simulation models and observation data on the basis of Bayesian statistics. Originally developed for meteorology, especially weather forecasting, DA…

The data-aware method of distributions (DA-MD) is a low-dimension data assimilation procedure to forecast the behavior of dynamical systems described by differential equations. It combines sequential Bayesian update with the MD, such that…

Statistics Theory · Mathematics 2022-07-27 Francesca Boso , Daniel M. Tartakovsky

There has been a recent surge in development of accurate machine learning (ML) weather prediction models, but evaluation of these models has mainly been focused on medium-range forecasts, not their performance in cycling data assimilation…

Atmospheric and Oceanic Physics · Physics 2024-12-25 Laura C. Slivinski , Jeffrey S. Whitaker , Sergey Frolov , Timothy A. Smith , Niraj Agarwal

Data assimilation (DA) aims at optimally merging observational data and model outputs to create a coherent statistical and dynamical picture of the system under investigation. Indeed, DA aims at minimizing the effect of observational and…

Data Analysis, Statistics and Probability · Physics 2022-01-05 Yumeng Chen , Alberto Carrassi , Valerio Lucarini

Data assimilation (DA) solves the inverse problem of inferring initial conditions given data and a model. Here we use biophysically motivated Hodgkin-Huxley (HH) models of avian HVCI neurons, experimentally obtained recordings of these…

Neurons and Cognition · Quantitative Biology 2016-08-17 Daniel Breen , Sasha Shirman , Eve Armstrong , Nirag Kadakia , Henry Abarbanel

In several supervised learning scenarios, auxiliary losses are used in order to introduce additional information or constraints into the supervised learning objective. For instance, knowledge distillation aims to mimic outputs of a powerful…

Machine Learning · Computer Science 2022-12-08 Durga Sivasubramanian , Ayush Maheshwari , Pradeep Shenoy , Prathosh AP , Ganesh Ramakrishnan

Data assimilation (DA) methods combine model predictions with observational data to improve state estimation in dynamical systems, inspiring their increasingly prominent role in geophysical and climate applications. Classical DA methods…

Numerical Analysis · Mathematics 2025-10-23 Lizuo Liu , Tongtong Li , Anne Gelb

Data assimilation addresses the general problem of how to combine model-based predictions with partial and noisy observations of the process in an optimal manner. This survey focuses on sequential data assimilation techniques using…

Numerical Analysis · Mathematics 2019-08-15 Sebastian Reich

Machine learning can provide deep insights into data, allowing machines to make high-quality predictions and having been widely used in real-world applications, such as text mining, visual classification, and recommender systems. However,…

Machine Learning · Computer Science 2020-08-11 Meng Wang , Weijie Fu , Xiangnan He , Shijie Hao , Xindong Wu

Machine learning (ML) and Deep Learning (DL) tasks primarily depend on data. Most of the ML and DL applications involve supervised learning which requires labelled data. In the initial phases of ML realm lack of data used to be a problem,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-04 Ankush Deshmukh , Bhargava B C , A V Narasimhadhan

Data-driven machine learning (ML) models are reshaping weather forecasting and have shown the potential to accelerate and surpass traditional physics-based approaches, leading to a second revolution in the field after data assimilation.…

Machine Learning · Computer Science 2026-05-19 Hang Fan , Yi Xiao , Yongquan Qu , Juan Nathaniel , Fenghua Ling , Ben Fei , Lei Bai , Pierre Gentine

Enforcing universal symmetries in machine learning (ML) models is a common strategy to mitigate data scarcity. We show that exploiting exact, as well as approximate, label symmetries can benefit scaling laws. We illustrate the idea for the…

Chemical Physics · Physics 2026-05-28 Scott Y. H. Kim , Mathis Lechaume-Robert , O. Anatole von Lilienfeld

Data assimilation refers to the problem of finding trajectories of a prescribed dynamical model in such a way that the output of the model (usually some function of the model states) follows a given time series of observations. Typically…

Atmospheric and Oceanic Physics · Physics 2015-05-30 Jochen Bröcker , Ivan G. Szendro

Dynamical systems that evolve continuously over time are ubiquitous throughout science and engineering. Machine learning (ML) provides data-driven approaches to model and predict the dynamics of such systems. A core issue with this approach…

Machine Learning · Computer Science 2023-11-23 Aditi S. Krishnapriyan , Alejandro F. Queiruga , N. Benjamin Erichson , Michael W. Mahoney

Object recognition is a key enabler across industry and defense. As technology changes, algorithms must keep pace with new requirements and data. New modalities and higher resolution sensors should allow for increased algorithm robustness.…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Samuel Rivera , Joel Klipfel , Deborah Weeks

The analysis of tabular datasets is highly prevalent both in scientific research and real-world applications of Machine Learning (ML). Unlike many other ML tasks, Deep Learning (DL) models often do not outperform traditional methods in this…

Machine Learning · Computer Science 2024-08-28 Assaf Shmuel , Oren Glickman , Teddy Lazebnik

Data assimilation (DA) methods use priors arising from differential equations to robustly interpolate and extrapolate data. Popular techniques such as ensemble methods that handle high-dimensional, nonlinear PDE priors focus mostly on state…

Machine Learning · Statistics 2024-06-05 Rafael Anderka , Marc Peter Deisenroth , So Takao

Data assimilation is a technique for increasing the accuracy of simulations of solutions to partial differential equations by incorporating observable data into the solution as time evolves. Recently, a promising new algorithm for data…

Analysis of PDEs · Mathematics 2018-12-06 Adam Larios , Collin Victor

Data Assimilation is a cornerstone of atmospheric system modeling, tasked with reconstructing system states by integrating sparse, noisy observations with prior estimation. While traditional approaches like variational and ensemble Kalman…

Machine Learning · Computer Science 2025-11-04 Hao Wang , Zixuan Weng , Jindong Han , Wei Fan , Hao Liu