English
Related papers

Related papers: Data Assimilation Models for Computing Probability…

200 papers

The importance of accurately quantifying forecast uncertainty has motivated much recent research on probabilistic forecasting. In particular, a variety of deep learning approaches has been proposed, with forecast distributions obtained as…

Machine Learning · Statistics 2024-11-11 Benedikt Schulz , Lutz Köhler , Sebastian Lerch

Data assimilation is a core component of numerical weather prediction systems. The large quantity of data processed during assimilation requires the computation to be distributed across increasingly many compute nodes, yet existing…

Machine Learning · Computer Science 2025-01-15 Oscar Key , So Takao , Daniel Giles , Marc Peter Deisenroth

In meteorology, engineering and computer sciences, data assimilation is routinely employed as the optimal way to combine noisy observations with prior model information for obtaining better estimates of a state, and thus better forecasts,…

Geophysics · Physics 2009-08-12 M. J. Werner , K. Ide , D. Sornette

We propose closed-form conditional diffusion models for data assimilation. Diffusion models use data to learn the score function (defined as the gradient of the log-probability density of a data distribution), allowing them to generate new…

Machine Learning · Statistics 2026-04-02 Brianna Binder , Agnimitra Dasgupta , Assad Oberai

Variational data assimilation is a technique for combining measured data with dynamical models. It is a key component of Earth system state estimation and is commonly used in weather and ocean forecasting. The approach involves a…

Numerical Analysis · Mathematics 2026-04-30 I. Daužickaitė , M. A. Freitag , S. Gürol , A. S. Lawless , A. Ramage , J. A. Scott , J. M. Tabeart

This chapter provides various perspective on an important challenge in data assimilation: model error. While the overall goal is to understand the implication of model error of any type in data assimilation, we emphasize on the effect of…

Dynamical Systems · Mathematics 2015-07-02 John Harlim

A hybrid data assimilation algorithm is developed for complex dynamical systems with partial observations. The method starts with applying a spectral decomposition to the entire spatiotemporal fields, followed by creating a machine learning…

Computational Physics · Physics 2022-12-27 Changhong Mou , Leslie M. Smith , Nan Chen

Data assimilation is a technique for increasing the accuracy of simulations of solutions to partial differential equations by incorporating observable data into the solution as time evolves. Recently, a promising new algorithm for data…

Analysis of PDEs · Mathematics 2018-12-06 Adam Larios , Collin Victor

This paper develops a computational framework for optimizing the parameters of data assimilation systems in order to improve their performance. The approach formulates a continuous meta-optimization problem for parameters; the…

Computational Engineering, Finance, and Science · Computer Science 2015-06-16 Alexandru Cioaca , Adrian Sandu

A framework for deriving probabilistic data-driven closure models is proposed for coarse-grained numerical simulations of turbulence in statistically stationary state. The approach unites the ideal large-eddy simulation model and data…

Fluid Dynamics · Physics 2025-03-25 Sagy Ephrati

Nonuniform subsampling methods are effective to reduce computational burden and maintain estimation efficiency for massive data. Existing methods mostly focus on subsampling with replacement due to its high computational efficiency. If the…

Methodology · Statistics 2021-07-06 Jun Yu , HaiYing Wang , Mingyao Ai , Huiming Zhang

In the past couple of years, there is a proliferation in the use of machine learning approaches to represent subgrid scale processes in geophysical flows with an aim to improve the forecasting capability and to accelerate numerical…

Computational Physics · Physics 2021-04-13 Suraj Pawar , Omer San

Stochastic parameterizations are increasingly being used to represent the uncertainty associated with model errors in ensemble forecasting and data assimilation. One of the challenges associated with the use of these parameterizations is…

Computation · Statistics 2019-10-23 Guillermo Scheffler , Juan Ruiz , Manuel Pulido

This paper is a contribution in the context of variational data assimilation combined with statistical learning. The framework of data assimilation traditionally uses data collected at sensor locations in order to bring corrections to a…

Numerical Analysis · Mathematics 2023-05-09 Amina Benaceur , Barbara Verfürth

Data Assimilation is the process in which we improve the representation of the state of a physical system by combining information coming from a numerical model, real-world observations, and some prior modelling. It is widely used to model…

Optimization and Control · Mathematics 2025-01-09 Victor Trappler , Arthur Vidard

When the heat released by a flame is sufficiently in phase with the acoustic pressure, a self-excited thermoacoustic oscillation can arise. These nonlinear oscillations are one of the biggest challenges faced in the design of safe and…

Computational Engineering, Finance, and Science · Computer Science 2019-06-28 Tullio Traverso , Luca Magri

Data assimilation is the task to combine evolution models and observational data in order to produce reliable predictions. In this paper, we focus on ensemble-based recursive data assimilation problems. Our main contribution is a hybrid…

Numerical Analysis · Mathematics 2016-02-26 Nawinda Chustagulprom , Sebastian Reich , Maria Reinhardt

In this study, two classes of methods including statistical and variational data assimilation algorithms will be described. In statistical methods, the model state is updated sequentially based on the previous estimate. Variational methods,…

Systems and Control · Electrical Eng. & Systems 2021-10-25 Loc Luong

We propose a practical and scalable Gaussian process model for large-scale nonlinear probabilistic regression. Our mixture-of-experts model is conceptually simple and hierarchically recombines computations for an overall approximation of a…

Machine Learning · Statistics 2014-12-10 Jun Wei Ng , Marc Peter Deisenroth

We study prediction-assimilation systems, which have become routine in meteorology and oceanography and are rapidly spreading to other areas of the geosciences and of continuum physics. The long-term, nonlinear stability of such a system…

Chaotic Dynamics · Physics 2009-11-13 Alberto Carrassi , Michael Ghil , Anna Trevisan , Francesco Uboldi