English
Related papers

Related papers: Correcting biased observation model error in data …

200 papers

Standard methods of data assimilation assume prior knowledge of a model that describes the system dynamics and an observation function that maps the model state to a predicted output. An accurate mapping from model state to observation…

Dynamical Systems · Mathematics 2019-05-22 Franz Hamilton , Tyrus Berry , Timothy Sauer

We develop an algebraic framework for sequential data assimilation of partially observed dynamical systems. In this framework, Bayesian data assimilation is embedded in a non-abelian operator algebra, which provides a representation of…

Statistics Theory · Mathematics 2023-03-29 David Freeman , Dimitrios Giannakis , Brian Mintz , Abbas Ourmazd , Joanna Slawinska

Errors in the representation of clouds in convection-permitting numerical weather prediction models can be introduced by different sources. These can be the forcing and boundary conditions, the representation of orography, the accuracy of…

Atmospheric and Oceanic Physics · Physics 2022-03-14 Stefanie Legler , Tijana Janjic

We introduce a data assimilation strategy aimed at accurately capturing key non-Gaussian structures in probability distributions using a small ensemble size. A major challenge in statistical forecasting of nonlinearly coupled multiscale…

Numerical Analysis · Mathematics 2025-04-01 Di Qi , Jian-Guo Liu

In-situ ocean wave observations are critical to improve model skill and validate remote sensing wave measurements. Historically, such observations are extremely sparse due to the large costs and complexity of traditional wave buoys and…

Atmospheric and Oceanic Physics · Physics 2020-03-11 Pieter B. Smit , Isabel A. Houghton , Kalina Jordanova , Thomas Portwood , Evan Shapiro , David Clark , Michael Sosa , Tim T. Janssen

For oceanographic applications, probabilistic forecasts typically have to deal with i) high-dimensional complex models, and ii) very sparse spatial observations. In search-and-rescue operations at sea, for instance, the short-term…

Applications · Statistics 2023-02-15 Florian Beiser , Håvard Heitlo Holm , Jo Eidsvik

Model uncertainty quantification is an essential component of effective data assimilation. Model errors associated with sub-grid scale processes are often represented through stochastic parameterizations of the unresolved process. Many…

Methodology · Statistics 2021-04-13 Sahani Pathiraja , Peter Jan van Leeuwen

Nonparametric Bayesian models are used routinely as flexible and powerful models of complex data. Many times, a statistician may have additional informative beliefs about data distribution of interest, e.g., its mean or subset components,…

Methodology · Statistics 2022-11-08 Bingjing Tang , Vinayak Rao

Data assimilation is an iterative approach to the problem of estimating the state of a dynamical system using both current and past observations of the system together with a model for the system's time evolution. Rather than solving the…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Brian R. Hunt , Eric J. Kostelich , Istvan Szunyogh

Data assimilation involves estimating the state of a system by combining observations from various sources with a background estimate of the state. The weights given to the observations and background state depend on their specified error…

Numerical Analysis · Mathematics 2025-03-13 Olivier Goux , Anthony Weaver , Selime Gürol , Oliver Guillet , Andrea Piacentini

Data assimilation is a central problem in many geophysical applications, such as weather forecasting. It aims to estimate the state of a potentially large system, such as the atmosphere, from sparse observations, supplemented by prior…

Machine Learning · Computer Science 2024-06-24 Matthieu Blanke , Ronan Fablet , Marc Lelarge

The large underlying assumption of climate models today relies on the basis of a "confident" initial condition, a reasonably plausible snapshot of the Earth for which all future predictions depend on. However, given the inherently chaotic…

Applications · Statistics 2025-06-03 Valerie Tsao , Nathaniel W. Chaney , Manolis Veveakis

Data assimilation provides algorithms for widespread applications in various fields. It is of practical use to deal with a large amount of information in the complex system that is hard to estimate. Weather forecasting is one of the…

Optimization and Control · Mathematics 2023-03-23 Yihua Yang

Variational data assimilation optimizes for an initial state of a dynamical system such that its evolution fits observational data. The physical model can subsequently be evolved into the future to make predictions. This principle is a…

Machine Learning · Computer Science 2021-05-21 Thomas Frerix , Dmitrii Kochkov , Jamie A. Smith , Daniel Cremers , Michael P. Brenner , Stephan Hoyer

The generation of initial conditions via accurate data assimilation is crucial for weather forecasting and climate modeling. We propose DiffDA as a denoising diffusion model capable of assimilating atmospheric variables using predicted…

Computational Engineering, Finance, and Science · Computer Science 2024-06-11 Langwen Huang , Lukas Gianinazzi , Yuejiang Yu , Peter D. Dueben , Torsten Hoefler

Selection bias arises when the probability that an observation enters a dataset depends on variables related to the quantities of interest, leading to systematic distortions in estimation and uncertainty quantification. For example, in…

Low-order thermoacoustic models are qualitatively correct, but they are typically quantitatively inaccurate. We propose a time-domain bias-aware method to make qualitatively low--order models quantitatively (more) accurate. First, we…

Fluid Dynamics · Physics 2022-11-10 Andrea Nóvoa , Luca Magri

We propose closed-form conditional diffusion models for data assimilation. Diffusion models use data to learn the score function (defined as the gradient of the log-probability density of a data distribution), allowing them to generate new…

Machine Learning · Statistics 2026-04-02 Brianna Binder , Agnimitra Dasgupta , Assad Oberai

Data assimilation is a core component of numerical weather prediction systems. The large quantity of data processed during assimilation requires the computation to be distributed across increasingly many compute nodes, yet existing…

Machine Learning · Computer Science 2025-01-15 Oscar Key , So Takao , Daniel Giles , Marc Peter Deisenroth

The accuracy of simulation-based forecasting in chaotic systems is heavily dependent on high-quality estimates of the system state at the time the forecast is initialized. Data assimilation methods are used to infer these initial conditions…

Machine Learning · Computer Science 2021-11-02 Michael McCabe , Jed Brown
‹ Prev 1 2 3 10 Next ›