English
Related papers

Related papers: Estimating model evidence using data assimilation

200 papers

The reconstruction of the dynamics of an observed physical system as a surrogate model has been brought to the fore by recent advances in machine learning. To deal with partial and noisy observations in that endeavor, machine learning…

Machine Learning · Statistics 2020-10-06 Marc Bocquet , Alban Farchi , Quentin Malartic

The success of the ensemble Kalman filter has triggered a strong interest in expanding its scope beyond classical state estimation problems. In this paper, we focus on continuous-time data assimilation where the model and measurement errors…

Numerical Analysis · Mathematics 2019-06-26 Nikolas Nüsken , Sebastian Reich , Paul J. Rozdeba

Accurate modeling and prediction of complex physical systems often rely on data assimilation techniques to correct errors inherent in model simulations. Traditional methods like the Ensemble Kalman Filter (EnKF) and its variants as well as…

Machine Learning · Computer Science 2024-09-12 Phillip Si , Peng Chen

Bayesian uncertainty quantification (UQ) is of interest to industry and academia as it provides a framework for quantifying and reducing the uncertainty in computational models by incorporating available data. For systems with very high…

Computational Physics · Physics 2020-04-14 Xinlei Zhang , Heng Xiao , Thomas Gomez , Olivier Coutier-Delgosha

Every day, weather forecasting centres around the world make use of noisy, incomplete observations of the atmosphere to update their weather forecasts. This process is known as data assimilation, data fusion or state estimation and is best…

Multiagent Systems · Computer Science 2022-05-04 Daniel Tang , Nick Malleson

Continuous data assimilation (CDA) methods, such as the nudging algorithm introduced by Azouani, Olson, and Titi (AOT), have proven to be highly effective in deterministic settings for asymptotically synchronizing approximate solutions with…

Probability · Mathematics 2026-01-27 Kush Kinra

Data assimilation is a method of uncertainty quantification to estimate the hidden true state by updating the prediction owing to model dynamics with observation data. As a prediction model, we consider a class of nonlinear dynamical…

Statistics Theory · Mathematics 2026-03-05 Kota Takeda , Takashi Sakajo

We identify a strong equivalence between neural network based machine learning (ML) methods and the formulation of statistical data assimilation (DA), known to be a problem in statistical physics. DA, as used widely in physical and…

Machine Learning · Computer Science 2017-10-23 H. D. I. Abarbanel , P. J. Rozdeba , S. Shirman

Stochastic parameterizations are increasingly being used to represent the uncertainty associated with model errors in ensemble forecasting and data assimilation. One of the challenges associated with the use of these parameterizations is…

Computation · Statistics 2019-10-23 Guillermo Scheffler , Juan Ruiz , Manuel Pulido

A Bayesian data assimilation scheme is formulated for advection-dominated or hyperbolic evolutionary problems, and observations. The method is referred to as the dynamic likelihood filter because it exploits the model physics to dynamically…

Dynamical Systems · Mathematics 2017-04-26 Juan M. Restrepo

The increasing availability of data presents an opportunity to calibrate unknown parameters which appear in complex models of phenomena in the biomedical, physical and social sciences. However, model complexity often leads to…

Numerical Analysis · Mathematics 2022-01-25 Oliver R. A. Dunbar , Andrew B. Duncan , Andrew M. Stuart , Marie-Therese Wolfram

Calibration strengthens the trustworthiness of black-box models by producing better accurate confidence estimates on given examples. However, little is known about if model explanations can help confidence calibration. Intuitively, humans…

Computation and Language · Computer Science 2022-11-08 Dongfang Li , Baotian Hu , Qingcai Chen

The ensemble Kalman filter (EnKF) (Evensen, 2009) has proven effective in quantifying uncertainty in a number of challenging dynamic, state estimation, or data assimilation, problems such as weather forecasting and ocean modeling. In these…

An Ensemble of Data Assimilations (EDA) can provide valuable information on the analysis and short-range forecast uncertainties. The present ECMWF operational ocean analysis and reanalysis system, called ORAS5, produces an ensemble but does…

Atmospheric and Oceanic Physics · Physics 2024-07-08 Marcin Chrust , Anthony T. Weaver , Philip Browne , Hao Zuo , Magdalena Alonso Balmaseda

Estimating background-error covariances remains a core challenge in variational data assimilation (DA). Operational systems typically approximate these covariances by transformations that separate geostrophically balanced components from…

Atmospheric and Oceanic Physics · Physics 2026-01-21 Boštjan Melinc , Uroš Perkan , Žiga Zaplotnik

Reconstruction of turbulent flow based on data assimilation methods is of significant importance for improving the estimation of flow characteristics by incorporating limited observations. Existing works mainly focus on using only one…

Fluid Dynamics · Physics 2021-03-30 Xin-Lei Zhang , Heng Xiao , Guo-Wei He , Shi-Zhao Wang

The ensemble smoother with multiple data assimilation (ES-MDA) is becoming a popular assisted history matching method. In its standard form, the method requires the specification of the number of iterations in advance. If the selected…

Numerical Analysis · Mathematics 2024-06-11 Alexandre A. Emerick

Ensemble learning is a mainstay in modern data science practice. Conventional ensemble algorithms assign to base models a set of deterministic, constant model weights that (1) do not fully account for individual models' varying accuracy…

Methodology · Statistics 2019-04-02 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent A. Coull

A general challenge in statistics is prediction in the presence of multiple candidate models or learning algorithms. Model aggregation tries to combine all predictive distributions from individual models, which is more stable and flexible…

Methodology · Statistics 2021-09-28 Yuling Yao

Data Assimilation (DA) and Uncertainty quantification (UQ) are extensively used in analysing and reducing error propagation in high-dimensional spatial-temporal dynamics. Typical applications span from computational fluid dynamics (CFD) to…