English
Related papers

Related papers: Correcting biased observation model error in data …

200 papers

This paper presents an ensemble data assimilation method using the pseudo ensembles generated by denoising diffusion probabilistic model. Since the model is trained against noisy and sparse observation data, this model can produce divergent…

Machine Learning · Computer Science 2023-08-15 Yuuichi Asahi , Yuta Hasegawa , Naoyuki Onodera , Takashi Shimokawabe , Hayato Shiba , Yasuhiro Idomura

Data assimilation combines forecasts from a numerical model with observations. Most of the current data assimilation algorithms consider the model and observation error terms as additive Gaussian noise, specified by their covariance…

Accurate estimation of error covariances (both background and observation) is crucial for efficient observation compression approaches in data assimilation of large-scale dynamical problems. We propose a new combination of a covariance…

Numerical Analysis · Mathematics 2021-06-11 Sibo Cheng , Didier Lucor , Jean-Philippe Argaud

This paper is a contribution in the context of variational data assimilation combined with statistical learning. The framework of data assimilation traditionally uses data collected at sensor locations in order to bring corrections to a…

Numerical Analysis · Mathematics 2023-05-09 Amina Benaceur , Barbara Verfürth

In the context of regressing a response $Y$ on a predictor $X$, we consider estimating the local modes of the distribution of $Y$ given $X=x$ when $X$ is prone to measurement error. We propose two nonparametric estimation methods, with one…

Methodology · Statistics 2016-10-28 Haiming Zhou , Xianzheng Huang

Nested error regression models are useful tools for analysis of grouped data, especially in the case of small area estimation. This paper suggests a nested error regression model using uncertain random effects in which the random effect in…

Methodology · Statistics 2017-02-28 Shonosuke Sugasawa , Tatsuya Kubokawa

Data-driven prediction and physics-agnostic machine-learning methods have attracted increased interest in recent years achieving forecast horizons going well beyond those to be expected for chaotic dynamical systems. In a separate strand of…

Data Analysis, Statistics and Probability · Physics 2021-05-19 Georg A. Gottwald , Sebastian Reich

In this paper, we apply a recently developed nonparametric modeling approach, the "diffusion forecast", to predict the time-evolution of Fourier modes of turbulent dynamical systems. While the diffusion forecasting method assumes the…

Chaotic Dynamics · Physics 2016-03-23 Tyrus Berry , John Harlim

Many problems in science and engineering require making predictions based on few observations. To build a robust predictive model, these sparse data may need to be augmented with simulated data, especially when the design space is…

We present a cost-effective method for model calibration and solution of source inversion problems in atmospheric dispersion modelling. We use Gaussian process emulations of atmospheric dispersion models within a Bayesian framework for…

Numerical Analysis · Mathematics 2021-06-08 Juan G. Garcia , Bamdad Hosseini , John M Stockie

The continuous improvement in weather forecast skill over the past several decades is largely due to the increasing quantity of available satellite observations and their assimilation into operational forecast systems. Assimilating these…

Atmospheric and Oceanic Physics · Physics 2025-04-24 Lucas Howard , Aneesh C. Subramanian , Gregory Thompson , Benjamin Johnson , Thomas Auligne

Ensemble learning is a mainstay in modern data science practice. Conventional ensemble algorithms assign to base models a set of deterministic, constant model weights that (1) do not fully account for individual models' varying accuracy…

Methodology · Statistics 2019-04-02 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent A. Coull

State estimation in multi-layer turbulent flow fields with only a single layer of partial observation remains a challenging yet practically important task. Applications include inferring the state of the deep ocean by exploiting surface…

Fluid Dynamics · Physics 2025-09-30 Zhongrui Wang , Nan Chen , Di Qi

Data assimilation, consisting in the combination of a dynamical model with a set of noisy and incomplete observations in order to infer the state of a system over time, involves uncertainty in most settings. Building upon an existing…

Machine Learning · Computer Science 2026-03-02 Anthony Frion , David S Greenberg

Climate change exacerbates extreme weather events like heavy rainfall and flooding. As these events cause severe socioeconomic damage, accurate high-resolution simulation of precipitation is imperative. However, existing Earth System Models…

Geophysics · Physics 2026-02-03 Michael Aich , Philipp Hess , Baoxiang Pan , Sebastian Bathiany , Yu Huang , Niklas Boers

Conventional recursive filtering approaches, designed for quantifying the state of an evolving uncertain dynamical system with intermittent observations, use a sequence of (i) an uncertainty propagation step followed by (ii) a step where…

Probability · Mathematics 2015-06-18 Wonjung Lee , Chris Farmer

Artificial intelligence (AI)-based weather prediction research is growing rapidly and has shown to be competitive with the advanced dynamic numerical weather prediction models. However, research combining AI-based weather prediction models…

Machine Learning · Computer Science 2025-10-16 Shunji Kotsuki , Kenta Shiraishi , Atsushi Okazaki

Regression models that ignore measurement error in predictors may produce highly biased estimates leading to erroneous inferences. It is well known that it is extremely difficult to take measurement error into account in Gaussian…

Methodology · Statistics 2023-02-03 Mohammad W. Hattab , David Ruppert

The presence of measurement error is a widespread issue which, when ignored, can render the results of an analysis unreliable. Numerous corrections for the effects of measurement error have been proposed and studied, often under the…

Methodology · Statistics 2023-06-29 Dylan Spicker , Michael Wallace , Grace Yi

Bayesian learning is built on an assumption that the model space contains a true reflection of the data generating mechanism. This assumption is problematic, particularly in complex data environments. Here we present a Bayesian…

Machine Learning · Statistics 2018-11-05 S. P. Lyddon , S. G. Walker , C. C. Holmes