English
Related papers

Related papers: Sampling error mitigation through spectrum smoothi…

200 papers

The performance of ensemble-based data assimilation techniques that estimate the state of a dynamical system from partial observations depends crucially on the prescribed uncertainty of the model dynamics and of the observations. These are…

Computation · Statistics 2021-02-24 Tadeo Javier Cocucci , Manuel Pulido , Magdalena Lucini , Pierre Tandeo

Subsampling algorithms for various parametric regression models with massive data have been extensively investigated in recent years. However, all existing studies on subsampling heavily rely on clean massive data. In practical…

Statistics Theory · Mathematics 2025-06-11 Jiangshan Ju , Mingqiu Wang , Shengli Zhao

Predictions of the future state of the Earth's atmosphere suffer from the consequences of chaos: numerical weather forecast models quickly diverge from observations as uncertainty in the initial state is amplified by nonlinearity. One…

Mathematical Physics · Physics 2015-03-19 Ross M. Lieb-Lappen , Christopher M. Danforth

This paper constructs an ensemble-based sampling smoother for four-dimensional data assimilation using a Hybrid/Hamiltonian Monte-Carlo approach. The smoother samples efficiently from the posterior probability density of the solution at the…

Numerical Analysis · Computer Science 2015-05-19 Ahmed Attia , Vishwas Rao , Adrian Sandu

Several numerical tools designed to overcome the challenges of smoothing in a nonlinear and non-Gaussian setting are investigated for a class of particle smoothers. The considered family of smoothers is induced by the class of linear…

Numerical Analysis · Mathematics 2019-10-29 Jana de Wiljes , Sahani Pathiraja , Sebastian Reich

We propose two new methods based/inspired by machine learning for tabular data and distance-free localization to enhance the covariance estimations in an ensemble data assimilation. The main goal is to enhance the data assimilation results…

Machine Learning · Computer Science 2025-07-31 Vinicius L. S. Silva , Gabriel S. Seabra , Alexandre A. Emerick

Smoothing is essential to many oceanographic, meteorological and hydrological applications. The interval smoothing problem updates all desired states within a time interval using all available observations. The fixed-lag smoothing problem…

Chaotic Dynamics · Physics 2015-06-26 S. Ravela , D. McLaughlin

Ensemble models refer to methods that combine a typically large number of classifiers into a compound prediction. The output of an ensemble method is the result of fitting a base-learning algorithm to a given data set, and obtaining diverse…

Machine Learning · Statistics 2019-06-10 Waldyn Martinez

We introduce a data assimilation strategy aimed at accurately capturing key non-Gaussian structures in probability distributions using a small ensemble size. A major challenge in statistical forecasting of nonlinearly coupled multiscale…

Numerical Analysis · Mathematics 2025-04-01 Di Qi , Jian-Guo Liu

Data assimilation algorithms are used to estimate the states of a dynamical system using partial and noisy observations. The ensemble Kalman filter has become a popular data assimilation scheme due to its simplicity and robustness for a…

Numerical Analysis · Mathematics 2021-06-23 Gottfried Hastermann , Maria Reinhardt , Rupert Klein , Sebastian Reich

Data assimilation is a method of uncertainty quantification to estimate the hidden true state by updating the prediction owing to model dynamics with observation data. As a prediction model, we consider a class of nonlinear dynamical…

Statistics Theory · Mathematics 2026-03-05 Kota Takeda , Takashi Sakajo

Machine learning has emerged as a promising approach to path loss prediction, yet its effectiveness often degrades when measurement data are scarce. To address this limitation, we propose an ensemble-based machine learning framework that…

Signal Processing · Electrical Eng. & Systems 2026-05-26 Ahmed P. Mohamed , Byunghyun Lee , Yaguang Zhang , Christopher R. Anderson , David J. Love , James V. Krogmeier

Data assimilation schemes are confronted with the presence of model errors arising from the imperfect description of atmospheric dynamics. These errors are usually modeled on the basis of simple assumptions such as bias, white noise, first…

Chaotic Dynamics · Physics 2009-11-13 A. Carrassi , S. Vannitsem , C. Nicolis

Ensemble data assimilation techniques form an indispensable part of numerical weather prediction. As the ensemble size grows and model resolution increases, the amount of required storage becomes a major issue. Data compression schemes may…

A new efficient ensemble prediction strategy is developed for a general turbulent model framework with emphasis on the nonlinear interactions between large and small scale variables. The high computational cost in running large ensemble…

Fluid Dynamics · Physics 2023-02-22 Di Qi , Jian-Guo Liu

Inferring the state and unknown parameters of a network of coupled oscillators is of utmost importance. This task is made harder when only partial and noisy observations are available, which is a typical scenario in realistic…

Adaptation and Self-Organizing Systems · Physics 2025-04-07 Lauren D. Smith , Georg A. Gottwald

This chapter provides various perspective on an important challenge in data assimilation: model error. While the overall goal is to understand the implication of model error of any type in data assimilation, we emphasize on the effect of…

Dynamical Systems · Mathematics 2015-07-02 John Harlim

This article shows that increasing the observation variance at small scales can reduce the ensemble size required to avoid collapse in particle filtering of spatially-extended dynamics and improve the resulting uncertainty quantification at…

Applications · Statistics 2018-08-15 Gregor Robinson , Ian Grooms , William Kleiber

We consider the Ensemble Kalman Inversion which has been recently introduced as an efficient, gradient-free optimisation method to estimate unknown parameters in an inverse setting. In the case of large data sets, the Ensemble Kalman…

Numerical Analysis · Mathematics 2023-12-05 Matei Hanu , Jonas Latz , Claudia Schillings

The weighting of critical-point samples in the weighted randomized maximum likelihood method depend on the magnitude of the data mismatch at the critical points and on the Jacobian of the transformation from the prior density to the…

Methodology · Statistics 2023-01-16 Yuming Ba , Dean S. Oliver