English
Related papers

Related papers: A non-parametric ensemble transform method for Bay…

200 papers

Data assimilation is a method of uncertainty quantification to estimate the hidden true state by updating the prediction owing to model dynamics with observation data. As a prediction model, we consider a class of nonlinear dynamical…

Statistics Theory · Mathematics 2026-03-05 Kota Takeda , Takashi Sakajo

In the process of reproducing the state dynamics of parameter dependent distributed systems, data from physical measurements can be incorporated into the mathematical model to reduce the parameter uncertainty and, consequently, improve the…

Numerical Analysis · Mathematics 2022-10-06 Francesco A. B. Silva , Cecilia Pagliantini , Martin Grepl , Karen Veroy

Data assimilation provides algorithms for widespread applications in various fields. It is of practical use to deal with a large amount of information in the complex system that is hard to estimate. Weather forecasting is one of the…

Optimization and Control · Mathematics 2023-03-23 Yihua Yang

Many data-science problems can be formulated as an inverse problem, where the parameters are estimated by minimizing a proper loss function. When complicated black-box models are involved, derivative-free optimization tools are often…

Numerical Analysis · Mathematics 2021-10-19 Neil K. Chada , Xin T. Tong

We discuss properties of hierarchical Bayesian inversion through the ensemble Kalman filter (EnKF). Our focus will be primarily on deriving continuous-time limits for hierarchical inversion in the linear case. An important characteristic of…

Numerical Analysis · Mathematics 2018-01-04 Neil K. Chada

We consider Bayesian inference for large scale inverse problems, where computational challenges arise from the need for repeated evaluations of an expensive forward model. This renders most Markov chain Monte Carlo approaches infeasible,…

Numerical Analysis · Mathematics 2022-08-12 Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

Data assimilation is concerned with sequentially estimating a temporally-evolving state. This task, which arises in a wide range of scientific and engineering applications, is particularly challenging when the state is high-dimensional and…

Machine Learning · Statistics 2021-07-21 Yuming Chen , Daniel Sanz-Alonso , Rebecca Willett

The ensemble random forest filter (ERFF) is presented as an alternative to the ensemble Kalman filter (EnKF) for the purpose of inverse modeling. The EnKF is a data assimilation approach that forecasts and updates parameter estimates…

Machine Learning · Computer Science 2022-07-11 Vanessa A. Godoy , Gian F. Napa-García , J. Jaime Gómez-Hernández

Although data assimilation originates from control theory, the relationship between modern data assimilation methods in geoscience and model predictive control has not been extensively explored. In the present paper, I discuss that the…

Geophysics · Physics 2024-10-21 Yohei Sawada

This paper develops an efficient implementation of the ensemble Kalman filter based on a modified Cholesky decomposition for inverse covariance matrix estimation. This implementation is named EnKF-MC. Background errors corresponding to…

Statistics Theory · Mathematics 2016-05-31 Elias D. Nino , Adrian Sandu , Xinwei Deng

Ensemble methods, such as the ensemble Kalman filter (EnKF), the local ensemble transform Kalman filter (LETKF), and the ensemble Kalman smoother (EnKS) are widely used in sequential data assimilation, where state vectors are of huge…

Probability · Mathematics 2019-01-03 El houcine Bergou , Serge Gratton , Jan Mandel

Real-time nonlinear Bayesian filtering algorithms are overwhelmed by data volume, velocity and increasing complexity of computational models. In this paper, we propose a novel ensemble based nonlinear Bayesian filtering approach which only…

Computation · Statistics 2019-06-05 Xiao Lin , Gabriel Terejanu

The ensemble Kalman filter (EnKF) is widely used for nonlinear and high-dimensional state estimation because it replaces complex covariance propagation with simple ensemble statistics. However, conventional EnKF implementations can become…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Shida Jiang , Shengyu Tao , Zihe Liu , Scott Moura

This work develops a new multifidelity ensemble Kalman filter (MFEnKF) algorithm based on linear control variate framework. The approach allows for rigorous multifidelity extensions of the EnKF, where the uncertainty in coarser fidelities…

Numerical Analysis · Mathematics 2020-07-03 Andrey A Popov , Changhong Mou , Traian Iliescu , Adrian Sandu

An Ensemble Kalman Filter (EnKF, the predictor) is used make a large change in the state, followed by a Particle Filer (PF, the corrector) which assigns importance weights to describe non-Gaussian distribution. The weights are obtained by…

Computation · Statistics 2009-07-20 Jan Mandel , Jonathan D. Beezley

Because of physical assumptions and numerical approximations, low-order models are affected by uncertainties in the state and parameters, and by model biases. Model biases, also known as model errors or systematic errors, are difficult to…

Methodology · Statistics 2024-10-10 Andrea Nóvoa , Alberto Racca , Luca Magri

This work embeds a multilevel Monte Carlo (MLMC) sampling strategy into the Monte Carlo step of the ensemble Kalman filter (EnKF), thereby yielding a multilevel ensemble Kalman filter (MLEnKF) which has provably superior asymptotic cost to…

Numerical Analysis · Mathematics 2016-08-31 Alexey Chernov , Haakon Hoel , Kody Law , Fabio Nobile , Raul Tempone

The filtering distribution in hidden Markov models evolves according to the law of a mean-field model in state-observation space. The ensemble Kalman filter (EnKF) approximates this mean-field model with an ensemble of interacting…

Machine Learning · Statistics 2025-12-25 Eviatar Bach , Ricardo Baptista , Edoardo Calvello , Bohan Chen , Andrew Stuart

Neuronal ensemble inference is one of the significant problems in the study of biological neural networks. Various methods have been proposed for ensemble inference from their activity data taken experimentally. Here we focus on Bayesian…

Disordered Systems and Neural Networks · Physics 2020-03-30 Shun Kimura , Koujin Takeda

This paper develops efficient ensemble Kalman filter (EnKF) implementations based on shrinkage covariance estimation. The forecast ensemble members at each step are used to estimate the background error covariance matrix via the…

Statistics Theory · Mathematics 2015-02-03 Elias D. Nino-Ruiz , Adrian Sandu