English
Related papers

Related papers: Ensemble-localized Kernel Density Estimation with …

200 papers

Nonlinear/non-Gaussian filtering has broad applications in many areas of life sciences where either the dynamic is nonlinear and/or the probability density function of uncertain state is non-Gaussian. In such problems, the accuracy of the…

Computation · Statistics 2012-08-02 Hatef Monajemi , Peter K. Kitanidis

Over the years data assimilation methods have been developed to obtain estimations of uncertain model parameters by taking into account a few observations of a model state. The most reliable methods of MCMC are computationally expensive.…

Applications · Statistics 2018-11-14 Sangeetika Ruchi , Svetlana Dubinkina

The sample covariance matrix of a random vector is a good estimate of the true covariance matrix if the sample size is much larger than the length of the vector. In high-dimensional problems, this condition is never met. As a result, in…

Data Analysis, Statistics and Probability · Physics 2024-11-12 Michael Tsyrulnikov , Arseniy Sotskiy

Ensemble learning is a mainstay in modern data science practice. Conventional ensemble algorithms assign to base models a set of deterministic, constant model weights that (1) do not fully account for individual models' varying accuracy…

Methodology · Statistics 2019-04-02 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent A. Coull

Sequential Bayesian filters in non-linear dynamic systems require the recursive estimation of the predictive and posterior distributions. This paper introduces a Bayesian filter called the adaptive kernel Kalman filter (AKKF). With this…

Signal Processing · Electrical Eng. & Systems 2023-04-12 Mengwei Sun , Mike E. Davies , Ian K. Proudler , James R. Hopgood

Contemporary data assimilation often involves more than a million prediction variables. Ensemble Kalman filters (EnKF) have been developed by geoscientists. They are successful indispensable tools in science and engineering, because they…

Probability · Mathematics 2017-05-26 Andrew J. Majda , Xin T. Tong

The ensemble random forest filter (ERFF) is presented as an alternative to the ensemble Kalman filter (EnKF) for the purpose of inverse modeling. The EnKF is a data assimilation approach that forecasts and updates parameter estimates…

Machine Learning · Computer Science 2022-07-11 Vanessa A. Godoy , Gian F. Napa-García , J. Jaime Gómez-Hernández

Many filters have been proposed in recent decades for the nonlinear state estimation problem. The linearization-based extended Kalman filter (EKF) is widely applied to nonlinear industrial systems. As EKF is limited in accuracy and…

Systems and Control · Electrical Eng. & Systems 2020-09-29 Chengling Fang , Jiang Liu , Songqing Ye , Ju Zhang

The ensemble Kalman filter is widely used in applications because, for high dimensional filtering problems, it has a robustness that is not shared for example by the particle filter; in particular it does not suffer from weight collapse.…

Optimization and Control · Mathematics 2024-08-29 J. A. Carrillo , F. Hoffmann , A. M. Stuart , U. Vaes

Accurate modeling and prediction of complex physical systems often rely on data assimilation techniques to correct errors inherent in model simulations. Traditional methods like the Ensemble Kalman Filter (EnKF) and its variants as well as…

Machine Learning · Computer Science 2024-09-12 Phillip Si , Peng Chen

Heavy tails is a common feature of filtering distributions that results from the nonlinear dynamical and observation processes as well as the uncertainty from physical sensors. In these settings, the Kalman filter and its ensemble version -…

Computation · Statistics 2023-10-16 Mathieu Le Provost , Ricardo Baptista , Jeff D. Eldredge , Youssef Marzouk

An ensemble Kalman filter (EnKF)-based mixed model (EnKF-MM) is proposed for the subgrid-scale (SGS) closure in the large-eddy simulation (LES) of turbulence. The model coefficients are determined through the EnKF-based data assimilation…

Fluid Dynamics · Physics 2023-08-16 Yunpeng Wang , Zelong Yuan , Jianchun Wang

The ensemble Kalman filter (EnKF) is a data assimilation technique that uses an ensemble of models, updated with data, to track the time evolution of a usually non-linear system. It does so by using an empirical approximation to the…

Applications · Statistics 2021-03-12 Elizabeth Hou , Earl Lawrence , Alfred O. Hero

Data assimilation plays a key role in large-scale atmospheric weather forecasting, where the state of the physical system is estimated from model outputs and observations, and is then used as initial condition to produce accurate future…

Methodology · Statistics 2018-02-13 Azam Moosavi , Ahmed Attia , Adrian Sandu

The Ensemble Kalman Filter (EnKF) is a widely used method for data assimilation in high-dimensional systems, with an ensemble update step equivalent to an empirical version of the Matheron update popular in Gaussian process regression -- a…

Machine Learning · Computer Science 2025-09-19 Dan MacKinlay

Ensemble Kalman filters are based on a Gaussian assumption, which can limit their performance in some non-Gaussian settings. This paper reviews two nonlinear, non-Gaussian extensions of the Ensemble Kalman Filter: Gaussian anamorphosis (GA)…

Computation · Statistics 2022-03-08 Ian Grooms

This work presents new results and understanding of the Ensemble Kalman filter (EnKF) for inverse problems. In particular, using a Lagrangian dual perspective we show that EnKF can be derived from the sample average approximation (SAA) of…

Numerical Analysis · Mathematics 2026-01-27 C G Krishnanunni , Jonathan Wittmer , Tan Bui-Thanh , Quoc P. Nguyen

The Ensemble Score Filter (EnSF) has emerged as a promising approach to leverage score-based diffusion models for solving high-dimensional and nonlinear data assimilation problems. While initial applications of EnSF to the Lorenz-96 model…

Numerical Analysis · Mathematics 2025-10-24 Zezhong Zhang , Feng Bao , Guannan Zhang

Nonlinear Bayesian update for a prior ensemble is proposed to extend traditional ensemble Kalman filtering to settings characterized by non-Gaussian priors and nonlinear measurement operators. In this framework, the observed component is…

Machine Learning · Statistics 2025-03-20 Yoonsang Lee

The Gaussian mixture model (GMM) provides a simple yet principled framework for clustering, with properties suitable for statistical inference. In this paper, we propose a new model-based clustering algorithm, called EGMM (evidential GMM),…

Machine Learning · Computer Science 2022-11-29 Lianmeng Jiao , Thierry Denoeux , Zhun-ga Liu , Quan Pan