English
Related papers

Related papers: Learning Discriminators for Resampling in the Ense…

200 papers

We generalize the popular ensemble Kalman filter to an ensemble transform filter where the prior distribution can take the form of a Gaussian mixture or a Gaussian kernel density estimator. The design of the filter is based on a continuous…

Probability · Mathematics 2015-05-27 Sebastian Reich

The ensemble Gaussian mixture filter (EnGMF) is a non-linear filter suited to data assimilation of highly non-Gaussian and non-linear models that has practical utility in the case of a small number of samples, and theoretical convergence to…

Optimization and Control · Mathematics 2024-06-03 Andrey A. Popov , Enrico M. Zucchelli , Renato Zanetti

The ensemble Gaussian mixture filter combines the simplicity and power of Gaussian mixture models with the provable convergence and power of particle filters. The quality of the ensemble Gaussian mixture filter heavily depends on the choice…

Optimization and Control · Mathematics 2022-12-21 Andrey A Popov , Renato Zanetti

Data assimilation combines information from models, measurements, and priors to estimate the state of a dynamical system such as the atmosphere. The Ensemble Kalman filter (EnKF) is a family of ensemble-based data assimilation approaches…

Computational Engineering, Finance, and Science · Computer Science 2014-12-09 Ahmed Attia , Adrian Sandu

An Ensemble Kalman Filter (EnKF, the predictor) is used make a large change in the state, followed by a Particle Filer (PF, the corrector) which assigns importance weights to describe non-Gaussian distribution. The weights are obtained by…

Computation · Statistics 2009-07-20 Jan Mandel , Jonathan D. Beezley

The Ensemble Score Filter (EnSF) has emerged as a promising approach to leverage score-based diffusion models for solving high-dimensional and nonlinear data assimilation problems. While initial applications of EnSF to the Lorenz-96 model…

Numerical Analysis · Mathematics 2025-10-24 Zezhong Zhang , Feng Bao , Guannan Zhang

This paper presents the machine learning-based ensemble conditional mean filter (ML-EnCMF) -- a filtering method based on the conditional mean filter (CMF) previously introduced in the literature. The updated mean of the CMF matches that of…

Machine Learning · Computer Science 2022-08-02 Truong-Vinh Hoang , Sebastian Krumscheid , Hermann G. Matthies , Raúl Tempone

Data assimilation (DA) estimates a dynamical system's state from noisy observations. Recent generative models like the ensemble score filter (EnSF) improve DA in high-dimensional nonlinear settings but are computationally expensive. We…

Machine Learning · Statistics 2025-09-30 Taos Transue , Bohan Chen , So Takao , Bao Wang

The filtering distribution in hidden Markov models evolves according to the law of a mean-field model in state-observation space. The ensemble Kalman filter (EnKF) approximates this mean-field model with an ensemble of interacting…

Machine Learning · Statistics 2025-12-25 Eviatar Bach , Ricardo Baptista , Edoardo Calvello , Bohan Chen , Andrew Stuart

The Gaussian process state-space models (GPSSMs) represent a versatile class of data-driven nonlinear dynamical system models. However, the presence of numerous latent variables in GPSSM incurs unresolved issues for existing variational…

Machine Learning · Computer Science 2024-07-23 Zhidi Lin , Yiyong Sun , Feng Yin , Alexandre Hoang Thiéry

The ensemble Kalman filter (EnKF) is a recursive filter suitable for problems with a large number of variables, such as discretizations of partial differential equations in geophysical models. The EnKF originated as a version of the Kalman…

Atmospheric and Oceanic Physics · Physics 2009-01-26 Jan Mandel

This work provides a new multinomial resampling procedure for particle filter resampling, focused on the case where the number of samples required is less than or equal to the size of the underlying discrete distribution. This setting is…

Data Structures and Algorithms · Computer Science 2026-04-03 Andrey A. Popov

In the high-dimensional setting, Gaussian mixture kernel density estimates become increasingly suboptimal. In this work we aim to show that it is practical to instead use the optimal multivariate Epanechnikov kernel. We make use of this…

Machine Learning · Statistics 2024-08-22 Andrey A. Popov , Renato Zanetti

Ensemble Kalman Filtering (EnKF) is a popular technique for data assimilation, with far ranging applications. However, the vanilla EnKF framework is not well-defined when perturbations are nonlinear. We study two non-linear extensions of…

Machine Learning · Statistics 2024-09-24 Zachariah Malik , Romit Maulik

Image restoration has experienced significant advancements due to the development of deep learning. Nevertheless, it encounters challenges related to ill-posed problems, resulting in deviations between single model predictions and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Shangquan Sun , Wenqi Ren , Zikun Liu , Hyunhee Park , Rui Wang , Xiaochun Cao

Numerical modeling and simulation of two-phase flow in porous media is challenging due to the uncertainties in key parameters, such as permeability. To address these challenges, we propose a computational framework by utilizing the novel…

Numerical Analysis · Mathematics 2025-05-13 Ruoyu Hu , Sanjeeb Poudel , Feng Bao , Sanghyun Lee

The Bootstrap Particle Filter (BPF) and the Ensemble Kalman Filter (EnKF) are two widely used methods for sequential Bayesian filtering: the BPF is asymptotically exact but can suffer from weight degeneracy, while the EnKF scales well in…

Methodology · Statistics 2026-01-28 Ilja Klebanov , Claudia Schillings , Dana Wrischnig

We introduce a score-filter-enhanced data assimilation framework designed to reduce predictive uncertainty in machine learning (ML) models for data-driven dynamical system forecasting. Machine learning serves as an efficient numerical model…

Dynamical Systems · Mathematics 2026-03-17 Jingqiao Tang , Ryan Bausback , Feng Bao , Guannan Zhang , Phuoc-Toan Huynh

Nonlinear/non-Gaussian filtering has broad applications in many areas of life sciences where either the dynamic is nonlinear and/or the probability density function of uncertain state is non-Gaussian. In such problems, the accuracy of the…

Computation · Statistics 2012-08-02 Hatef Monajemi , Peter K. Kitanidis

We propose an ensemble score filter (EnSF) for solving high-dimensional nonlinear filtering problems with superior accuracy. A major drawback of existing filtering methods, e.g., particle filters or ensemble Kalman filters, is the low…

Machine Learning · Statistics 2024-08-14 Feng Bao , Zezhong Zhang , Guannan Zhang
‹ Prev 1 2 3 10 Next ›