中文
相关论文

相关论文: A Data-Consistent Approach to Ensemble Filtering

200 篇论文

Data assimilation (DA) aims to optimally combine model forecasts and observations that are both partial and noisy. Multi-model DA generalizes the variational or Bayesian formulation of the Kalman filter, and we prove that it is also the…

统计方法学 · 统计学 2023-01-23 Eviatar Bach , Michael Ghil

We present a novel sampling-based method for estimating probabilities of rare or failure events. Our approach is founded on the Ensemble Kalman filter (EnKF) for inverse problems. Therefore, we reformulate the rare event problem as an…

数值分析 · 数学 2021-12-15 Fabian Wagner , Iason Papaioannou , Elisabeth Ullmann

This paper develops an efficient implementation of the ensemble Kalman filter based on a modified Cholesky decomposition for inverse covariance matrix estimation. This implementation is named EnKF-MC. Background errors corresponding to…

统计理论 · 数学 2016-05-31 Elias D. Nino , Adrian Sandu , Xinwei Deng

Data assimilation (DA) estimates a dynamical system's state from noisy observations. Recent generative models like the ensemble score filter (EnSF) improve DA in high-dimensional nonlinear settings but are computationally expensive. We…

机器学习 · 统计学 2025-09-30 Taos Transue , Bohan Chen , So Takao , Bao Wang

Ensemble-based data assimilation (DA) methods have become increasingly popular due to their inherent ability to address nonlinear dynamic problems. However, these methods often face a trade-off between analysis accuracy and computational…

机器学习 · 计算机科学 2026-05-26 Zhilin Li , Zhou Yao , Xianglong Li , Zeng Liu , Zhaokuan Lu , Shanlin Xu , Seungnam Kim , Guangyao Wang

The sample covariance matrix of a random vector is a good estimate of the true covariance matrix if the sample size is much larger than the length of the vector. In high-dimensional problems, this condition is never met. As a result, in…

数据分析、统计与概率 · 物理学 2024-11-12 Michael Tsyrulnikov , Arseniy Sotskiy

Data assimilation provides algorithms for widespread applications in various fields. It is of practical use to deal with a large amount of information in the complex system that is hard to estimate. Weather forecasting is one of the…

最优化与控制 · 数学 2023-03-23 Yihua Yang

We propose a Dynamical Low-Rank Ensemble Kalman Filter (DLR-ENKF) for efficient joint state-parameter estimation in high-dimensional dynamical systems. The method extends the DLR-ENKF formulation of arXiv:2509.11210 to the augmented…

数值分析 · 数学 2026-02-09 Fabio Nobile , Sébastien Riffaud , Thomas Trigo Trindade

The Bootstrap Particle Filter (BPF) and the Ensemble Kalman Filter (EnKF) are two widely used methods for sequential Bayesian filtering: the BPF is asymptotically exact but can suffer from weight degeneracy, while the EnKF scales well in…

统计方法学 · 统计学 2026-01-28 Ilja Klebanov , Claudia Schillings , Dana Wrischnig

The filtering distribution in hidden Markov models evolves according to the law of a mean-field model in state-observation space. The ensemble Kalman filter (EnKF) approximates this mean-field model with an ensemble of interacting…

机器学习 · 统计学 2025-12-25 Eviatar Bach , Ricardo Baptista , Edoardo Calvello , Bohan Chen , Andrew Stuart

The Ensemble Kalman Filter (EnKF) has achieved great successes in data assimilation in atmospheric and oceanic sciences, but its failure in convergence to the right filtering distribution precludes its use for uncertainty quantification. We…

统计方法学 · 统计学 2021-05-13 Peiyi Zhang , Qifan Song , Faming Liang

Data assimilation combines information from models, measurements, and priors to estimate the state of a dynamical system such as the atmosphere. The Ensemble Kalman filter (EnKF) is a family of ensemble-based data assimilation approaches…

计算工程、金融与科学 · 计算机科学 2014-12-09 Ahmed Attia , Adrian Sandu

We develop a self contained stochastic perturbation theory for discrete generation and multivariate Ensemble Kalman filters. Unlike their continuous-time counterparts, discrete EnKF algorithms are defined through a two steps prediction…

概率论 · 数学 2026-01-28 Pierre Del Moral , Bouchra Nasri , Bruno Rémillard

Data assimilation plays a pivotal role in understanding and predicting turbulent systems within geoscience and weather forecasting, where data assimilation is used to address three fundamental challenges, i.e., high-dimensionality,…

大气与海洋物理 · 物理学 2025-01-23 Siming Liang , Hoang Tran , Feng Bao , Hristo G. Chipilski , Peter Jan van Leeuwen , Guannan Zhang

This work introduces a new, distributed implementation of the Ensemble Kalman Filter (EnKF) that allows for non-sequential assimilation of large datasets in high-dimensional problems. The traditional EnKF algorithm is computationally…

机器学习 · 统计学 2023-11-23 Cédric Travelletti , Jörg Franke , David Ginsbourger , Stefan Brönnimann

This work presents new results and understanding of the Ensemble Kalman filter (EnKF) for inverse problems. In particular, using a Lagrangian dual perspective we show that EnKF can be derived from the sample average approximation (SAA) of…

数值分析 · 数学 2026-01-27 C G Krishnanunni , Jonathan Wittmer , Tan Bui-Thanh , Quoc P. Nguyen

This article shows that increasing the observation variance at small scales can reduce the ensemble size required to avoid collapse in particle filtering of spatially-extended dynamics and improve the resulting uncertainty quantification at…

应用统计 · 统计学 2018-08-15 Gregor Robinson , Ian Grooms , William Kleiber

The ensemble Kalman filter (EnKF) is a widely used methodology for state estimation in partial, noisily observed dynamical systems, and for parameter estimation in inverse problems. Despite its widespread use in the geophysical sciences,…

数值分析 · 数学 2016-09-21 Claudia Schillings , Andrew M. Stuart

We consider the problem of an ensemble Kalman filter when only partial observations are available. In particular we consider the situation where the observational space consists of variables which are directly observable with known…

数据分析、统计与概率 · 物理学 2011-08-31 Georg A. Gottwald , Lewis Mitchell , Sebastian Reich

Ensemble-based Data Assimilation faces significant challenges in high-dimensional systems due to spurious correlations and ensemble collapse. These issues arise from estimating dense dependencies with limited ensemble sizes. This paper…

统计方法学 · 统计学 2025-01-16 Berent Ånund Strømnes Lunde