English
Related papers

Related papers: Auto-differentiable Ensemble Kalman Filters

200 papers

Many data-science problems can be formulated as an inverse problem, where the parameters are estimated by minimizing a proper loss function. When complicated black-box models are involved, derivative-free optimization tools are often…

Numerical Analysis · Mathematics 2021-10-19 Neil K. Chada , Xin T. Tong

The robustness of the Kalman filter to double talk and its rapid convergence make it a popular approach for addressing acoustic echo cancellation (AEC) challenges. However, the inability to model nonlinearity and the need to tune control…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-27 Yixuan Zhang , Meng Yu , Hao Zhang , Dong Yu , DeLiang Wang

In the presence of renewable resources, distribution networks have become extremely complex to monitor, operate and control. Furthermore, for the real time applications, active distribution networks require fast real time distribution state…

Applications · Statistics 2018-04-24 Mehdi Shafiei , Gerard Ledwich , Ghavameddin Nourbakhsh , Ali Arefi , Houman Pezeshki

Quantifying forecast uncertainty is a key aspect of state-of-the-art numerical weather prediction and data assimilation systems. Ensemble-based data assimilation systems incorporate state-dependent uncertainty quantification based on…

Atmospheric and Oceanic Physics · Physics 2023-05-17 Maximiliano A. Sacco , Manuel Pulido , Juan J. Ruiz , Pierre Tandeo

This work embeds a multilevel Monte Carlo sampling strategy into the Monte Carlo step of the ensemble Kalman filter (EnKF) in the setting of finite dimensional signal evolution and noisy discrete-time observations. The signal dynamics is…

Numerical Analysis · Mathematics 2016-06-30 Håkon Hoel , Kody J. H. Law , Raul Tempone

This paper considers the problem of data-driven robust control design for nonlinear systems, for instance, obtained when discretizing nonlinear partial differential equations (PDEs). A robust learning control approach is developed for…

Optimization and Control · Mathematics 2025-09-01 Anant A. Joshi , Saviz Mowlavi , Mouhacine Benosman

We present a practical implementation of the ensemble Kalman (EnKF) filter based on an iterative Sherman-Morrison formula. The new direct method exploits the special structure of the ensemble-estimated error covariance matrices in order to…

Numerical Analysis · Computer Science 2015-02-03 Elias D. Nino-Ruiz , Adrian Sandu , Jeffrey Anderson

This work develops a new multifidelity ensemble Kalman filter (MFEnKF) algorithm based on linear control variate framework. The approach allows for rigorous multifidelity extensions of the EnKF, where the uncertainty in coarser fidelities…

Numerical Analysis · Mathematics 2020-07-03 Andrey A Popov , Changhong Mou , Traian Iliescu , Adrian Sandu

The present research work proposes advancement for Data Assimilation strategies using Convolutional Neural Networks (CNN). More precisely, multi-fidelity and multi-level algorithms for the Ensemble Kalman Filter are enhanced by CNN tools,…

Fluid Dynamics · Physics 2025-07-21 Tom Moussie , Paolo Errante , Marcello Meldi

The Ensemble Kalman Filter (EnKF) belongs to the class of iterative particle filtering methods and can be used for solving control--to--observable inverse problems. In this context, the EnKF is known as Ensemble Kalman Inversion (EKI). In…

Numerical Analysis · Mathematics 2022-02-17 Dieter Armbruster , Michael Herty , Giuseppe Visconti

The extended Kalman filter (EKF) is a widely adopted method for sensor fusion in navigation applications. A crucial aspect of the EKF is the online determination of the process noise covariance matrix reflecting the model uncertainty. While…

Robotics · Computer Science 2025-03-11 Nadav Cohen , Itzik Klein

The ensemble Kalman filter (EnKF) is widely used to sample a probability density function (pdf) generated by a stochastic model conditioned by noisy data. This pdf can be either a joint posterior that describes the evolution of the state of…

Data Analysis, Statistics and Probability · Physics 2016-08-08 Matthias Morzfeld , Daniel Hodyss

We investigate the applicability of the data assimilation (DA) to large eddy simulations (LESs) based on the lattice Boltzmann method (LBM). We carry out the observing system simulation experiment of a two-dimensional (2D) forced isotropic…

We consider the problem of filtering dynamical systems, possibly stochastic, using observations of statistics. Thus, the computational task is to estimate a time-evolving density $\rho(v, t)$ given noisy observations of the true density…

Methodology · Statistics 2024-03-12 Eviatar Bach , Tim Colonius , Isabel Scherl , Andrew Stuart

Heavy tails is a common feature of filtering distributions that results from the nonlinear dynamical and observation processes as well as the uncertainty from physical sensors. In these settings, the Kalman filter and its ensemble version -…

Computation · Statistics 2023-10-16 Mathieu Le Provost , Ricardo Baptista , Jeff D. Eldredge , Youssef Marzouk

The Kalman Filter (KF) is a powerful mathematical tool widely used for state estimation in various domains, including Simultaneous Localization and Mapping (SLAM). This paper presents an in-depth introduction to the Kalman Filter and…

Robotics · Computer Science 2024-07-01 Gyubeom Im

The Ensemble Kalman Filter (EnKF) is a popular estimation technique in the geosciences. It is used as a numerical tool for state vector prognosis and parameter estimation. The EnKF can, for example, help to evaluate the geothermal potential…

Applications · Statistics 2018-09-17 Johannes Keller , Harrie-Jan Hendricks Franssen , Gabriele Marquart

Variational inference (VI) combined with Bayesian nonlinear filtering produces state-of-the-art results for latent time-series modeling. A body of recent work has focused on sequential Monte Carlo (SMC) and its variants, e.g., forward…

Machine Learning · Statistics 2021-11-10 Tsuyoshi Ishizone , Tomoyuki Higuchi , Kazuyuki Nakamura

The accuracy of Earth system models is compromised by unknown and/or unresolved dynamics, making the quantification of systematic model errors essential. While a model parameter estimation, which allows parameters to change…

Methodology · Statistics 2023-10-04 Yohei Sawada , Le Duc

We propose a robust ensemble filtering scheme based on the $H_{\infty}$ filtering theory. The optimal $H_{\infty}$ filter is derived by minimizing the supremum (or maximum) of a predefined cost function, a criterion different from the…

Data Analysis, Statistics and Probability · Physics 2015-05-30 Xiaodong Luo , Ibrahim Hoteit