English
Related papers

Related papers: Ensemble transform Kalman-Bucy filters

200 papers

Currently, more and more machine learning (ML) surrogates are being developed for computationally expensive physical models. In this work we investigate the use of a Multi-Fidelity Ensemble Kalman Filter (MF-EnKF) in which the low-fidelity…

Machine Learning · Computer Science 2025-12-16 Jeffrey van der Voort , Martin Verlaan , Hanne Kekkonen

We propose a new type of the Ensemble Kalman Filter (EnKF), which uses the Fast Fourier Transform (FFT) for covariance estimation from a very small ensemble with automatic tapering, and for a fast computation of the analysis ensemble by…

Atmospheric and Oceanic Physics · Physics 2011-08-01 Jan Mandel , Jonathan D. Beezley , Volodymyr Y. Kondratenko

We investigate an algorithm named histogram transform ensembles (HTE) density estimator whose effectiveness is supported by both solid theoretical analysis and significant experimental performance. On the theoretical side, by decomposing…

Statistics Theory · Mathematics 2019-11-27 Hanyuan Hang

A powerful way to improve performance in machine learning is to construct an ensemble that combines the predictions of multiple models. Ensemble methods are often much more accurate and lower variance than the individual classifiers that…

Machine Learning · Computer Science 2024-12-03 Antonio Macaluso , Luca Clissa , Stefano Lodi , Claudio Sartori

The ensemble Kalman filter is widely used in applications because, for high dimensional filtering problems, it has a robustness that is not shared for example by the particle filter; in particular it does not suffer from weight collapse.…

Optimization and Control · Mathematics 2024-08-29 J. A. Carrillo , F. Hoffmann , A. M. Stuart , U. Vaes

Smoothing is essential to many oceanographic, meteorological and hydrological applications. The interval smoothing problem updates all desired states within a time interval using all available observations. The fixed-lag smoothing problem…

Chaotic Dynamics · Physics 2015-06-26 S. Ravela , D. McLaughlin

Model merging aims to combine multiple task-specific expert models into a single model while preserving generalization across diverse tasks. However, interference among experts, especially when they are trained on different objectives,…

Computation and Language · Computer Science 2026-04-09 Bo Xu , Haotian Wu , Hehai Lin , Weiquan Huang , Beier Zhu , Yao Shu , Chengwei Qin

In this technical note, we prove that the ODEFTC algorithm constitutes the first optimal distributed state estimator for continuous-time linear time-varying systems subject to stochastic disturbances. Particularly, we formally show that it…

Optimization and Control · Mathematics 2025-10-22 Irene Perez-Salesa , Rodrigo Aldana-Lopez , Carlos Sagues

Ensemble forecasting is a technique devised to palliate sensitivity to initial conditions in nonlinear dynamical systems. The basic idea to avoid this sensitivity is to run the model many times under several slightly-different initial…

Atmospheric and Oceanic Physics · Physics 2015-06-26 F J Tapiador , R Verdejo

The efficiency of statistical sampling in broad-histogram Monte Carlo simulations can be considerably improved by optimizing the simulated extended ensemble for fastest equilibration. Here we describe how a recently developed feedback…

Statistical Mechanics · Physics 2007-12-13 Stefan Wessel , Norbert Stoop , Emanuel Gull , Simon Trebst , Matthias Troyer

Variational inference (VI) combined with Bayesian nonlinear filtering produces state-of-the-art results for latent time-series modeling. A body of recent work has focused on sequential Monte Carlo (SMC) and its variants, e.g., forward…

Machine Learning · Statistics 2021-11-10 Tsuyoshi Ishizone , Tomoyuki Higuchi , Kazuyuki Nakamura

Bayesian inference offers a robust framework for updating prior beliefs based on new data using Bayes' theorem, but exact inference is often computationally infeasible, necessitating approximate methods. Though widely used, these methods…

Machine Learning · Statistics 2024-10-23 Xu-Hui Zhou , Zhuo-Ran Liu , Heng Xiao

Conventional approximations to Bayesian inference rely on either approximations by statistics such as mean and covariance or by point particles. Recent advances such as the ensemble Gaussian mixture filter have generalized these notions to…

Optimization and Control · Mathematics 2025-04-10 Andrey A Popov

Bayesian experimental design (BED) offers a principled framework for optimizing data acquisition by leveraging probabilistic inference. However, practical implementations of BED are often compromised by model discrepancy, i.e., the mismatch…

Machine Learning · Computer Science 2025-11-25 Huchen Yang , Xinghao Dong , Jin-Long Wu

This research introduces a novel methodology for optimizing Bayesian Neural Networks (BNNs) by synergistically integrating them with traditional machine learning algorithms such as Random Forests (RF), Gradient Boosting (GB), and Support…

Machine Learning · Computer Science 2023-10-10 Peiwen Tan

Parameters in climate models are usually calibrated manually, exploiting only small subsets of the available data. This precludes both optimal calibration and quantification of uncertainties. Traditional Bayesian calibration methods that…

Statistics Theory · Mathematics 2021-10-04 Oliver R. A. Dunbar , Alfredo Garbuno-Inigo , Tapio Schneider , Andrew M. Stuart

We present a practical implementation of the ensemble Kalman (EnKF) filter based on an iterative Sherman-Morrison formula. The new direct method exploits the special structure of the ensemble-estimated error covariance matrices in order to…

Numerical Analysis · Computer Science 2015-02-03 Elias D. Nino-Ruiz , Adrian Sandu , Jeffrey Anderson

We extend the Kalman-Bucy filter to the case where both the system and observation processes are driven by finite dimensional L\'{e}vy processes, but whereas the process driving the system dynamics is square-integrable, that driving the…

Probability · Mathematics 2014-04-09 David Applebaum , Stefan Blackwood

The pseudopotential lattice Boltzmann method (LBM) is a prominent approach for simulating multiphase flows, valued for its physical intuitiveness and computational tractability. However, existing immiscible pseudopotential methods for…

Fluid Dynamics · Physics 2026-03-02 Yizhong Chen , Zhibin Wang

In the current era, known as Noisy Intermediate-Scale Quantum (NISQ), encoding large amounts of data in the quantum devices is challenging and the impact of noise significantly affects the quality of the obtained results. A viable approach…

Emerging Technologies · Computer Science 2024-03-26 Emiliano Tolotti , Enrico Zardini , Enrico Blanzieri , Davide Pastorello