English
Related papers

Related papers: DAFI: An Open-Source Framework for Ensemble-Based …

200 papers

Prediction of chaotic systems relies on a floating fusion of sensor data (observations) with a numerical model to decide on a good system trajectory and to compensate nonlinear feedback effects. Ensemble-based data assimilation (DA) is a…

Computational Engineering, Finance, and Science · Computer Science 2020-11-26 Sebastian Friedemann , Bruno Raffin

Ensemble Kalman methods are widely used for state estimation in the geophysical sciences. Their success stems from the fact that they take an underlying (possibly noisy) dynamical system as a black box to provide a systematic,…

Optimization and Control · Mathematics 2024-10-10 Edoardo Calvello , Sebastian Reich , Andrew M. Stuart

We study the ensemble Kalman filter (EnKF) algorithm for sequential data assimilation in a general situation, that is, for nonlinear forecast and measurement models with non-additive and non-Gaussian noises. Such applications traditionally…

Methodology · Statistics 2018-08-17 Weixuan Li , W. Steven Rosenthal , Guang Lin

Wireless sensor networks consist of sensor nodes that are physically distributed over different locations. Spatial filtering procedures exploit the spatial correlation across these sensor signals to fuse them into a filtered signal…

Signal Processing · Electrical Eng. & Systems 2022-11-04 Cem Ates Musluoglu , Alexander Bertrand

We develop an algebraic framework for sequential data assimilation of partially observed dynamical systems. In this framework, Bayesian data assimilation is embedded in a non-abelian operator algebra, which provides a representation of…

Statistics Theory · Mathematics 2023-03-29 David Freeman , Dimitrios Giannakis , Brian Mintz , Abbas Ourmazd , Joanna Slawinska

Many modern algorithms for inverse problems and data assimilation rely on ensemble Kalman updates to blend prior predictions with observed data. Ensemble Kalman methods often perform well with a small ensemble size, which is essential in…

Machine Learning · Statistics 2024-01-05 Omar Al Ghattas , Daniel Sanz-Alonso

This paper is concerned with the problem of tracking single or multiple targets with multiple non-target specific observations (measurements). For such filtering problems with data association uncertainty, a novel feedback control-based…

Probability · Mathematics 2014-04-18 Tao Yang , Prashant G. Mehta

The Ensemble Score Filter (EnSF) has emerged as a promising approach to leverage score-based diffusion models for solving high-dimensional and nonlinear data assimilation problems. While initial applications of EnSF to the Lorenz-96 model…

Numerical Analysis · Mathematics 2025-10-24 Zezhong Zhang , Feng Bao , Guannan Zhang

A framework for data assimilation combining aspects of operator-theoretic ergodic theory and quantum mechanics is developed. This framework adapts the Dirac--von Neumann formalism of quantum dynamics and measurement to perform sequential…

Mathematical Physics · Physics 2019-09-18 Dimitrios Giannakis

Data Assimilation is a cornerstone of atmospheric system modeling, tasked with reconstructing system states by integrating sparse, noisy observations with prior estimation. While traditional approaches like variational and ensemble Kalman…

Machine Learning · Computer Science 2025-11-04 Hao Wang , Zixuan Weng , Jindong Han , Wei Fan , Hao Liu

Because of physical assumptions and numerical approximations, low-order models are affected by uncertainties in the state and parameters, and by model biases. Model biases, also known as model errors or systematic errors, are difficult to…

Methodology · Statistics 2024-10-10 Andrea Nóvoa , Alberto Racca , Luca Magri

The Ensemble Kalman inversion (EKI) method is a method for the estimation of unknown parameters in the context of (Bayesian) inverse problems. The method approximates the underlying measure by an ensemble of particles and iteratively…

Numerical Analysis · Mathematics 2021-08-02 Dirk Blömker , Claudia Schillings , Philipp Wacker , Simon Weissmann

The forecasting skill of numerical weather prediction (NWP) models critically depends on the accurate initial conditions, also known as analysis, provided by data assimilation (DA). Traditional DA methods often face a trade-off between…

Atmospheric and Oceanic Physics · Physics 2024-11-28 Yanfei Xiang , Weixin Jin , Haiyu Dong , Mingliang Bai , Zuliang Fang , Pengcheng Zhao , Hongyu Sun , Kit Thambiratnam , Qi Zhang , Xiaomeng Huang

This survey paper is written with the intention of giving a mathematical introduction to filtering techniques for intermittent data assimilation, and to survey some recent advances in the field. The paper is divided into three parts. The…

Numerical Analysis · Mathematics 2012-09-03 Colin J. Cotter , Sebastian Reich

Reduced-order models based on level-set methods are widely used tools to qualitatively capture and track the nonlinear dynamics of an interface. The aim of this paper is to develop a physics-informed, data-driven, statistically rigorous…

Computational Physics · Physics 2019-09-20 Hans Yu , Matthew P. Juniper , Luca Magri

The Ensemble Kalman Filter (EnKF) belongs to the class of iterative particle filtering methods and can be used for solving control--to--observable inverse problems. In this context, the EnKF is known as Ensemble Kalman Inversion (EKI). In…

Numerical Analysis · Mathematics 2022-02-17 Dieter Armbruster , Michael Herty , Giuseppe Visconti

We are interested in ensemble methods to solve multi-objective optimization problems. An ensemble Kalman method is proposed to solve a formulation of the nonlinear problem using a weighted function approach. An analysis of the mean field…

Numerical Analysis · Mathematics 2022-03-21 Michael Herty , Elisa Iacomini

We consider the problem of performing Bayesian inference for logistic regression using appropriate extensions of the ensemble Kalman filter. Two interacting particle systems are proposed that sample from an approximate posterior and prove…

Machine Learning · Statistics 2024-07-02 Diksha Bhandari , Jakiw Pidstrigach , Sebastian Reich

The increasing availability of data presents an opportunity to calibrate unknown parameters which appear in complex models of phenomena in the biomedical, physical and social sciences. However, model complexity often leads to…

Numerical Analysis · Mathematics 2022-01-25 Oliver R. A. Dunbar , Andrew B. Duncan , Andrew M. Stuart , Marie-Therese Wolfram

Data assimilation (DA) integrates observational information with model predictions to improve state estimation in complex systems. While filtering provides the basis for online forecasts by using only past and present observations, it can…

Numerical Analysis · Mathematics 2026-05-05 Zhang Jiang , Marios Andreou , Sebastian Reich , Nan Chen