English
Related papers

Related papers: Ensemble Kalman methods for high-dimensional hiera…

200 papers

The ensemble Kalman inversion is widely used in practice to estimate unknown parameters from noisy measurement data. Its low computational costs, straightforward implementation, and non-intrusive nature makes the method appealing in various…

Numerical Analysis · Mathematics 2019-09-04 Dirk Blömker , Claudia Schillings , Philipp Wacker , Simon Weissmann

Data assimilation is the task to combine evolution models and observational data in order to produce reliable predictions. In this paper, we focus on ensemble-based recursive data assimilation problems. Our main contribution is a hybrid…

Numerical Analysis · Mathematics 2016-02-26 Nawinda Chustagulprom , Sebastian Reich , Maria Reinhardt

We consider the problem of performing Bayesian inference for logistic regression using appropriate extensions of the ensemble Kalman filter. Two interacting particle systems are proposed that sample from an approximate posterior and prove…

Machine Learning · Statistics 2024-07-02 Diksha Bhandari , Jakiw Pidstrigach , Sebastian Reich

In this paper, we propose a new framework for solving state estimation problems with an additional sparsity-promoting $L_1$-regularizer term. We first formulate such problems as minimization of the sum of linear or nonlinear quadratic error…

Information Theory · Computer Science 2019-10-02 Rui Gao , Filip Tronarp , Simo Särkkä

This manuscript derives locally weighted ensemble Kalman methods from the point of view of ensemble-based function approximation. This is done by using pointwise evaluations to build up a local linear or quadratic approximation of a…

Numerical Analysis · Mathematics 2025-05-07 Philipp Wacker

Filtering in spatially-extended dynamical systems is a challenging problem with significant practical applications such as numerical weather prediction. Particle filters allow asymptotically consistent inference but require infeasibly large…

Computation · Statistics 2019-06-04 Matthew M. Graham , Alexandre H. Thiery

We investigate the application of ensemble transform approaches to Bayesian inference of logistic regression problems. Our approach relies on appropriate extensions of the popular ensemble Kalman filter and the feedback particle filter to…

Numerical Analysis · Mathematics 2021-09-27 Jakiw Pidstrigach , Sebastian Reich

Climate change poses significant challenges for accurate climate modeling due to the complexity and variability of non-Gaussian climate systems. To address the complexities of non-Gaussian systems in climate modeling, this thesis proposes a…

Applications · Statistics 2024-06-28 Yunjin Tong

Large-scale dynamic inverse problems are often ill-posed due to model complexity and the high dimensionality of the unknown parameters. Regularization is commonly employed to mitigate ill-posedness by incorporating prior information and…

Numerical Analysis · Mathematics 2026-01-21 Aryeh Keating , Mirjeta Pasha

Data assimilation (DA) is a key component of many forecasting models in science and engineering. DA allows one to estimate better initial conditions using an imperfect dynamical model of the system and noisy/sparse observations available…

Machine Learning · Computer Science 2023-02-01 Ashesh Chattopadhyay , Ebrahim Nabizadeh , Eviatar Bach , Pedram Hassanzadeh

In inverse problems, the goal is to estimate unknown model parameters from noisy observational data. Traditionally, inverse problems are solved under the assumption of a fixed forward operator describing the observation model. In this…

Numerical Analysis · Mathematics 2024-09-26 Simon Weissmann , Neil K. Chada , Xin T. Tong

In this paper, we present the optimization formulation of the Kalman filtering and smoothing problems, and use this perspective to develop a variety of extensions and applications. We first formulate classic Kalman smoothing as a least…

Optimization and Control · Mathematics 2013-03-12 Aleksandr Y. Aravkin , James V. Burke , Gianluigi Pillonetto

Ensemble learning is a mainstay in modern data science practice. Conventional ensemble algorithms assign to base models a set of deterministic, constant model weights that (1) do not fully account for individual models' varying accuracy…

Methodology · Statistics 2019-04-02 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent A. Coull

A computationally efficient method for online joint state inference and dynamical model learning is presented. The dynamical model combines an a priori known, physically derived, state-space model with a radial basis function expansion…

Systems and Control · Electrical Eng. & Systems 2021-07-12 Anton Kullberg , Isaac Skog , Gustaf Hendeby

The purpose of this review is to present a comprehensive overview of the theory of ensemble Kalman-Bucy filtering for continuous-time, linear-Gaussian signal and observation models. We present a system of equations that describe the flow of…

Statistics Theory · Mathematics 2023-06-16 Adrian N. Bishop , Pierre Del Moral

Dynamic inference problems in autoregressive (AR/ARMA/ARIMA), exponential smoothing, and navigation are often formulated and solved using state-space models (SSM), which allow a range of statistical distributions to inform innovations and…

Optimization and Control · Mathematics 2019-10-31 Jonathan Jonker , Peng Zheng , Aleksandr Y. Aravkin

Bayesian filtering approximates the true underlying behavior of a time-varying system by inverting an explicit generative model to convert noisy measurements into state estimates. This process typically requires either storage, inversion,…

Machine Learning · Computer Science 2023-11-20 Gianluca M. Bencomo , Jake C. Snell , Thomas L. Griffiths

Data assimilation techniques, such as ensemble Kalman filtering, have been shown to be a highly effective and efficient way to combine noisy data with a mathematical model to track and forecast dynamical systems. However, when dealing with…

Dynamical Systems · Mathematics 2023-05-17 Stephen A Falconer , David J. B. Lloyd , Naratip Santitissadeekorn

The ensemble Kalman filter (EnKF) is a widely used methodology for state estimation in partial, noisily observed dynamical systems, and for parameter estimation in inverse problems. Despite its widespread use in the geophysical sciences,…

Numerical Analysis · Mathematics 2016-09-21 Claudia Schillings , Andrew M. Stuart

Estimating the state of a dynamical system from partial and noisy observations is a ubiquitous problem in a large number of applications, such as probabilistic weather forecasting and prediction of epidemics. Particle filters are a widely…

Statistics Theory · Mathematics 2025-03-21 E. Calvello , J. A. Carrillo , F. Hoffmann , P. Monmarché , A. M. Stuart , U. Vaes