English
Related papers

Related papers: Ensemble Kalman Inversion for nonlinear problems: …

200 papers

Ensemble methods have become ubiquitous for the solution of Bayesian inference problems. State-of-the-art Langevin samplers such as the Ensemble Kalman Sampler (EKS), Affine Invariant Langevin Dynamics (ALDI) or its extension using weighted…

Numerical Analysis · Mathematics 2022-12-23 Martin Eigel , Robert Gruhlke , David Sommer

Data assimilation is concerned with sequentially estimating a temporally-evolving state. This task, which arises in a wide range of scientific and engineering applications, is particularly challenging when the state is high-dimensional and…

Machine Learning · Statistics 2021-07-21 Yuming Chen , Daniel Sanz-Alonso , Rebecca Willett

In this study, an efficient stochastic gradient-free method, the ensemble neural networks (ENN), is developed. In the ENN, the optimization process relies on covariance matrices rather than derivatives. The covariance matrices are…

Machine Learning · Statistics 2019-11-11 Yuntian Chen , Haibin Chang , Meng Jin , Dongxiao Zhang

This paper presents an innovative Reduced-Order Model (ROM) for merging experimental and simulation data using Data Assimilation (DA) to estimate the "True" state of a fluid dynamics system, leading to more accurate predictions. Our…

Computational Engineering, Finance, and Science · Computer Science 2025-07-03 Paul Jeanney , Ashton Hetherington , Shady E. Ahmed , David Lanceta , Susana Saiz , José Miguel Perez , Soledad Le Clainche

In this paper, we study efficient approximate sampling for probability distributions known up to normalization constants. We specifically focus on a problem class arising in Bayesian inference for large-scale inverse problems in science and…

Machine Learning · Computer Science 2024-10-14 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

The Bayesian approach to inverse problems is widely used in practice to infer unknown parameters from noisy observations. In this framework, the ensemble Kalman inversion has been successfully applied for the quantification of uncertainties…

Numerical Analysis · Mathematics 2019-10-15 Neil K. Chada , Claudia Schillings , Simon Weissmann

The Kalman filter is ubiquitous for state space models because of its desirable statistical properties, ease of implementation, and generally good performance. However, it can perform poorly in the presence of outliers, or measurements with…

Systems and Control · Electrical Eng. & Systems 2025-02-26 Michael J. Walsh

The ensemble Kalman inversion (EKI), as a derivative-free methodology, has been widely used in the parameter estimation of inverse problems. Unfortunately, its cost may become moderately large for systems described by high dimensional…

Numerical Analysis · Mathematics 2018-09-25 Liang Yan , Tao Zhou

The widely-used Extended Kalman Filter (EKF) provides a straightforward recipe to estimate the mean and covariance of the state given all past measurements in a causal and recursive fashion. For a wide variety of applications, the EKF is…

Robotics · Computer Science 2023-03-28 Stephanie Tsuei , Stefano Soatto , Paulo Tabuada , Mark B. Milam

We introduce a new multilevel ensemble Kalman filter method (MLEnKF) which consists of a hierarchy of independent samples of ensemble Kalman filters (EnKF). This new MLEnKF method is fundamentally different from the preexisting method…

Numerical Analysis · Mathematics 2020-09-22 Håkon Hoel , Gaukhar Shaimerdenova , Raúl Tempone

Accurate estimation and forecasting of energy consumption are important for power-system operation, planning, and demand-side management. In practice, however, complete and timely measurements may not always be available, and the observed…

Machine Learning · Computer Science 2026-05-29 Ruoyu Hu , Dahai Yu , Feng Bao , Guang Wang , Guannan Zhang

We investigate the application of ensemble transform approaches to Bayesian inference of logistic regression problems. Our approach relies on appropriate extensions of the popular ensemble Kalman filter and the feedback particle filter to…

Numerical Analysis · Mathematics 2021-09-27 Jakiw Pidstrigach , Sebastian Reich

This paper is concerned with the filtering problem in continuous-time. Three algorithmic solution approaches for this problem are reviewed: (i) the classical Kalman-Bucy filter which provides an exact solution for the linear Gaussian…

Optimization and Control · Mathematics 2017-12-22 Amirhossein Taghvaei , Jana de Wiljes , Prashant G. Mehta , Sebastian Reich

Many parameter estimation problems arising in applications are best cast in the framework of Bayesian inversion. This allows not only for an estimate of the parameters, but also for the quantification of uncertainties in the estimates.…

Computation · Statistics 2020-10-28 Emmet Cleary , Alfredo Garbuno-Inigo , Shiwei Lan , Tapio Schneider , Andrew M Stuart

Rapid resource model updating with real-time data is important for making timely decisions in resource management and mining operations. This requires optimal merging of models and observations, which can be achieved through data…

Applications · Statistics 2025-06-03 Sultan Abulkhair , Peter Dowd , Chaoshui Xu , Penny Stewart

Many modern algorithms for inverse problems and data assimilation rely on ensemble Kalman updates to blend prior predictions with observed data. Ensemble Kalman methods often perform well with a small ensemble size, which is essential in…

Machine Learning · Statistics 2024-01-05 Omar Al Ghattas , Daniel Sanz-Alonso

This paper introduces the ensemble directional Kalman filter (EnDKF), an ensemble-based Kalman filtering approach for pose tracking that jointly estimates an object's position and attitude using ideas from directional statistics. The EnDKF…

Machine Learning · Computer Science 2026-05-06 Tianlu Lu , Asif Sijan , Thomas Noh , Huaijin Chen , Andrey A. Popov

We consider the problem of state estimation in dynamical systems and propose a different mechanism for handling unmodeled system uncertainties. Instead of injecting random process noise, we assign different weights to measurements so that…

Information Theory · Computer Science 2020-09-08 Yaron Shulami , Daniel Sigalov

Recent advances in counter-adversarial systems have garnered significant research attention to inverse filtering from a Bayesian perspective. For example, interest in estimating the adversary's Kalman filter tracked estimate with the…

Optimization and Control · Mathematics 2023-08-15 Himali Singh , Arpan Chattopadhyay , Kumar Vijay Mishra

Particle filtering (PF) is an often used method to estimate the states of dynamical systems. A major limitation of the standard PF method is that the dimensionality of the state space increases as the time proceeds and eventually may cause…

Computation · Statistics 2019-08-30 Linjie Wen , Jiangqi Wu , Linjun Lu , Jinglai Li