English
Related papers

Related papers: Sampling error correction in ensemble Kalman inver…

200 papers

The use of model order reduction techniques in combination with ensemble-based methods for estimating the state of systems described by nonlinear partial differential equations has been of great interest in recent years in the data…

Numerical Analysis · Mathematics 2024-12-18 Francesco A. B. Silva , Cecilia Pagliantini , Karen Veroy

Quantum error mitigation (QEM) is a class of promising techniques for reducing the computational error of variational quantum algorithms. In general, the computational error reduction comes at the cost of a sampling overhead due to the…

Quantum Physics · Physics 2022-01-21 Yifeng Xiong , Soon Xin Ng , Lajos Hanzo

This paper proposes new methodology for sequential state and parameter estimation within the ensemble Kalman filter. The method is fully Bayesian and propagates the joint posterior density of states and parameters over time. In order to…

Methodology · Statistics 2016-11-14 Jonathan R. Stroud , Matthias Katzfuss , Christopher K. Wikle

The ensemble random forest filter (ERFF) is presented as an alternative to the ensemble Kalman filter (EnKF) for the purpose of inverse modeling. The EnKF is a data assimilation approach that forecasts and updates parameter estimates…

Machine Learning · Computer Science 2022-07-11 Vanessa A. Godoy , Gian F. Napa-García , J. Jaime Gómez-Hernández

We address unsupervised dependency parsing by building an ensemble of diverse existing models through post hoc aggregation of their output dependency parse structures. We observe that these ensembles often suffer from low robustness against…

Computation and Language · Computer Science 2025-04-22 Behzad Shayegh , Hobie H. -B. Lee , Xiaodan Zhu , Jackie Chi Kit Cheung , Lili Mou

Ensemble data assimilation methods such as the Ensemble Kalman Filter (EnKF) are a key component of probabilistic weather forecasting. They represent the uncertainty in the initial conditions by an ensemble which incorporates information…

Applications · Statistics 2018-10-17 Sylvain Robert , Daniel Leuenberger , Hans R. Künsch

Despite the cheap availability of computing resources enabling faster Monte Carlo simulations, the potential benefits of particle filtering in revealing accurate statistical information on the imprecisely known model parameters or modeling…

Methodology · Statistics 2014-02-07 Saikat Sarkar , Debasish Roy

The ensemble Kalman inversion (EKI) is a particle based method which has been introduced as the application of the ensemble Kalman filter to inverse problems. In practice it has been widely used as derivative-free optimization method in…

Numerical Analysis · Mathematics 2022-09-21 Simon Weissmann

Ensemble learning is a mainstay in modern data science practice. Conventional ensemble algorithms assign to base models a set of deterministic, constant model weights that (1) do not fully account for individual models' varying accuracy…

Methodology · Statistics 2019-04-02 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent A. Coull

Ensemble randomized maximum likelihood (EnRML) is an iterative (stochastic) ensemble smoother, used for large and nonlinear inverse problems, such as history matching and data assimilation. Its current formulation is overly complicated and…

Data Analysis, Statistics and Probability · Physics 2019-09-12 Patrick N. Raanes , Geir Evensen , Andreas S. Stordal

Convergence of the ensemble Kalman filter in the limit for large ensembles to the Kalman filter is proved. In each step of the filter, convergence of the ensemble sample covariance follows from a weak law of large numbers for exchangeable…

Statistics Theory · Mathematics 2012-01-31 Jan Mandel , Loren Cobb , Jonathan D. Beezley

Ensemble models refer to methods that combine a typically large number of classifiers into a compound prediction. The output of an ensemble method is the result of fitting a base-learning algorithm to a given data set, and obtaining diverse…

Machine Learning · Statistics 2019-06-10 Waldyn Martinez

In stochastic systems, informative approaches select key measurement or decision variables that maximize information gain to enhance the efficacy of model-related inferences. Neural Learning also embodies stochastic dynamics, but…

Machine Learning · Computer Science 2020-08-25 Margaret Trautner , Gabriel Margolis , Sai Ravela

In this paper, we study efficient approximate sampling for probability distributions known up to normalization constants. We specifically focus on a problem class arising in Bayesian inference for large-scale inverse problems in science and…

Machine Learning · Computer Science 2024-10-14 Yifan Chen , Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

Simulator imperfection, often known as model error, is ubiquitous in practical data assimilation problems. Despite the enormous efforts dedicated to addressing this problem, properly handling simulator imperfection in data assimilation…

Optimization and Control · Mathematics 2019-08-06 Xiaodong Luo

We present a method of parameter estimation for large class of nonlinear systems, namely those in which the state consists of output derivatives and the flow is linear in the parameter. The method, which solves for the unknown parameter by…

Systems and Control · Electrical Eng. & Systems 2024-07-16 Simon Kuang , Xinfan Lin

The Derivative-free nonlinear Kalman Filter is proposed for state estimation and fault diagnosis in distributed parameter systems and particularly in dynamical systems described by partial differential equations of the nonlinear wave type.…

Systems and Control · Computer Science 2013-11-05 Gerasimos G. Rigatos

Several numerical tools designed to overcome the challenges of smoothing in a nonlinear and non-Gaussian setting are investigated for a class of particle smoothers. The considered family of smoothers is induced by the class of linear…

Numerical Analysis · Mathematics 2019-10-29 Jana de Wiljes , Sahani Pathiraja , Sebastian Reich

In many areas of science and engineering, it is a common task to infer physical fields from sparse observations. This paper presents the DAFI code intended as a flexible framework for two broad classes of such inverse problems: data…

Computational Physics · Physics 2020-12-07 Carlos A. Michelén Ströfer , Xin-Lei Zhang , Heng Xiao

This paper extends the ensemble Kalman filter (EnKF) for inverse problems to identify trending model coefficients. This is done by repeatedly inflating the ensemble while maintaining the mean of the particles. As a benchmark serves a…

Optimization and Control · Mathematics 2020-01-30 M. Schwenzer , G. Visconti , M. Ay , T. Bergs , M. Herty , D. Abel