English
Related papers

Related papers: A data-driven method for improving the correlation…

200 papers

Standard methods of data assimilation assume prior knowledge of a model that describes the system dynamics and an observation function that maps the model state to a predicted output. An accurate mapping from model state to observation…

Dynamical Systems · Mathematics 2019-05-22 Franz Hamilton , Tyrus Berry , Timothy Sauer

Data assimilation is concerned with sequentially estimating a temporally-evolving state. This task, which arises in a wide range of scientific and engineering applications, is particularly challenging when the state is high-dimensional and…

Machine Learning · Statistics 2021-07-21 Yuming Chen , Daniel Sanz-Alonso , Rebecca Willett

The Ensemble Kalman filter assumes the observations to be Gaussian random variables with a pre-specified mean and variance. In practice, observations may also have detection limits, for instance when a gauge has a minimum or maximum value.…

Optimization and Control · Mathematics 2018-11-14 Abhishek Shah , Mohamad El Gharamti , Laurent Bertino

This paper studies the distributed state estimation in sensor network, where $m$ sensors are deployed to infer the $n$-dimensional state of a linear time-invariant (LTI) Gaussian system. By a lossless decomposition of optimal steady-state…

Systems and Control · Electrical Eng. & Systems 2022-04-22 Jiaqi Yan , Xu Yang , Yilin Mo , Keyou You

This manuscript derives locally weighted ensemble Kalman methods from the point of view of ensemble-based function approximation. This is done by using pointwise evaluations to build up a local linear or quadratic approximation of a…

Numerical Analysis · Mathematics 2025-05-07 Philipp Wacker

Inverse problems are more challenging when only partial data are available in general. In this paper, we propose a two-step approach combining the extended sampling method and the ensemble Kalman filter to reconstruct an elastic rigid…

Numerical Analysis · Mathematics 2020-10-13 Zhaoxing Li , Jiguang Sun , Liwei Xu

The use of data assimilation for the merging of observed data with dynamical models is becoming standard in modern physics. If a parametric model is known, methods such as Kalman filtering have been developed for this purpose. If no model…

Data Analysis, Statistics and Probability · Physics 2018-01-17 Franz Hamilton , Tyrus Berry , Timothy Sauer

We consider the problem of data-assisted forecasting of chaotic dynamical systems when the available data is in the form of noisy partial measurements of the past and present state of the dynamical system. Recently there have been several…

Machine Learning · Computer Science 2021-06-02 Alexander Wikner , Jaideep Pathak , Brian R. Hunt , Istvan Szunyogh , Michelle Girvan , Edward Ott

Real-time nonlinear Bayesian filtering algorithms are overwhelmed by data volume, velocity and increasing complexity of computational models. In this paper, we propose a novel ensemble based nonlinear Bayesian filtering approach which only…

Computation · Statistics 2019-06-05 Xiao Lin , Gabriel Terejanu

We consider the problem of conditioning a geological process-based computer simulation, which produces basin models by simulating transport and deposition of sediments, to data. Emphasising uncertainty quantification, we frame this as a…

Applications · Statistics 2017-11-22 Jacob Skauvold , Jo Eidsvik

We consider the Ensemble Kalman Inversion which has been recently introduced as an efficient, gradient-free optimisation method to estimate unknown parameters in an inverse setting. In the case of large data sets, the Ensemble Kalman…

Numerical Analysis · Mathematics 2023-12-05 Matei Hanu , Jonas Latz , Claudia Schillings

This paper proposes new methodology for sequential state and parameter estimation within the ensemble Kalman filter. The method is fully Bayesian and propagates the joint posterior density of states and parameters over time. In order to…

Methodology · Statistics 2016-11-14 Jonathan R. Stroud , Matthias Katzfuss , Christopher K. Wikle

Data assimilation (DA) is a key component of many forecasting models in science and engineering. DA allows one to estimate better initial conditions using an imperfect dynamical model of the system and noisy/sparse observations available…

Machine Learning · Computer Science 2023-02-01 Ashesh Chattopadhyay , Ebrahim Nabizadeh , Eviatar Bach , Pedram Hassanzadeh

In this paper, we consider a dynamic linear system in state-space form where the observation equation depends linearly on a set of parameters. We address the problem of how to dynamically calculate these parameters in order to minimize the…

Information Theory · Computer Science 2013-04-02 Feng Jiang , Jie Chen , A. Lee Swindlehurst

A Bayesian data assimilation scheme is formulated for advection-dominated or hyperbolic evolutionary problems, and observations. The method is referred to as the dynamic likelihood filter because it exploits the model physics to dynamically…

Dynamical Systems · Mathematics 2017-04-26 Juan M. Restrepo

In the process of reproducing the state dynamics of parameter dependent distributed systems, data from physical measurements can be incorporated into the mathematical model to reduce the parameter uncertainty and, consequently, improve the…

Numerical Analysis · Mathematics 2022-10-06 Francesco A. B. Silva , Cecilia Pagliantini , Martin Grepl , Karen Veroy

We consider the problem of performing Bayesian inference for logistic regression using appropriate extensions of the ensemble Kalman filter. Two interacting particle systems are proposed that sample from an approximate posterior and prove…

Machine Learning · Statistics 2024-07-02 Diksha Bhandari , Jakiw Pidstrigach , Sebastian Reich

Many modern algorithms for inverse problems and data assimilation rely on ensemble Kalman updates to blend prior predictions with observed data. Ensemble Kalman methods often perform well with a small ensemble size, which is essential in…

Machine Learning · Statistics 2024-01-05 Omar Al Ghattas , Daniel Sanz-Alonso

Gaussian process regression is a machine learning approach which has been shown its power for estimation of unknown functions. However, Gaussian processes suffer from high computational complexity, as in a basic form they scale cubically…

Machine Learning · Statistics 2018-09-10 Danil Kuzin , Le Yang , Olga Isupova , Lyudmila Mihaylova

This work introduces a novel nonlinear optimal filtering method, termed the Ensemble Schr{\"o}dinger Bridge nonlinear filter. The proposed filter combines the standard prediction step with a diffusion-generative-modeling-based analysis…

Machine Learning · Computer Science 2026-05-12 Hui Sun