English
Related papers

Related papers: Inference of stochastic parameterizations for mode…

200 papers

Filtering is a widely used methodology for the incorporation of observed data into time-evolving systems. It provides an online approach to state estimation inverse problems when data is acquired sequentially. The Kalman filter plays a…

Probability · Mathematics 2015-05-27 Wonjung Lee , Damon McDougall , Andrew Stuart

The sample covariance matrix of a random vector is a good estimate of the true covariance matrix if the sample size is much larger than the length of the vector. In high-dimensional problems, this condition is never met. As a result, in…

Data Analysis, Statistics and Probability · Physics 2024-11-12 Michael Tsyrulnikov , Arseniy Sotskiy

With the increasing penetration of high-frequency sensors across a number of biological and physical systems, the abundance of the resulting observations offers opportunities for higher statistical accuracy of down-stream estimates, but…

Optimization and Control · Mathematics 2020-11-06 Shushu Zhang , Vivak Patel

This paper tackles the challenge of parameter calibration in stochastic models, particularly in scenarios where the likelihood function is unavailable in an analytical form. We introduce a gradient-based simulated parameter estimation…

Machine Learning · Statistics 2025-03-25 Zehao Li , Yijie Peng

Ensemble randomized maximum likelihood (EnRML) is an iterative (stochastic) ensemble smoother, used for large and nonlinear inverse problems, such as history matching and data assimilation. Its current formulation is overly complicated and…

Data Analysis, Statistics and Probability · Physics 2019-09-12 Patrick N. Raanes , Geir Evensen , Andreas S. Stordal

This paper studies the sparse identification problem of unknown sparse parameter vectors in stochastic dynamic systems. Firstly, a novel sparse identification algorithm is proposed, which can generate sparse estimates based on least squares…

Optimization and Control · Mathematics 2024-04-02 Ziming Wang , Xinghua Zhu

Data assimilation plays a key role in large-scale atmospheric weather forecasting, where the state of the physical system is estimated from model outputs and observations, and is then used as initial condition to produce accurate future…

Methodology · Statistics 2018-02-13 Azam Moosavi , Ahmed Attia , Adrian Sandu

The understanding of nonlinear, high dimensional flows, e.g, atmospheric and ocean flows, is critical to address the impacts of global climate change. Data Assimilation techniques combine physical models and observational data, often in a…

This paper proposes an Extended-Kalman-Filter-like observer for parameter estimation during synchronization of chaotic systems. The exponential stability of the observer is guaranteed by a persistent excitation condition. This approach is…

Chaotic Dynamics · Physics 2017-06-21 L. Torres

Estimating the state of a dynamical system from partial and noisy observations is a ubiquitous problem in a large number of applications, such as probabilistic weather forecasting and prediction of epidemics. Particle filters are a widely…

Statistics Theory · Mathematics 2025-03-21 E. Calvello , J. A. Carrillo , F. Hoffmann , P. Monmarché , A. M. Stuart , U. Vaes

This paper proposes two practical implementations of Four-Dimensional Variational (4D-Var) Ensemble Kalman Filter (4D-EnKF) methods for non-linear data assimilation. Our formulations' main idea is to avoid the intrinsic need for adjoint…

Applications · Statistics 2023-05-05 Elias Nin-Ruiz , Jairo Diaz-Rodriguez

We consider the solution of inverse problems in dynamic contrast-enhanced imaging by means of Ensemble Kalman Filters. Our quantity of interest is blood perfusion, i.e. blood flow rates in tissue. While existing approaches to compute blood…

Numerical Analysis · Mathematics 2018-10-23 Peter Zaspel

Traditional data assimilation uses information obtained from the propagation of one physics-driven model and combines it with information derived from real-world observations in order to obtain a better estimate of the truth of some natural…

Computational Engineering, Finance, and Science · Computer Science 2022-10-24 Andrey A Popov , Adrian Sandu

Prediction error and maximum likelihood methods are powerful tools for identifying linear dynamical systems and, in particular, enable the joint estimation of model parameters and the Kalman filter used for state estimation. A key…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Léo Simpson , Moritz Diehl

This paper studies the distributed state estimation problem for a class of discrete-time stochastic systems with nonlinear uncertain dynamics over time-varying topologies of sensor networks. An extended state vector consisting of the…

Systems and Control · Computer Science 2018-09-12 Xingkang He , Xiaocheng Zhang , Wenchao Xue , Haitao Fang

We introduce a statistical physics inspired supervised machine learning algorithm for classification and regression problems. The method is based on the invariances or stability of predicted results when known data is represented as…

Machine Learning · Statistics 2018-11-19 Patrick Chao , Tahereh Mazaheri , Bo Sun , Nicholas B. Weingartner , Zohar Nussinov

The estimation of model parameters with uncertainties from observed data is a ubiquitous inverse problem in science and engineering. In this paper, we suggest an inexpensive and easy to implement parameter estimation technique that uses a…

Machine Learning · Computer Science 2020-11-06 Ushnish Sengupta , Maximilian L. Croci , Matthew P. Juniper

Several localized versions of the ensemble Kalman filter have been proposed. Although tests applying such schemes have proven them to be extremely promising, a full basic understanding of the rationale and limitations of localization is…

Chaotic Dynamics · Physics 2015-05-30 Young-noh Yoon , Edward Ott , Istvan Szunyogh

We consider the problem of an ensemble Kalman filter when only partial observations are available. In particular we consider the situation where the observational space consists of variables which are directly observable with known…

Data Analysis, Statistics and Probability · Physics 2011-08-31 Georg A. Gottwald , Lewis Mitchell , Sebastian Reich

The prediction of stochastic dynamical systems and the capture of dynamical behaviors are profound problems. In this article, we propose a data-driven framework combining Reservoir Computing and Normalizing Flow to study this issue, which…

Dynamical Systems · Mathematics 2023-08-01 Cheng Fang , Yubin Lu , Ting Gao , Jinqiao Duan