English
Related papers

Related papers: Inference of stochastic parameterizations for mode…

200 papers

In this paper, we propose a new model reduction technique for linear stochastic systems that builds upon knowledge filtering and utilizes optimal Kalman filtering techniques. This new technique will reduce the dimension of the noise…

Systems and Control · Electrical Eng. & Systems 2023-09-18 Maico Hendrikus Wilhelmus Engelaar , Licio Romao , Yulong Gao , Mircea Lazar , Alessandro Abate , Sofie Haesaert

The ensemble Kalman filter (EnKF) is a data assimilation technique that uses an ensemble of models, updated with data, to track the time evolution of a usually non-linear system. It does so by using an empirical approximation to the…

Applications · Statistics 2021-03-12 Elizabeth Hou , Earl Lawrence , Alfred O. Hero

We look at a stochastic time-varying optimization problem and we formulate online algorithms to find and track its optimizers in expectation. The algorithms are derived from the intuition that standard prediction and correction steps can be…

Optimization and Control · Mathematics 2024-04-11 Andrea Simonetto , Paolo Massioni

We develop a stochastic parametrization, based on a `simple' deterministic model for the dynamics of steady longshore currents, that produces ensembles that are statistically consistent with field observations of these currents. Unlike…

Data Analysis, Statistics and Probability · Physics 2016-12-06 Juan M. Restrepo , Shankar C. Venkataramani

In this paper we address the problem of estimating the posterior distribution of the static parameters of a continuous time state space model with discrete time observations by an algorithm that combines the Kalman filter and a particle…

Computation · Statistics 2019-05-22 Jian He , Asma Khedher , Peter Spreij

In a recent methodological paper, we showed how to learn chaotic dynamics along with the state trajectory from sequentially acquired observations, using local ensemble Kalman filters. Here, we more systematically investigate the possibility…

Machine Learning · Statistics 2022-10-19 Quentin Malartic , Alban Farchi , Marc Bocquet

The Bayesian approach to inverse problems is widely used in practice to infer unknown parameters from noisy observations. In this framework, the ensemble Kalman inversion has been successfully applied for the quantification of uncertainties…

Numerical Analysis · Mathematics 2019-10-15 Neil K. Chada , Claudia Schillings , Simon Weissmann

Data assimilation is the task to combine evolution models and observational data in order to produce reliable predictions. In this paper, we focus on ensemble-based recursive data assimilation problems. Our main contribution is a hybrid…

Numerical Analysis · Mathematics 2016-02-26 Nawinda Chustagulprom , Sebastian Reich , Maria Reinhardt

Weather and climate forecasts are inherently uncertain due to chaotic dynamics, imperfect initial conditions, and incomplete representation of the underlying physical processes. Operational ensemble forecasts aim to represent these…

Machine Learning · Computer Science 2026-05-26 Birgit Kühbacher , Daan Crommelin , Niki Kilbertus

Data assimilation methods aim at estimating the state of a system by combining observations with a physical model. When sequential data assimilation is considered, the joint distribution of the latent state and the observations is described…

Methodology · Statistics 2018-04-23 Thi Tuyet Trang Chau , Pierre Ailliot , Valérie Monbet , Pierre Tandeo

Many real-world systems modeled using differential equations involve unknown or uncertain parameters. Standard approaches to address parameter estimation inverse problems in this setting typically focus on estimating constants; yet some…

Dynamical Systems · Mathematics 2024-03-25 Anna Fitzpatrick , Molly Folino , Andrea Arnold

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

In this work, we consider a sensor selection drawn at random by a sampling with replacement policy for a linear time-invariant dynamical system subject to process and measurement noise. We employ the Kalman filter to estimate the state of…

Systems and Control · Electrical Eng. & Systems 2023-03-15 Christopher I. Calle , Shaunak D. Bopardikar

Estimating the statistics of the state of a dynamical system, from partial and noisy observations, is both mathematically challenging and finds wide application. Furthermore, the applications are of great societal importance, including…

Numerical Analysis · Mathematics 2025-06-03 J. A. Carrillo , F. Hoffmann , A. M. Stuart , U. Vaes

Contemporary data assimilation often involves millions of prediction variables. The classical Kalman filter is no longer computationally feasible in such a high dimensional context. This problem can often be resolved by exploiting the…

Statistics Theory · Mathematics 2016-06-30 Andrew J. Majda , Xin T. Tong

System identification poses a significant bottleneck to characterizing and controlling complex systems. This challenge is greatest when both the system states and parameters are not directly accessible leading to a dual-estimation problem.…

Systems and Control · Electrical Eng. & Systems 2021-04-08 Matthew F. Singh , Chong Wang , Michael W. Cole , ShiNung Ching

We formulate a recursive estimation problem for multiple dynamical systems coupled through a low dimensional stochastic input, and we propose an efficient sub-optimal solution. The suggested approach is an approximation of the Kalman filter…

Optimization and Control · Mathematics 2019-11-26 Leonid Pogorelyuk , Clarence W. Rowley , N. Jeremy Kasdin

We propose a method to account for model error due to unresolved scales in the context of the ensemble transform Kalman filter (ETKF). The approach extends to this class of algorithms the deterministic model error formulation recently…

Data Analysis, Statistics and Probability · Physics 2023-07-19 Lewis Mitchell , Alberto Carrassi

Artificial intelligence (AI)-based weather prediction research is growing rapidly and has shown to be competitive with the advanced dynamic numerical weather prediction models. However, research combining AI-based weather prediction models…

Machine Learning · Computer Science 2025-10-16 Shunji Kotsuki , Kenta Shiraishi , Atsushi Okazaki

The analysis of high-dimensional dynamical systems generally requires the integration of simulation data with experimental measurements. Experimental data often has substantial amounts of measurement noise that compromises the ability to…

Numerical Analysis · Mathematics 2019-10-02 Samuel Rudy , Steven Brunton , J. Nathan Kutz