English
Related papers

Related papers: Sequential data assimilation with multiple nonline…

200 papers

Data assimilation techniques are often confronted with challenges handling complex high dimensional physical systems, because high precision simulation in complex high dimensional physical systems is computationally expensive and the exact…

Mathematical Software · Computer Science 2024-09-04 Sibo Cheng , Jinyang Min , Che Liu , Rossella Arcucci

A hybrid particle ensemble Kalman filter is developed for problems with medium non-Gaussianity, i.e. problems where the prior is very non-Gaussian but the posterior is approximately Gaussian. Such situations arise, e.g., when nonlinear…

Methodology · Statistics 2021-03-15 Gregor Robinson , Ian Grooms

In this paper, the ensemble consider Kalman filter is proposed to mitigate the negative effects of uncertain parameters in nonlinear dynamic and measurement models. The ensemble Kalman filter can avoid using the Jacobian matrices and reduce…

Systems and Control · Electrical Eng. & Systems 2019-06-18 Tai-shan Lou , Nan-hua Chen , Hua Xiong , Ya-xi Li , Lei Wang

The weather and climate domains are undergoing a significant transformation thanks to advances in AI-based foundation models such as FourCastNet, GraphCast, ClimaX and Pangu-Weather. While these models show considerable potential, they are…

Machine Learning · Computer Science 2024-07-18 Junqi Yin , Siming Liang , Siyan Liu , Feng Bao , Hristo G. Chipilski , Dan Lu , Guannan Zhang

Data-driven models of dynamical systems require extensive amounts of training data. For many practical applications, gathering sufficient data is not feasible due to cost or safety concerns. This work uses the Subset Extended Kalman Filter…

Machine Learning · Computer Science 2026-03-04 Joshua E. Hammond , Tyler A. Soderstrom , Brian A. Korgel , Michael Baldea

Filtering is a widely used methodology for the incorporation of observed data into time-evolving systems. It provides an online approach to state estimation inverse problems when data is acquired sequentially. The Kalman filter plays a…

Probability · Mathematics 2015-05-27 Wonjung Lee , Damon McDougall , Andrew Stuart

We consider the Ensemble Kalman Inversion which has been recently introduced as an efficient, gradient-free optimisation method to estimate unknown parameters in an inverse setting. In the case of large data sets, the Ensemble Kalman…

Numerical Analysis · Mathematics 2023-12-05 Matei Hanu , Jonas Latz , Claudia Schillings

Filtering is concerned with online estimation of the state of a dynamical system from partial and noisy observations. In applications where the state is high dimensional, ensemble Kalman filters are often the method of choice. This paper…

Dynamical Systems · Mathematics 2024-12-20 Daniel Sanz-Alonso , Nathan Waniorek

Data assimilation is a central problem in many geophysical applications, such as weather forecasting. It aims to estimate the state of a potentially large system, such as the atmosphere, from sparse observations, supplemented by prior…

Machine Learning · Computer Science 2024-06-24 Matthieu Blanke , Ronan Fablet , Marc Lelarge

Climate change poses significant challenges for accurate climate modeling due to the complexity and variability of non-Gaussian climate systems. To address the complexities of non-Gaussian systems in climate modeling, this thesis proposes a…

Applications · Statistics 2024-06-28 Yunjin Tong

To represent the complex individual interactions in the dynamics of disease spread informed by data, the coupling of an epidemiological agent-based model with the ensemble Kalman filter is proposed. The statistical inference of the…

Applications · Statistics 2022-05-04 Tadeo Javier Cocucci , Manuel Pulido , Juan Aparicio , Juan Ruiz , Ignacio Simoy , Santiago Rosa

Both constrained and unconstrained optimization problems regularly appear in recursive tracking problems engineers currently address -- however, constraints are rarely exploited for these applications. We define the Kalman Filter and…

Optimization and Control · Mathematics 2007-09-19 Nachi Gupta , Raphael Hauser

In this paper, we present the optimization formulation of the Kalman filtering and smoothing problems, and use this perspective to develop a variety of extensions and applications. We first formulate classic Kalman smoothing as a least…

Optimization and Control · Mathematics 2013-03-12 Aleksandr Y. Aravkin , James V. Burke , Gianluigi Pillonetto

Accurate and timely prediction of crop growth is of great significance to ensure crop yields and researchers have developed several crop models for the prediction of crop growth. However, there are large difference between the simulation…

Artificial Intelligence · Computer Science 2024-03-07 Siqi Zhou , Ling Wang , Jie Liu , Jinshan Tang

We consider filtering in high-dimensional non-Gaussian state-space models with intractable transition kernels, nonlinear and possibly chaotic dynamics, and sparse observations in space and time. We propose a novel filtering methodology that…

Methodology · Statistics 2022-04-07 Alessio Spantini , Ricardo Baptista , Youssef Marzouk

Data assimilation (DA) estimates a dynamical system's state from noisy observations. Recent generative models like the ensemble score filter (EnSF) improve DA in high-dimensional nonlinear settings but are computationally expensive. We…

Machine Learning · Statistics 2025-09-30 Taos Transue , Bohan Chen , So Takao , Bao Wang

Filtering - the task of estimating the conditional distribution for states of a dynamical system given partial and noisy observations - is important in many areas of science and engineering, including weather and climate prediction.…

Machine Learning · Computer Science 2025-03-25 Eviatar Bach , Ricardo Baptista , Enoch Luk , Andrew Stuart

The success of the ensemble Kalman filter has triggered a strong interest in expanding its scope beyond classical state estimation problems. In this paper, we focus on continuous-time data assimilation where the model and measurement errors…

Numerical Analysis · Mathematics 2019-06-26 Nikolas Nüsken , Sebastian Reich , Paul J. Rozdeba

In this paper, we propose a robust Kalman filtering framework for systems with probabilistic uncertainty in system parameters. We consider two cases, namely discrete time systems, and continuous time systems with discrete measurements. The…

Systems and Control · Electrical Eng. & Systems 2020-07-09 Sunsoo Kim , Vedang M. Deshpande , Raktim Bhattacharya

Contemporary data assimilation often involves millions of prediction variables. The classical Kalman filter is no longer computationally feasible in such a high dimensional context. This problem can often be resolved by exploiting the…

Statistics Theory · Mathematics 2016-06-30 Andrew J. Majda , Xin T. Tong