English
Related papers

Related papers: Enabling High-Accuracy Data Assimilation with Limi…

200 papers

Artificial intelligence (AI)-based weather prediction research is growing rapidly and has shown to be competitive with the advanced dynamic numerical weather prediction models. However, research combining AI-based weather prediction models…

Machine Learning · Computer Science 2025-10-16 Shunji Kotsuki , Kenta Shiraishi , Atsushi Okazaki

Many data-science problems can be formulated as an inverse problem, where the parameters are estimated by minimizing a proper loss function. When complicated black-box models are involved, derivative-free optimization tools are often…

Numerical Analysis · Mathematics 2021-10-19 Neil K. Chada , Xin T. Tong

We propose a robust ensemble filtering scheme based on the $H_{\infty}$ filtering theory. The optimal $H_{\infty}$ filter is derived by minimizing the supremum (or maximum) of a predefined cost function, a criterion different from the…

Data Analysis, Statistics and Probability · Physics 2015-05-30 Xiaodong Luo , Ibrahim Hoteit

The ensemble Kalman filter (EnKF) is a Monte Carlo approximation of the Kalman filter for high dimensional linear Gaussian state space models. EnKF methods have also been developed for parameter inference of static Bayesian models with a…

Ensemble-based Data Assimilation faces significant challenges in high-dimensional systems due to spurious correlations and ensemble collapse. These issues arise from estimating dense dependencies with limited ensemble sizes. This paper…

Methodology · Statistics 2025-01-16 Berent Ånund Strømnes Lunde

This paper presents a data-assimilation (DA)-based approach to forecast the phase-resolved wave evolution process and ship motion, which is developed by coupling the high-order spectral method (HOS), ensemble Kalman filter (EnKF), and a…

Systems and Control · Electrical Eng. & Systems 2025-04-22 Guangyao Wang , Yulin Pan

In this study, two classes of methods including statistical and variational data assimilation algorithms will be described. In statistical methods, the model state is updated sequentially based on the previous estimate. Variational methods,…

Systems and Control · Electrical Eng. & Systems 2021-10-25 Loc Luong

Complex systems are often described with competing models. Such divergence of interpretation on the system may stem from model fidelity, mathematical simplicity, and more generally, our limited knowledge of the underlying processes.…

Numerical Analysis · Mathematics 2017-07-21 Lun Yang , Akil Narayan , Peng Wang

The ensemble Kalman filter (EnKF) is a reliable data assimilation tool for high-dimensional meteorological problems. On the other hand, the EnKF can be interpreted as a particle filter, and particle filters collapse in high-dimensional…

Numerical Analysis · Mathematics 2016-06-01 Matthias Morzfeld , Daniel Hodyss , Chris Snyder

Continuous data assimilation (CDA) is a method that continuously integrates observational data into a dynamical system to improve model accuracy in real-time. The AOT algorithm is one of the most widely used methods in CDA due to its…

Optimization and Control · Mathematics 2024-07-25 Ning Ning , Collin Victor

This paper investigates an approximation scheme of the optimal nonlinear Bayesian filter based on the Gaussian mixture representation of the state probability distribution function. The resulting filter is similar to the particle filter,…

Data Analysis, Statistics and Probability · Physics 2015-05-30 Ibrahim Hoteit , Xiaodong Luo , Dinh-Tuan Pham

Deep learning is widely used to predict complex dynamical systems in many scientific and engineering areas. However, the black-box nature of these deep learning models presents significant challenges for carrying out simultaneous data…

Machine Learning · Computer Science 2025-04-04 Chuanqi Chen , Nan Chen , Yinling Zhang , Jin-Long Wu

The accuracy of Earth system models is compromised by unknown and/or unresolved dynamics, making the quantification of systematic model errors essential. While a model parameter estimation, which allows parameters to change…

Methodology · Statistics 2023-10-04 Yohei Sawada , Le Duc

Marine biogeochemistry models are critical for forecasting, as well as estimating ecosystem responses to climate change and human activities. Data assimilation (DA) improves these models by aligning them with real-world observations, but…

Atmospheric and Oceanic Physics · Physics 2025-04-08 Ieuan Higgs , Ross Bannister , Jozef Skákala , Alberto Carrassi , Stefano Ciavatta

It is a grand challenge to find a feasible weather modification method to mitigate the impact of extreme weather events such as tropical cyclones. Previous works have proposed potentially effective actuators and assessed their capabilities…

Applications · Statistics 2024-05-15 Yohei Sawada

Geoscientific applications of ensemble Kalman filters face several computational challenges arising from the high dimensionality of the forecast covariance matrix, particularly when this matrix incorporates localization. For square-root…

Computational Physics · Physics 2025-10-15 Robin Armstrong , Ian Grooms

This paper introduces a computational framework to reconstruct and forecast a partially observed state that evolves according to an unknown or expensive-to-simulate dynamical system. Our reduced-order autodifferentiable ensemble Kalman…

Machine Learning · Statistics 2023-01-31 Yuming Chen , Daniel Sanz-Alonso , Rebecca Willett

In many areas of science and engineering, it is a common task to infer physical fields from sparse observations. This paper presents the DAFI code intended as a flexible framework for two broad classes of such inverse problems: data…

Computational Physics · Physics 2020-12-07 Carlos A. Michelén Ströfer , Xin-Lei Zhang , Heng Xiao

Real-time nonlinear Bayesian filtering algorithms are overwhelmed by data volume, velocity and increasing complexity of computational models. In this paper, we propose a novel ensemble based nonlinear Bayesian filtering approach which only…

Computation · Statistics 2019-06-05 Xiao Lin , Gabriel Terejanu

Working with a two-stage ice sheet model, we explore how statistical data assimilation methods can be used to improve predictions of glacier melt and relatedly, sea level rise. We find that the EnKF improves model runs initialized using…

Dynamical Systems · Mathematics 2023-05-23 Emily Corcoran , Logan Knudsen , Talea Mayo , Hannah Park-Kaufmann , Alexander Robel