English
Related papers

Related papers: Continuous Hyper-parameter OPtimization (CHOP) in …

200 papers

In Wang & Pan (J. Fluid Mech., vol. 918, A19, 2021), the authors developed the first ensemble-based data assimilation (DA) capability for the reconstruction and forecast of ocean surface waves, namely the EnKF-HOS method coupling an…

Fluid Dynamics · Physics 2022-10-12 Guangyao Wang , Jinfeng Zhang , Yuxiang Ma , Qinghe Zhang , Zhilin Li , Yulin Pan

State estimation is a fundamental problem in control and signal processing, for which the Kalman Filter provides an optimal solution under linear dynamics, Gaussian noise, and known noise covariances. However, these assumptions often fail…

Machine Learning · Computer Science 2026-05-27 Vasileios Saketos , Ming Xiao

The present research work proposes advancement for Data Assimilation strategies using Convolutional Neural Networks (CNN). More precisely, multi-fidelity and multi-level algorithms for the Ensemble Kalman Filter are enhanced by CNN tools,…

Fluid Dynamics · Physics 2025-07-21 Tom Moussie , Paolo Errante , Marcello Meldi

Although data assimilation originates from control theory, the relationship between modern data assimilation methods in geoscience and model predictive control has not been extensively explored. In the present paper, I discuss that the…

Geophysics · Physics 2024-10-21 Yohei Sawada

The use of model order reduction techniques in combination with ensemble-based methods for estimating the state of systems described by nonlinear partial differential equations has been of great interest in recent years in the data…

Numerical Analysis · Mathematics 2024-12-18 Francesco A. B. Silva , Cecilia Pagliantini , Karen Veroy

We introduce a data assimilation strategy aimed at accurately capturing key non-Gaussian structures in probability distributions using a small ensemble size. A major challenge in statistical forecasting of nonlinearly coupled multiscale…

Numerical Analysis · Mathematics 2025-04-01 Di Qi , Jian-Guo Liu

Accurate estimation of error covariances (both background and observation) is crucial for efficient observation compression approaches in data assimilation of large-scale dynamical problems. We propose a new combination of a covariance…

Numerical Analysis · Mathematics 2021-06-11 Sibo Cheng , Didier Lucor , Jean-Philippe Argaud

Data assimilation is the process of estimating the state of a dynamical system over time by combining model predictions with measurements. This task becomes challenging when the system is nonlinear and high-dimensional. To address this,…

Machine Learning · Statistics 2026-05-22 Eunbi Yoon , Won Chang , Donghan Kim , Dae Wook Kim

Accurate and timely prediction of crop growth is of great significance to ensure crop yields and researchers have developed several crop models for the prediction of crop growth. However, there are large difference between the simulation…

Artificial Intelligence · Computer Science 2024-03-07 Siqi Zhou , Ling Wang , Jie Liu , Jinshan Tang

In this article, we propose a new filtering algorithm based in the Koopman operator, showing that a nonlinear filtering problem can be seen as an equivalent problem where the dynamics is infinite dimensional, but linear. Using Extended…

Dynamical Systems · Mathematics 2025-11-07 Diego Olguín , Axel Osses , Héctor Ramírez

We present a new continuous data assimilation algorithm based on ideas that have been developed for designing finite-dimensional feedback controls for dissipative dynamical systems, in particular, in the context of the incompressible…

Analysis of PDEs · Mathematics 2015-06-15 Abderrahim Azouani , Eric Olson , Edriss S. Titi

Simultaneous Localization and Mapping (SLAM) algorithms perform visual-inertial estimation via filtering or batch optimization methods. Empirical evidence suggests that filtering algorithms are computationally faster, while optimization…

Systems and Control · Electrical Eng. & Systems 2022-08-05 Amay Saxena , Chih-Yuan Chiu , Joseph Menke , Ritika Shrivastava , Shankar Sastry

Data assimilation algorithms estimate the state of a dynamical system from partial observations, where the successful performance of these algorithms hinges on costly parameter tuning and on employing an accurate model for the dynamics.…

Machine Learning · Statistics 2026-03-24 Melissa Adrian , Daniel Sanz-Alonso , Rebecca Willett

Hyperparameter optimization constitutes a large part of typical modern machine learning workflows. This arises from the fact that machine learning methods and corresponding preprocessing steps often only yield optimal performance when…

Ensembling is now recognized as an effective approach for increasing the predictive performance and calibration of deep networks. We introduce a new approach, Parameter Ensembling by Perturbation (PEP), that constructs an ensemble of…

Machine Learning · Computer Science 2020-10-27 Alireza Mehrtash , Purang Abolmaesumi , Polina Golland , Tina Kapur , Demian Wassermann , William M. Wells

The Kalman filter is the most powerful tool for estimation of the states of a linear Gaussian system. In addition, using this method, an expectation maximization algorithm can be used to estimate the parameters of the model. However, this…

Computation · Statistics 2020-06-01 Tsuyoshi Ishizone , Kazuyuki Nakamura

The majority of data assimilation (DA) methods in the geosciences are based on Gaussian assumptions. While these assumptions facilitate efficient algorithms, they cause analysis biases and subsequent forecast degradations. Non-parametric,…

Methodology · Statistics 2025-05-12 Hristo G. Chipilski

Kalman filtering can provide an optimal estimation of the system state from noisy observation data. This algorithm's performance depends on the accuracy of system modeling and noise statistical characteristics, which are usually challenging…

Systems and Control · Electrical Eng. & Systems 2025-04-18 Xun Xiao , Junbo Tie , Jinyue Zhao , Ziqi Wang , Yuan Li , Qiang Dou , Lei Wang

Reconstruction of turbulent flow based on data assimilation methods is of significant importance for improving the estimation of flow characteristics by incorporating limited observations. Existing works mainly focus on using only one…

Fluid Dynamics · Physics 2021-03-30 Xin-Lei Zhang , Heng Xiao , Guo-Wei He , Shi-Zhao Wang

We present recent results on the existence of a continuous time limit for Ensemble Kalman Filter algorithms. In the setting of continuous signal and observation processes, we apply the original Ensemble Kalman Filter algorithm proposed by…

Probability · Mathematics 2020-12-08 Theresa Lange , Wilhelm Stannat