English
Related papers

Related papers: Continuous Hyper-parameter OPtimization (CHOP) in …

200 papers

Data assimilation (DA) is a key component of many forecasting models in science and engineering. DA allows one to estimate better initial conditions using an imperfect dynamical model of the system and noisy/sparse observations available…

Machine Learning · Computer Science 2023-02-01 Ashesh Chattopadhyay , Ebrahim Nabizadeh , Eviatar Bach , Pedram Hassanzadeh

Continuous data assimilation (CDA) is a method that continuously integrates observational data into a dynamical system to improve model accuracy in real-time. The AOT algorithm is one of the most widely used methods in CDA due to its…

Optimization and Control · Mathematics 2024-07-25 Ning Ning , Collin Victor

Ensemble data assimilation methods such as the Ensemble Kalman Filter (EnKF) are a key component of probabilistic weather forecasting. They represent the uncertainty in the initial conditions by an ensemble which incorporates information…

Applications · Statistics 2018-10-17 Sylvain Robert , Daniel Leuenberger , Hans R. Künsch

We develop a fast algorithm for Kalman Filter applied to the random walk forecast model. The key idea is an efficient representation of the estimate covariance matrix at each time-step as a weighted sum of two contributions - the process…

Numerical Analysis · Mathematics 2015-05-13 Arvind K. Saibaba , Eric Miller , Peter K. Kitanidis

Data assimilation combines information from physical observations and numerical simulation results to obtain better estimates of the state and parameters of a physical system. A wide class of physical systems of interest have solutions that…

Optimization and Control · Mathematics 2025-05-02 Amit N. Subrahmanya , Adrian Sandu

In this paper we address the problem of estimating the posterior distribution of the static parameters of a continuous time state space model with discrete time observations by an algorithm that combines the Kalman filter and a particle…

Computation · Statistics 2019-05-22 Jian He , Asma Khedher , Peter Spreij

Traditional data assimilation uses information obtained from the propagation of one physics-driven model and combines it with information derived from real-world observations in order to obtain a better estimate of the truth of some natural…

Computational Engineering, Finance, and Science · Computer Science 2022-10-24 Andrey A Popov , Adrian Sandu

Filtering is concerned with online estimation of the state of a dynamical system from partial and noisy observations. In applications where the state of the system is high dimensional, ensemble Kalman filters are often the method of choice.…

Systems and Control · Electrical Eng. & Systems 2024-07-30 Omar Al Ghattas , Jiajun Bao , Daniel Sanz-Alonso

The accuracy of Earth system models is compromised by unknown and/or unresolved dynamics, making the quantification of systematic model errors essential. While a model parameter estimation, which allows parameters to change…

Methodology · Statistics 2023-10-04 Yohei Sawada , Le Duc

Koopman operator theory is a key tool in data assimilation of complex dynamical systems, with the potential to be applied to multimodal data. We formulate the problem of learning Koopman eigenfunctions from observations at arbitrary,…

Systems and Control · Electrical Eng. & Systems 2026-04-14 Younghwan Cho , Richard Sowers

The Ensemble Kalman filter assumes the observations to be Gaussian random variables with a pre-specified mean and variance. In practice, observations may also have detection limits, for instance when a gauge has a minimum or maximum value.…

Optimization and Control · Mathematics 2018-11-14 Abhishek Shah , Mohamad El Gharamti , Laurent Bertino

Data assimilation leads naturally to a Bayesian formulation in which the posterior probability distribution of the system state, given the observations, plays a central conceptual role. The aim of this paper is to use this Bayesian…

Data Analysis, Statistics and Probability · Physics 2013-01-01 K. J. H. Law , A. M. Stuart

The Ensemble Kalman Filter (EnKF), as a fundamental data assimilation approach, has been widely used in many fields of the sciences and engineering. When the state variable is of high dimensional accompanied with high resolution…

Methodology · Statistics 2025-09-18 Shouxia Wang , Hao-Xuan Sun , Song Xi Chen

Through ensemble-based data assimilation (DA), we address one of the most notorious difficulties in phase-resolved ocean wave forecast, regarding the deviation of numerical solution from the true surface elevation due to the chaotic nature…

Atmospheric and Oceanic Physics · Physics 2021-07-01 Guangyao Wang , Yulin Pan

This paper presents an approach for employing artificial neural networks (NN) to emulate an ensemble Kalman filter (EnKF) as a method of data assimilation. The assimilation methods are tested in the Simplified Parameterizations…

Artificial Intelligence · Computer Science 2014-07-17 Rosangela S. Cintra , Haroldo F. de Campos Velho

Machine learning algorithms have made remarkable achievements in the field of artificial intelligence. However, most machine learning algorithms are sensitive to the hyper-parameters. Manually optimizing the hyper-parameters is a common…

Machine Learning · Computer Science 2020-03-05 Bozhou Chen , Kaixin Zhang , Longshen Ou , Chenmin Ba , Hongzhi Wang , Chunnan Wang

Data assimilation schemes are confronted with the presence of model errors arising from the imperfect description of atmospheric dynamics. These errors are usually modeled on the basis of simple assumptions such as bias, white noise, first…

Chaotic Dynamics · Physics 2009-11-13 A. Carrassi , S. Vannitsem , C. Nicolis

For oceanographic applications, probabilistic forecasts typically have to deal with i) high-dimensional complex models, and ii) very sparse spatial observations. In search-and-rescue operations at sea, for instance, the short-term…

Applications · Statistics 2023-02-15 Florian Beiser , Håvard Heitlo Holm , Jo Eidsvik

A data-driven method for improving the correlation estimation in serial ensemble Kalman filters is introduced. The method finds a linear map that transforms, at each assimilation cycle, the poorly estimated sample correlation into an…

Statistics Theory · Mathematics 2017-04-05 Michèle De La Chevrotière , John Harlim

The ensemble Kalman filter (EnKF) is a method for combining a dynamical model with data in a sequential fashion. Despite its widespread use, there has been little analysis of its theoretical properties. Many of the algorithmic innovations…

Probability · Mathematics 2015-06-17 D. T. B. Kelly , K. J. H. Law , A. M. Stuart