English
Related papers

Related papers: Inferring unknown unknowns: Regularized bias-aware…

200 papers

The sample covariance matrix of a random vector is a good estimate of the true covariance matrix if the sample size is much larger than the length of the vector. In high-dimensional problems, this condition is never met. As a result, in…

Data Analysis, Statistics and Probability · Physics 2024-11-12 Michael Tsyrulnikov , Arseniy Sotskiy

Data assimilation has been applied to coastal hydrodynamic models to better estimate system states or parameters by incorporating observed data into the model. Kalman Filter (KF) is one of the most studied data assimilation methods whose…

Atmospheric and Oceanic Physics · Physics 2016-07-05 Milad Hooshyar , Stephen C. Medeiros , Dingbao Wang , Scott C. Hagen

This paper introduces a novel state estimation framework for robots using differentiable ensemble Kalman filters (DEnKF). DEnKF is a reformulation of the traditional ensemble Kalman filter that employs stochastic neural networks to model…

Robotics · Computer Science 2023-08-22 Xiao Liu , Geoffrey Clark , Joseph Campbell , Yifan Zhou , Heni Ben Amor

This paper introduces a computational framework to reconstruct and forecast a partially observed state that evolves according to an unknown or expensive-to-simulate dynamical system. Our reduced-order autodifferentiable ensemble Kalman…

Machine Learning · Statistics 2023-01-31 Yuming Chen , Daniel Sanz-Alonso , Rebecca Willett

Ensemble data assimilation methods such as the Ensemble Kalman Filter (EnKF) are a key component of probabilistic weather forecasting. They represent the uncertainty in the initial conditions by an ensemble which incorporates information…

Applications · Statistics 2018-10-17 Sylvain Robert , Daniel Leuenberger , Hans R. Künsch

Over the years data assimilation methods have been developed to obtain estimations of uncertain model parameters by taking into account a few observations of a model state. The most reliable methods of MCMC are computationally expensive.…

Applications · Statistics 2018-11-14 Sangeetika Ruchi , Svetlana Dubinkina

Although data assimilation originates from control theory, the relationship between modern data assimilation methods in geoscience and model predictive control has not been extensively explored. In the present paper, I discuss that the…

Geophysics · Physics 2024-10-21 Yohei Sawada

Contemporary data assimilation often involves more than a million prediction variables. Ensemble Kalman filters (EnKF) have been developed by geoscientists. They are successful indispensable tools in science and engineering, because they…

Probability · Mathematics 2017-05-26 Andrew J. Majda , Xin T. Tong

This study considers the data assimilation problem in coupled systems, which consists of two components (sub-systems) interacting with each other through certain coupling terms. A straightforward way to tackle the assimilation problem in…

Atmospheric and Oceanic Physics · Physics 2015-06-22 Xiaodong Luo , Ibrahim Hoteit

Data assimilation (DA) integrates numerical model forecasts with observations to achieve the optimal state estimation. Ensemble-based methods, such as the ensemble Kalman filter (EnKF), are widely used for state estimation for…

Atmospheric and Oceanic Physics · Physics 2026-05-25 Zhou Yao , Zhilin Li , Li Zhao , Zeng Liu , Zhaokuan Lu , Seungnam Kim , Guangyao Wang

Machine learning techniques have seen a tremendous rise in popularity in weather and climate sciences. Data assimilation (DA), which combines observations and numerical models, has great potential to incorporate machine learning and…

Machine Learning · Computer Science 2024-03-20 Feiyu Lu

Climate change poses significant challenges for accurate climate modeling due to the complexity and variability of non-Gaussian climate systems. To address the complexities of non-Gaussian systems in climate modeling, this thesis proposes a…

Applications · Statistics 2024-06-28 Yunjin Tong

Parameter estimation has a high importance in the geosciences. The ensemble Kalman filter (EnKF) allows parameter estimation for large, time-dependent systems. For large systems, the EnKF is applied using small ensembles, which may lead to…

Applications · Statistics 2021-08-05 Johannes Keller , Harrie-Jan Hendricks Franssen , Wolfgang Nowak

This paper presents an approach for simultaneous estimation of the state and unknown parameters in a sequential data assimilation framework. The state augmentation technique, in which the state vector is augmented by the model parameters,…

Chaotic Dynamics · Physics 2023-07-19 Naratip Santitissadeekorn , Chris Jones

The phase-field approach to brittle fracture provides a continuum framework for modeling crack initiation and propagation without explicit representation of discrete crack surfaces, provided the spatial discretization is fine enough to…

Computational Engineering, Finance, and Science · Computer Science 2026-03-11 Lucas Hermann , Ralf Jänicke , Knut Andreas Meyer , Ulrich Römer

Ensemble transform Kalman filtering (ETKF) data assimilation is often used to combine available observations with numerical simulations to obtain statistically accurate and reliable state representations in dynamical systems. However, it is…

Numerical Analysis · Mathematics 2024-03-07 Tongtong Li , Anne Gelb , Yoonsang Lee

Data assimilation provides algorithms for widespread applications in various fields. It is of practical use to deal with a large amount of information in the complex system that is hard to estimate. Weather forecasting is one of the…

Optimization and Control · Mathematics 2023-03-23 Yihua Yang

The reconstruction of the dynamics of an observed physical system as a surrogate model has been brought to the fore by recent advances in machine learning. To deal with partial and noisy observations in that endeavor, machine learning…

Machine Learning · Statistics 2020-10-06 Marc Bocquet , Alban Farchi , Quentin Malartic

Many applications, such as intermittent data assimilation, lead to a recursive application of Bayesian inference within a Monte Carlo context. Popular data assimilation algorithms include sequential Monte Carlo methods and ensemble Kalman…

Numerical Analysis · Mathematics 2013-01-15 Sebastian Reich

This work studies the state estimation problem of a stochastic nonlinear system with unknown sensor measurement losses. If the estimator knows the sensor measurement losses of a linear Gaussian system, the minimum variance estimate is…

Systems and Control · Computer Science 2020-05-11 Jiaqi Zhang , Keyou You , Lihua Xie