English
Related papers

Related papers: An Improved Data Assimilation Scheme for High Dime…

200 papers

An ensemble Kalman filter (EnKF)-based mixed model (EnKF-MM) is proposed for the subgrid-scale (SGS) closure in the large-eddy simulation (LES) of turbulence. The model coefficients are determined through the EnKF-based data assimilation…

Fluid Dynamics · Physics 2023-08-16 Yunpeng Wang , Zelong Yuan , Jianchun Wang

Current tools for multivariate density estimation struggle when the density is concentrated near a nonlinear subspace or manifold. Most approaches require choice of a kernel, with the multivariate Gaussian by far the most commonly used.…

Methodology · Statistics 2021-10-07 Minerva Mukhopadhyay , Didong Li , David B Dunson

Lagrangian data assimilation exploits the trajectories of moving tracers as observations to recover the underlying flow field. One major challenge in Lagrangian data assimilation is the intrinsic nonlinearity that impedes using exact…

Dynamical Systems · Mathematics 2023-06-14 Nan Chen , Shubin Fu

The ensemble Gaussian mixture filter (EnGMF) is a non-linear filter suited to data assimilation of highly non-Gaussian and non-linear models that has practical utility in the case of a small number of samples, and theoretical convergence to…

Optimization and Control · Mathematics 2024-06-03 Andrey A. Popov , Enrico M. Zucchelli , Renato Zanetti

Nonlinear state estimation under noisy observations is rapidly intractable as system dimension increases. We introduce an improved Yau-Yau filtering framework that breaks the curse of dimensionality and extends real-time nonlinear filtering…

Optimization and Control · Mathematics 2026-04-08 Shing-Tung Yau , Yi-Shuai Niu

We consider approximate maximum likelihood parameter estimation in nonlinear state-space models. We discuss both direct optimization of the likelihood and expectation--maximization (EM). For EM, we also give closed-form expressions for the…

Methodology · Statistics 2015-11-03 Juho Kokkala , Arno Solin , Simo Särkkä

We consider Bayesian inference for large scale inverse problems, where computational challenges arise from the need for repeated evaluations of an expensive forward model. This renders most Markov chain Monte Carlo approaches infeasible,…

Numerical Analysis · Mathematics 2022-08-12 Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

The Ensemble Kalman Filter (EnKF) has achieved great successes in data assimilation in atmospheric and oceanic sciences, but its failure in convergence to the right filtering distribution precludes its use for uncertainty quantification. We…

Methodology · Statistics 2021-05-13 Peiyi Zhang , Qifan Song , Faming Liang

Due to their flexibility, Gaussian processes (GPs) have been widely used in nonparametric function estimation. A prior information about the underlying function is often available. For instance, the physical system (computer model output)…

Methodology · Statistics 2017-11-21 Hassan Maatouk

We introduce a new sequential methodology to calibrate the fixed parameters and track the stochastic dynamical variables of a state-space system. The proposed method is based on the nested hybrid filtering (NHF) framework of [1], that…

Computation · Statistics 2021-03-24 Sara Pérez-Vieites , Joaquín Míguez

We present a novel sampling-based method for estimating probabilities of rare or failure events. Our approach is founded on the Ensemble Kalman filter (EnKF) for inverse problems. Therefore, we reformulate the rare event problem as an…

Numerical Analysis · Mathematics 2021-12-15 Fabian Wagner , Iason Papaioannou , Elisabeth Ullmann

This work presents new results and understanding of the Ensemble Kalman filter (EnKF) for inverse problems. In particular, using a Lagrangian dual perspective we show that EnKF can be derived from the sample average approximation (SAA) of…

Numerical Analysis · Mathematics 2026-01-27 C G Krishnanunni , Jonathan Wittmer , Tan Bui-Thanh , Quoc P. Nguyen

Reduced rank nonlinear filters are increasingly utilized in data assimilation of geophysical flows, but often require a set of ensemble forward simulations to estimate forecast covariance. On the other hand, predictor-corrector type nudging…

Computational Physics · Physics 2020-08-26 Suraj Pawar , Shady E. Ahmed , Omer San , Adil Rasheed , Ionel M. Navon

Conventional Kalman filtering (KF) approaches exhibit significant limitations in addressing nonlinear state estimation problems contaminated by non-Gaussian noise disturbances. To overcome these challenges, this work proposes a robust…

Signal Processing · Electrical Eng. & Systems 2026-05-25 Jinhui Hu , Haiquan Zhao , Yi Peng

Inference and simulation in the context of high-dimensional dynamical systems remain computationally challenging problems. Some form of dimensionality reduction is required to make the problem tractable in general. In this paper, we propose…

Machine Learning · Statistics 2024-01-04 Jonathan Schmidt , Philipp Hennig , Jörg Nick , Filip Tronarp

Counter-adversarial system design problems have lately motivated the development of inverse Bayesian filters. For example, inverse Kalman filter (I-KF) has been recently formulated to estimate the adversary's Kalman-filter-tracked estimates…

Optimization and Control · Mathematics 2023-08-11 Himali Singh , Arpan Chattopadhyay , Kumar Vijay Mishra

State-space models provide an important body of techniques for analyzing time-series, but their use requires estimating unobserved states. The optimal estimate of the state is its conditional expectation given the observation histories, and…

A sequential estimator based on the Ensemble Kalman Filter for Data Assimilation of fluid flows is presented in this research work. The main feature of this estimator is that the Kalman filter update, which relies on the determination of…

Computational Engineering, Finance, and Science · Computer Science 2021-07-28 Gabriel Moldovan , Guillame Lehnasch , Laurent Cordier , Marcello Meldi

The particle filter (PF) and the ensemble Kalman filter (EnKF) are widely used for approximate inference in state-space models. From a Bayesian perspective, these algorithms represent the prior by an ensemble of particles and update it to…

Methodology · Statistics 2025-02-11 Chengxin Gong , Wei Lin , Cheng Zhang

Uncertainty quantification based on generalized polynomial chaos has been used in many applications. It has also achieved great success in variation-aware design automation. However, almost all existing techniques assume that the parameters…

Numerical Analysis · Mathematics 2019-06-21 Chunfeng Cui , Zheng Zhang