English
Related papers

Related papers: Evaluation of an ensemble-based incremental variat…

200 papers

Control variates have become an increasingly popular variance-reduction technique in Bayesian inference. Many broadly applicable control variates are based on the Langevin-Stein operator, which leverages gradient information from any…

Computation · Statistics 2025-09-04 Long M. Nguyen , Christopher Drovandi , Leah F. South

Anomaly Detection in multivariate time series is a major problem in many fields. Due to their nature, anomalies sparsely occur in real data, thus making the task of anomaly detection a challenging problem for classification algorithms to…

Machine Learning · Computer Science 2023-08-08 Anastasios Iliopoulos , John Violos , Christos Diou , Iraklis Varlamis

Recent studies have demonstrated improved skill in numerical weather prediction via the use of spatially correlated observation error covariance information in data assimilation systems. In this case, the observation weighting matrices…

Numerical Analysis · Mathematics 2022-01-05 Guannan Hu , Sarah L. Dance

In inverse problems, the goal is to estimate unknown model parameters from noisy observational data. Traditionally, inverse problems are solved under the assumption of a fixed forward operator describing the observation model. In this…

Numerical Analysis · Mathematics 2024-09-26 Simon Weissmann , Neil K. Chada , Xin T. Tong

We explore the potential of Data-Assimilation (DA) within the multi-scale framework of a shell model of turbulence, with a focus on the Ensemble Kalman Filter (EnKF). The central objective is to understand how measuring mesoscales (i.e.,…

Fluid Dynamics · Physics 2026-01-15 Francesco Fossella , Luca Biferale , Alberto Carrassi , Massimo Cencini , Vikrant Gupta

A hybrid data assimilation algorithm is developed for complex dynamical systems with partial observations. The method starts with applying a spectral decomposition to the entire spatiotemporal fields, followed by creating a machine learning…

Computational Physics · Physics 2022-12-27 Changhong Mou , Leslie M. Smith , Nan Chen

The Ensemble Kalman filter (EnKF) was introduced by Evensen in 1994 [10] as a novel method for data assimilation: state estimation for noisily observed time-dependent problems. Since that time it has had enormous impact in many application…

Optimization and Control · Mathematics 2013-04-08 Marco A. Iglesias , Kody J. H. Law , Andrew M. Stuart

In the field of computer vision, the persistent presence of color bias, resulting from fluctuations in real-world lighting and camera conditions, presents a substantial challenge to the robustness of models. This issue is particularly…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Yunpeng Gong , Jiaquan Li , Lifei Chen , Min Jiang

We propose the application of iterative regularization for the development of ensemble methods for solving Bayesian inverse problems. In concrete, we construct (i) a variational iterative regularizing ensemble Levenberg-Marquardt method…

Numerical Analysis · Mathematics 2014-06-25 Marco A. Iglesias

This manuscript derives locally weighted ensemble Kalman methods from the point of view of ensemble-based function approximation. This is done by using pointwise evaluations to build up a local linear or quadratic approximation of a…

Numerical Analysis · Mathematics 2025-05-07 Philipp Wacker

Ensemble transform Kalman filtering (ETKF) data assimilation is often used to combine available observations with numerical simulations to obtain statistically accurate and reliable state representations in dynamical systems. However, it is…

Numerical Analysis · Mathematics 2024-03-07 Tongtong Li , Anne Gelb , Yoonsang Lee

This paper provides a detailed theoretical analysis of methods to approximate the solutions of high-dimensional (>10^6) linear Bayesian problems. An optimal low-rank projection that maximizes the information content of the Bayesian…

Data Analysis, Statistics and Probability · Physics 2019-10-28 Nicolas Bousserez , Daven K. Henze

Ensemble data assimilation in flood forecasting depends strongly on the density, frequency and statistics of errors associated with the observation network. This work focuses on the assimilation of 2D flood extent data, expressed in terms…

Image and Video Processing · Electrical Eng. & Systems 2023-05-24 Thanh Huy Nguyen , Sophie Ricci , Andrea Piacentini , Raquel Rodriguez Suquet , Gwendoline Blanchet , Santiago Pena Luque , Peter Kettig

The technique of data augmentation (DA) is often used in machine learning for regularization purposes to better generalize under i.i.d. settings. In this work, we present a unifying framework with topics in causal inference to make a case…

Machine Learning · Computer Science 2026-02-02 Uzair Akbar , Niki Kilbertus , Hao Shen , Krikamol Muandet , Bo Dai

Data assimilation aims to estimate the states of a dynamical system by optimally combining sparse and noisy observations of the physical system with uncertain forecasts produced by a computational model. The states of many dynamical systems…

Optimization and Control · Mathematics 2024-05-08 Amit N. Subrahmanya , Andrey A. Popov , Reid J. Gomillion , Adrian Sandu

The weighting of critical-point samples in the weighted randomized maximum likelihood method depend on the magnitude of the data mismatch at the critical points and on the Jacobian of the transformation from the prior density to the…

Methodology · Statistics 2023-01-16 Yuming Ba , Dean S. Oliver

This paper presents a novel centralized, variational data assimilation approach for calibrating transient dynamic models in electrical power systems, focusing on load model parameters. With the increasing importance of inverter-based…

Optimization and Control · Mathematics 2023-11-15 Ahmed Attia , D. Adrian Maldonado , Emil Constantinescu , Mihai Anitescu

Data assimilation (DA) plays a pivotal role in diverse applications, ranging from climate predictions and weather forecasts to trajectory planning for autonomous vehicles. A prime example is the widely used ensemble Kalman filter (EnKF),…

Dynamical Systems · Mathematics 2024-01-03 Mohamad Abed El Rahman Hammoud , Naila Raboudi , Edriss S. Titi , Omar Knio , Ibrahim Hoteit

In this paper, we present a new ensemble-based filter method by reconstructing the analysis step of the particle filter through a transport map, which directly transports prior particles to posterior particles. The transport map is…

Machine Learning · Statistics 2026-05-14 Dengfei Zeng , Lijian Jiang

We explore the potential of three-dimensional data assimilation for assimilating sparsely-distributed 2-metre temperature observations across the coupled atmosphere-land interface into the soil moisture. Using idealised twin experiments…

Atmospheric and Oceanic Physics · Physics 2022-09-29 Tobias Finn , Gernot Geppert , Felix Ament