English
Related papers

Related papers: Ensemble Inference Methods for Models With Noisy a…

200 papers

Data assimilation (DA) integrates numerical model forecasts with observations to achieve the optimal state estimation. Ensemble-based methods, such as the ensemble Kalman filter (EnKF), are widely used for state estimation for…

Atmospheric and Oceanic Physics · Physics 2026-05-25 Zhou Yao , Zhilin Li , Li Zhao , Zeng Liu , Zhaokuan Lu , Seungnam Kim , Guangyao Wang

We study Bayesian inverse problems with mixed noise, modeled as a combination of additive and multiplicative Gaussian components. While traditional inference methods often assume fixed or known noise characteristics, real-world…

Machine Learning · Computer Science 2025-10-17 Paul Hagemann , Robert Gruhlke , Bernhard Stankewitz , Claudia Schillings , Gabriele Steidl

In stochastic systems, informative approaches select key measurement or decision variables that maximize information gain to enhance the efficacy of model-related inferences. Neural Learning also embodies stochastic dynamics, but…

Machine Learning · Computer Science 2020-08-25 Margaret Trautner , Gabriel Margolis , Sai Ravela

Accurate modeling and prediction of complex physical systems often rely on data assimilation techniques to correct errors inherent in model simulations. Traditional methods like the Ensemble Kalman Filter (EnKF) and its variants as well as…

Machine Learning · Computer Science 2024-09-12 Phillip Si , Peng Chen

Bayesian methods are actively used for parameter identification and uncertainty quantification when solving nonlinear inverse problems with random noise. However, there are only few theoretical results justifying the Bayesian approach.…

Statistics Theory · Mathematics 2020-02-04 Vladimir Spokoiny

Most Kalman filter extensions assume Gaussian noise and when the noise is non-Gaussian, usually other types of filters are used. These filters, such as particle filter variants, are computationally more demanding than Kalman type filters.…

Applications · Statistics 2021-05-19 Matti Raitoharju , Henri Nurminen , Demet Cilden-Guler , Simo Särkkä

The ensemble Kalman filter (EnKF) is a method for combining a dynamical model with data in a sequential fashion. Despite its widespread use, there has been little analysis of its theoretical properties. Many of the algorithmic innovations…

Probability · Mathematics 2015-06-17 D. T. B. Kelly , K. J. H. Law , A. M. Stuart

For continuous-time linear stochastic dynamical systems driven by Wiener processes, we consider the problem of designing ensemble filters when the observation process is randomly time-sampled. We propose a continuous-discrete McKean--Vlasov…

Optimization and Control · Mathematics 2024-06-21 Aneel Tanwani , Olga Yufereva

Identifying model parameters from observed configurations poses a fundamental challenge in data science, especially with limited data. Recently, diffusion models have emerged as a novel paradigm in generative machine learning, capable of…

Data Analysis, Statistics and Probability · Physics 2025-03-14 Yechan Lim , Sangwon Lee , Junghyo Jo

This work introduces a new, distributed implementation of the Ensemble Kalman Filter (EnKF) that allows for non-sequential assimilation of large datasets in high-dimensional problems. The traditional EnKF algorithm is computationally…

Machine Learning · Statistics 2023-11-23 Cédric Travelletti , Jörg Franke , David Ginsbourger , Stefan Brönnimann

This paper develops efficient ensemble Kalman filter (EnKF) implementations based on shrinkage covariance estimation. The forecast ensemble members at each step are used to estimate the background error covariance matrix via the…

Statistics Theory · Mathematics 2015-02-03 Elias D. Nino-Ruiz , Adrian Sandu

This paper revisits building machine learning algorithms that involve interactions between entities, such as those between financial assets in an actively managed portfolio, or interactions between users in a social network. Our goal is to…

Machine Learning · Computer Science 2022-12-05 Qiong Wu , Jian Li , Zhenming Liu , Yanhua Li , Mihai Cucuringu

We propose a new recursive estimator for linear dynamical systems under Gaussian process noise and non-Gaussian measurement noise. Specifically, we develop an approximate maximum a posteriori (MAP) estimator using dynamic programming and…

Systems and Control · Electrical Eng. & Systems 2025-09-09 Mohammad Hussein Yoosefian Nooshabadi , Laurent Lessard

Contemporary data assimilation often involves more than a million prediction variables. Ensemble Kalman filters (EnKF) have been developed by geoscientists. They are successful indispensable tools in science and engineering, because they…

Probability · Mathematics 2017-05-26 Andrew J. Majda , Xin T. Tong

Several numerical tools designed to overcome the challenges of smoothing in a nonlinear and non-Gaussian setting are investigated for a class of particle smoothers. The considered family of smoothers is induced by the class of linear…

Numerical Analysis · Mathematics 2019-10-29 Jana de Wiljes , Sahani Pathiraja , Sebastian Reich

Practical data assimilation algorithms often contain hyper-parameters, which may arise due to, for instance, the use of certain auxiliary techniques like covariance inflation and localization in an ensemble Kalman filter, the…

Computation · Statistics 2022-06-08 Xiaodong Luo , Chuan-An Xia

We develop a general framework for state estimation in systems modeled with noise-polluted continuous time dynamics and discrete time noisy measurements. Our approach is based on maximum likelihood estimation and employs the calculus of…

Optimization and Control · Mathematics 2026-01-16 Griffin M. Kearney , Makan Fardad

Motivated by the maneuvering target tracking with sensors such as radar and sonar, this paper considers the joint and recursive estimation of the dynamic state and the time-varying process noise covariance in nonlinear state space models.…

Systems and Control · Electrical Eng. & Systems 2023-05-09 Hua Lan , Jinjie Hu , Zengfu Wang , Qiang Cheng

The spatial dependent unknown acoustic source is reconstructed according noisy multiple frequency data on a remote closed surface. Assume that the unknown function is supported on a bounded domain. To determine the support, we present a…

Numerical Analysis · Mathematics 2019-07-30 Zhiliang Deng , Xiaomei Yang

A hybrid particle ensemble Kalman filter is developed for problems with medium non-Gaussianity, i.e. problems where the prior is very non-Gaussian but the posterior is approximately Gaussian. Such situations arise, e.g., when nonlinear…

Methodology · Statistics 2021-03-15 Gregor Robinson , Ian Grooms