English
Related papers

Related papers: An Adaptive Covariance Parameterization Technique …

200 papers

The purpose of this review is to present a comprehensive overview of the theory of ensemble Kalman-Bucy filtering for continuous-time, linear-Gaussian signal and observation models. We present a system of equations that describe the flow of…

Statistics Theory · Mathematics 2023-06-16 Adrian N. Bishop , Pierre Del Moral

Data assimilation provides algorithms for widespread applications in various fields. It is of practical use to deal with a large amount of information in the complex system that is hard to estimate. Weather forecasting is one of the…

Optimization and Control · Mathematics 2023-03-23 Yihua Yang

This paper is considered with joint estimation of state and time-varying noise covariance matrices in non-linear stochastic state space models. We present a variational Bayes and Gaussian filtering based algorithm for efficient computation…

Methodology · Statistics 2013-02-05 Simo Särkkä Jouni Hartikainen

The inverse problem of determining parameters in a model by comparing some output of the model with observations is addressed. This is a description for what hat to be done to use the Gauss-Markov-Kalman filter for the Bayesian estimation…

Numerical Analysis · Mathematics 2016-11-29 Hermann G. Matthies , Alexander Litvinenko , Bojana V. Rosic , Elmar Zander

In this work, a kernel-based Ensemble Gaussian Mixture Probability Hypothesis Density (EnGM-PHD) filter is presented for multi-target filtering applications. The EnGM-PHD filter combines the Gaussian-mixture-based techniques of the Gaussian…

Machine Learning · Computer Science 2025-05-02 Dalton Durant , Renato Zanetti

In the classical Kalman filter(KF), the estimated state is a linear combination of the one-step predicted state and measurement state, their confidence level change when the prediction mean square error matrix and covariance matrix of…

Signal Processing · Electrical Eng. & Systems 2023-09-19 Benyang Gong , Jiacheng He , Gang Wang , Bei Peng

We consider maximum likelihood estimation for Gaussian Mixture Models (Gmms). This task is almost invariably solved (in theory and practice) via the Expectation Maximization (EM) algorithm. EM owes its success to various factors, of which…

Machine Learning · Statistics 2018-06-04 Reshad Hosseini , Suvrit Sra

Filter methods realize a projection from a superposed quantum state onto a target state, which can be efficient if two states have sufficient overlap. Here we propose a quantum Gaussian filter (QGF) with the filter operator being a Gaussian…

Quantum Physics · Physics 2022-09-19 Min-Quan He , Dan-Bo Zhang , Z. D. Wang

This paper proposes new methodology for sequential state and parameter estimation within the ensemble Kalman filter. The method is fully Bayesian and propagates the joint posterior density of states and parameters over time. In order to…

Methodology · Statistics 2016-11-14 Jonathan R. Stroud , Matthias Katzfuss , Christopher K. Wikle

This work introduces a novel probabilistic deep learning technique called deep Gaussian mixture ensembles (DGMEs), which enables accurate quantification of both epistemic and aleatoric uncertainty. By assuming the data generating process…

Machine Learning · Statistics 2023-06-13 Yousef El-Laham , Niccolò Dalmasso , Elizabeth Fons , Svitlana Vyetrenko

We study the convergence behavior of the Expectation Maximization (EM) algorithm on Gaussian mixture models with an arbitrary number of mixture components and mixing weights. We show that as long as the means of the components are separated…

Statistics Theory · Mathematics 2018-10-10 Ruofei Zhao , Yuanzhi Li , Yuekai Sun

We take a new look at parameter estimation for Gaussian Mixture Models (GMMs). In particular, we propose using \emph{Riemannian manifold optimization} as a powerful counterpart to Expectation Maximization (EM). An out-of-the-box invocation…

Machine Learning · Statistics 2015-06-26 Reshad Hosseini , Suvrit Sra

This paper presents a seamless algorithm for the application of the multilevel Monte Carlo (MLMC) method to the ensemble transform particle filter (ETPF). The algorithm uses a combination of optimal coupling transformations between coarse…

Numerical Analysis · Mathematics 2017-06-15 Alastair Gregory , Colin Cotter

Standard maximum likelihood or Bayesian approaches to parameter estimation for stochastic differential equations are not robust to perturbations in the continuous-in-time data. In this paper, we give a rather elementary explanation of this…

Numerical Analysis · Mathematics 2023-12-20 Sebastian Reich

The present paper proposes generalized Gaussian kernel adaptive filtering, where the kernel parameters are adaptive and data-driven. The Gaussian kernel is parametrized by a center vector and a symmetric positive definite (SPD) precision…

Machine Learning · Computer Science 2021-05-20 Tomoya Wada , Kosuke Fukumori , Toshihisa Tanaka , Simone Fiori

In this paper, we study the problem of learning one-dimensional Gaussian mixture models (GMMs) with a specific focus on estimating both the model order and the mixing distribution from independent and identically distributed (i.i.d.)…

Machine Learning · Statistics 2026-02-24 Xinyu Liu , Hai Zhang

Data assimilation is the task to combine evolution models and observational data in order to produce reliable predictions. In this paper, we focus on ensemble-based recursive data assimilation problems. Our main contribution is a hybrid…

Numerical Analysis · Mathematics 2016-02-26 Nawinda Chustagulprom , Sebastian Reich , Maria Reinhardt

Collaborative filtering is an important technique for recommendation. Whereas it has been repeatedly shown to be effective in previous work, its performance remains unsatisfactory in many real-world applications, especially those where the…

Information Retrieval · Computer Science 2018-08-15 Zhiyu Min , Dahua Lin

The Bootstrap Particle Filter (BPF) and the Ensemble Kalman Filter (EnKF) are two widely used methods for sequential Bayesian filtering: the BPF is asymptotically exact but can suffer from weight degeneracy, while the EnKF scales well in…

Methodology · Statistics 2026-01-28 Ilja Klebanov , Claudia Schillings , Dana Wrischnig

Gaussian Mixture Models (GMMs) are one of the most potent parametric density models used extensively in many applications. Flexibly-tied factorization of the covariance matrices in GMMs is a powerful approach for coping with the challenges…

Machine Learning · Computer Science 2023-11-14 Mohammad Pasande , Reshad Hosseini , Babak Nadjar Araabi