English
Related papers

Related papers: Algorithm Design and Comparative Test of Natural G…

200 papers

In this manuscript, a general method for deriving filtering algorithms that involve a network of interconnected Bayesian filters is proposed. This method is based on the idea that the processing accomplished inside each of the Bayesian…

Statistics Theory · Mathematics 2020-04-22 Giorgio M. Vitetta , Pasquale Di Viesti , Emilio Sirignano , Francesco Montorsi

We consider the problem of performing Bayesian inference for logistic regression using appropriate extensions of the ensemble Kalman filter. Two interacting particle systems are proposed that sample from an approximate posterior and prove…

Machine Learning · Statistics 2024-07-02 Diksha Bhandari , Jakiw Pidstrigach , Sebastian Reich

Variational approximation methods have proven to be useful for scaling Bayesian computations to large data sets and highly parametrized models. Applying variational methods involves solving an optimization problem, and recent research in…

Methodology · Statistics 2017-01-13 Victor M. -H. Ong , David J. Nott , Michael S. Smith

This paper contains a concise comparison of a number of nonlinear attitude filtering methods that have attracted attention in the robotics and aviation literature. With the help of previously published surveys and comparison studies, the…

Systems and Control · Computer Science 2015-02-16 M. Zamani , J. Trumpf , R. Mahony

Artificial neural networks (ANNs) are powerful machine learning methods used in many modern applications such as facial recognition, machine translation, and cancer diagnostics. A common issue with ANNs is that they usually have millions or…

Machine Learning · Statistics 2023-05-08 Lars Skaaret-Lund , Geir Storvik , Aliaksandr Hubin

Bayesian inference offers a robust framework for updating prior beliefs based on new data using Bayes' theorem, but exact inference is often computationally infeasible, necessitating approximate methods. Though widely used, these methods…

Machine Learning · Statistics 2024-10-23 Xu-Hui Zhou , Zhuo-Ran Liu , Heng Xiao

Existing high-dimensional Bayesian optimization (BO) methods aim to overcome the curse of dimensionality by carefully encoding structural assumptions, from locality to sparsity to smoothness, into the optimization procedure. Surprisingly,…

Machine Learning · Computer Science 2026-04-10 Colin Doumont , Donney Fan , Natalie Maus , Jacob R. Gardner , Henry Moss , Geoff Pleiss

The paper provides simple formulas of Bayesian filtering for the exact recursive computation of state conditional probability density functions given quantized innovations signal measurements of a linear stochastic system. This is a topic…

Systems and Control · Computer Science 2017-04-11 Chun-Chia Huang , Robert R. Bitmead

Reliable state estimation is essential for autonomous systems operating in complex, noisy environments. Classical filtering approaches, such as the Kalman filter, can struggle when facing nonlinear dynamics or non-Gaussian noise, and even…

Machine Learning · Computer Science 2025-04-11 Wonjin Song , Feng Bao

The PC algorithm is a popular method for learning the structure of Gaussian Bayesian networks. It carries out statistical tests to determine absent edges in the network. It is hence governed by two parameters: (i) The type of test, and (ii)…

In this paper is proposed a novel incremental iterative Gauss-Newton-Markov-Kalman filter method for state estimation of dynamic models given noisy measurements. The mathematical formulation of the proposed filter is based on the…

Optimization and Control · Mathematics 2019-09-17 Bojana Rosic

In this work, we highlight a connection between the incremental proximal method and stochastic filters. We begin by showing that the proximal operators coincide, and hence can be realized with, Bayes updates. We give the explicit form of…

Computation · Statistics 2018-07-13 Ömer Deniz Akyildiz , Victor Elvira , Joaquin Miguez

We look at a stochastic time-varying optimization problem and we formulate online algorithms to find and track its optimizers in expectation. The algorithms are derived from the intuition that standard prediction and correction steps can be…

Optimization and Control · Mathematics 2024-04-11 Andrea Simonetto , Paolo Massioni

Ensemble Kalman filters are based on a Gaussian assumption, which can limit their performance in some non-Gaussian settings. This paper reviews two nonlinear, non-Gaussian extensions of the Ensemble Kalman Filter: Gaussian anamorphosis (GA)…

Computation · Statistics 2022-03-08 Ian Grooms

Recent years have witnessed a growing interest in tracking algorithms that augment Kalman Filters (KFs) with Deep Neural Networks (DNNs). By transforming KFs into trainable deep learning models, one can learn from data to reliably track a…

Signal Processing · Electrical Eng. & Systems 2025-06-19 Yehonatan Dahan , Guy Revach , Jindrich Dunik , Nir Shlezinger

This paper presents a systematic review of recent advances in nonlinear filtering algorithms, structured into three principal categories: Kalman-type methods, Monte Carlo methods, and the Yau-Yau algorithm. For each category, we provide a…

Optimization and Control · Mathematics 2026-02-11 Chang Qin , Yikun Li , Ru Qian , Jiayi Kang , Yao Mao

Recent result shows how to compute distributively and efficiently the linear MMSE for the multiuser detection problem, using the Gaussian BP algorithm. In the current work, we extend this construction, and show that operating this algorithm…

Information Theory · Computer Science 2009-04-16 Danny Bickson , Ori Shental , Danny Dolev

An incremental/online state dynamic learning method is proposed for identification of the nonlinear Gaussian state space models. The method embeds the stochastic variational sparse Gaussian process as the probabilistic state dynamic model…

Machine Learning · Statistics 2016-08-31 Vahid Bastani , Lucio Marcenaro , Carlo Regazzoni

Matrix completion aims to predict missing elements in a partially observed data matrix which in typical applications, such as collaborative filtering, is large and extremely sparsely observed. A standard solution is matrix factorization,…

Machine Learning · Computer Science 2019-08-06 Xiangju Qin , Paul Blomstedt , Samuel Kaski

Filters, especially wide range of Kalman Filters have shown their impacts on predicting variables of stochastic models with higher accuracy then traditional statistic methods. Updating mean and covariance each time makes Bayesian inferences…

Applications · Statistics 2018-03-26 Yan Zhao