English
Related papers

Related papers: A Step by Step Mathematical Derivation and Tutoria…

200 papers

We introduce Kalman Gradient Descent, a stochastic optimization algorithm that uses Kalman filtering to adaptively reduce gradient variance in stochastic gradient descent by filtering the gradient estimates. We present both a theoretical…

Machine Learning · Statistics 2018-10-30 James Vuckovic

In this paper, we present the detailed mathematical derivation of the gradient and Hessian matrix for the Vora-Value based colorimetric filter optimization. We make a full recapitulation of the steps involved in differentiating the…

Optimization and Control · Mathematics 2020-10-06 Yuteng Zhu , Graham D. Finlayson

We propose an affine-mapping based variational Ensemble Kalman filter for sequential Bayesian filtering problems with generic observation models. Specifically, the proposed method is formulated as to construct an affine mapping from the…

Numerical Analysis · Mathematics 2021-09-06 Linjie Wen , Jinglai Li

We propose a method for optimal Bayesian filtering with deterministic particles. In order to avoid particle degeneration, the filter step is not performed at once. Instead, the particles progressively flow from prior to posterior. This is…

Machine Learning · Statistics 2023-03-07 Uwe D. Hanebeck

The Kalman filter and its extensions are used in a vast number of aerospace and navigation applications for nonlinear state estimation of time series. In the literature, different approaches have been proposed to exploit the structure of…

Systems and Control · Electrical Eng. & Systems 2019-10-11 Matti Raitoharju , Robert Piché

We formulate a recursive estimation problem for multiple dynamical systems coupled through a low dimensional stochastic input, and we propose an efficient sub-optimal solution. The suggested approach is an approximation of the Kalman filter…

Optimization and Control · Mathematics 2019-11-26 Leonid Pogorelyuk , Clarence W. Rowley , N. Jeremy Kasdin

Bayesian filtering approximates the true underlying behavior of a time-varying system by inverting an explicit generative model to convert noisy measurements into state estimates. This process typically requires either storage, inversion,…

Machine Learning · Computer Science 2023-11-20 Gianluca M. Bencomo , Jake C. Snell , Thomas L. Griffiths

In this paper we provide novel closed-form expressions enabling differentiation of any scalar function of the Kalman filter's outputs with respect to all its tuning parameters and to the measurements. The approach differs from the previous…

Optimization and Control · Mathematics 2023-04-03 Colin Parellier , Axel Barrau , Silvere Bonnabel

In this paper, we present the optimization formulation of the Kalman filtering and smoothing problems, and use this perspective to develop a variety of extensions and applications. We first formulate classic Kalman smoothing as a least…

Optimization and Control · Mathematics 2013-03-12 Aleksandr Y. Aravkin , James V. Burke , Gianluigi Pillonetto

A generalisation of the extended Kalman filter for Stiefel manifold-valued measurements is presented. We provide simulations on the 2-sphere and the space of orthogonal 4-by-2 matrices which show significant improvement of the Extended…

Applications · Statistics 2025-11-05 Jordi-Lluís Figueras , Aron Persson , Lauri Viitasaari

The Kalman filter is a fundamental filtering algorithm that fuses noisy sensory data, a previous state estimate, and a dynamics model to produce a principled estimate of the current state. It assumes, and is optimal for, linear models and…

Neural and Evolutionary Computing · Computer Science 2021-04-30 Beren Millidge , Alexander Tschantz , Anil Seth , Christopher Buckley

Kalman filter is a best linear unbiased state estimator. It is also comprehensible from the point view of the Bayesian estimation. However, this note gives a detailed derivation of Kalman filter from the mutual information perspective for…

Information Theory · Computer Science 2021-01-05 Yarong Luo , Jianlang Hu , Chi Guo

In this paper, we propose an approach to address the problems with ambiguity in tuning the process and observation noises for a discrete-time linear Kalman filter. Conventional approaches to tuning (e.g. using normalized estimation error…

Systems and Control · Electrical Eng. & Systems 2021-08-25 Zhaozhong Chen , Christoffer Heckman , Simon Julier , Nisar Ahmed

We introduce the inverse Kalman filter, which enables exact matrix-vector multiplication between a covariance matrix from a dynamic linear model and any real-valued vector with linear computational cost. We integrate the inverse Kalman…

Methodology · Statistics 2026-01-27 Xinyi Fang , Mengyang Gu

Large-scale distributed systems such as sensor networks, often need to achieve filtering and consensus on an estimated parameter from high-dimensional measurements. Running a Kalman filter on every node in such a network is computationally…

Optimization and Control · Mathematics 2017-04-12 Mathias Hudoba de Badyn , Mehran Mesbahi

Kalman Filtering problems often have inherent and known constraints in the physical dynamics that are not exploited despite potentially significant gains (e.g., fixed speed of a motor). In this paper, we review existing methods and propose…

Optimization and Control · Mathematics 2009-02-11 Nachi Gupta

Kalman filtering is a widely used framework for Bayesian estimation. The partitioned update Kalman filter applies a Kalman filter update in parts so that the most linear parts of measurements are applied first. In this paper, we generalize…

Optimization and Control · Mathematics 2016-03-16 Matti Raitoharju , Ángel F. García-Fernández , Robert Piché

In this manuscript, a general method for deriving filtering algorithms that involve a network of interconnected Bayesian filters is proposed. This method is based on the idea that the processing accomplished inside each of the Bayesian…

Statistics Theory · Mathematics 2020-04-22 Giorgio M. Vitetta , Pasquale Di Viesti , Emilio Sirignano , Francesco Montorsi

We present a novel algorithm based on the ensemble Kalman filter to solve inverse problems involving multiscale elliptic partial differential equations. Our method is based on numerical homogenization and finite element discretization and…

Numerical Analysis · Mathematics 2020-12-16 Assyr Abdulle , Giacomo Garegnani , Andrea Zanoni

In this paper, we give a detailed account of the algorithm outlined in [1] for Feynman integral reduction and $\varepsilon$-factorised differential equations. The algorithm consists of two steps. In the first step, we use a new geometric…

‹ Prev 1 2 3 10 Next ›