English
Related papers

Related papers: Nonlinear Kalman Filtering with Divergence Minimiz…

200 papers

A common situation in filtering where classical Kalman filtering does not perform particularly well is tracking in the presence of propagating outliers. This calls for robustness understood in a distributional sense, i.e.; we enlarge the…

Statistics Theory · Mathematics 2014-01-28 Peter Ruckdeschel , Bernhard Spangl , Daria Pupashenko

Using the recently developed Sinkhorn algorithm for approximating the Wasserstein distance between probability distributions represented by Monte Carlo samples, we demonstrate exponential filter stability of two commonly used nonlinear…

Optimization and Control · Mathematics 2023-05-24 Pinak Mandal , Shashank Kumar Roy , Amit Apte

State estimation of dynamical systems from noisy observations is a fundamental task in many applications. It is commonly addressed using the linear Kalman filter (KF), whose performance can significantly degrade in the presence of outliers…

Signal Processing · Electrical Eng. & Systems 2024-08-27 Shunit Truzman , Guy Revach , Nir Shlezinger , Itzik Klein

We propose a Neural-Enhanced Distributed Kalman Filter (NDKF) for multi-sensor state estimation in nonlinear systems. Unlike traditional Kalman filters that rely on explicit analytical models and assume centralized fusion, NDKF leverages…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Siavash Farzan , Bennett Parisi

This paper presents a novel filter with low computational demand to address the problem of orientation estimation of a robotic platform. This is conventionally addressed by extended Kalman filtering of measurements from a sensor suit which…

Robotics · Computer Science 2016-12-02 Oscar De Silva , George K. I. Mann , Raymond G. Gosine

We propose a greedy mixture reduction algorithm which is capable of pruning mixture components as well as merging them based on the Kullback-Leibler divergence (KLD). The algorithm is distinct from the well-known Runnalls' KLD based method…

Machine Learning · Statistics 2015-08-25 Tohid Ardeshiri , Umut Orguner , Emre Özkan

The Kullback-Leibler (KL) divergence plays a central role in probabilistic machine learning, where it commonly serves as the canonical loss function. Optimization in such settings is often performed over the probability simplex, where the…

Machine Learning · Computer Science 2025-07-31 Adwait Datar , Nihat Ay

This study tackles the efficient estimation of Kullback-Leibler (KL) Divergence in Dirichlet Mixture Models (DMM), crucial for clustering compositional data. Despite the significance of DMMs, obtaining an analytically tractable solution for…

Machine Learning · Statistics 2024-03-20 Samyajoy Pal , Christian Heumann

Recent research in inverse cognition with cognitive radar has led to the development of inverse stochastic filters that are employed by the target to infer the information the cognitive radar may have learned. Prior works addressed this…

Optimization and Control · Mathematics 2024-04-22 Himali Singh , Kumar Vijay Mishra , Arpan Chattopadhyay

Kalman filtering has been traditionally applied in three application areas of estimation, state estimation, parameter estimation (a.k.a. model updating), and dual estimation. However, Kalman filter is often not sufficient when experimenting…

Systems and Control · Electrical Eng. & Systems 2019-11-11 Johnny Condori , Amin Maghareh , Shirley Dyke

Recursive least squares (RLS) is derived as the recursive minimizer of the least-squares cost function. Moreover, it is well known that RLS is a special case of the Kalman filter. This work presents the Kalman filter least squares (KFLS)…

Systems and Control · Electrical Eng. & Systems 2024-04-18 Brian Lai , Dennis S. Bernstein

We study the ensemble Kalman filter (EnKF) algorithm for sequential data assimilation in a general situation, that is, for nonlinear forecast and measurement models with non-additive and non-Gaussian noises. Such applications traditionally…

Methodology · Statistics 2018-08-17 Weixuan Li , W. Steven Rosenthal , Guang Lin

The Kalman Filter is a widely used approach for the linear estimation of dynamical systems and is frequently employed within nuclear and particle physics experiments for the reconstruction of charged particle trajectories, known as tracks.…

Instrumentation and Detectors · Physics 2025-03-04 Xiaocong Ai , Heather M. Gray , Andreas Salzburger , Nicholas Styles

Accelerated algorithms for maximum likelihood image reconstruction are essential for emerging applications such as 3D tomography, dynamic tomographic imaging, and other high dimensional inverse problems. In this paper, we introduce and…

Computation · Statistics 2012-01-31 Stéphane Chrétien , Alfred O. Hero

Tools from control and dynamical systems have proven valuable for analyzing and developing optimization methods. In this paper, we establish rigorous theoretical foundations for using feedback linearization (FL) -- a well-established…

Optimization and Control · Mathematics 2026-01-29 Runyu Zhang , Arvind Raghunathan , Jeff Shamma , Na Li

We study the problem of distributed Kalman filtering for sensor networks in the presence of model uncertainty. More precisely, we assume that the actual state-space model belongs to a ball, in the Kullback-Leibler topology, about the…

Optimization and Control · Mathematics 2020-04-20 Mattia Zorzi

Information-theoretic measures such as the entropy, cross-entropy and the Kullback-Leibler divergence between two mixture models is a core primitive in many signal processing tasks. Since the Kullback-Leibler divergence of mixtures provably…

Machine Learning · Computer Science 2017-02-01 Frank Nielsen , Ke Sun

Many applications, such as intermittent data assimilation, lead to a recursive application of Bayesian inference within a Monte Carlo context. Popular data assimilation algorithms include sequential Monte Carlo methods and ensemble Kalman…

Numerical Analysis · Mathematics 2013-01-15 Sebastian Reich

This work presents new results and understanding of the Ensemble Kalman filter (EnKF) for inverse problems. In particular, using a Lagrangian dual perspective we show that EnKF can be derived from the sample average approximation (SAA) of…

Numerical Analysis · Mathematics 2026-01-27 C G Krishnanunni , Jonathan Wittmer , Tan Bui-Thanh , Quoc P. Nguyen

Most Kalman filter extensions assume Gaussian noise and when the noise is non-Gaussian, usually other types of filters are used. These filters, such as particle filter variants, are computationally more demanding than Kalman type filters.…

Applications · Statistics 2021-05-19 Matti Raitoharju , Henri Nurminen , Demet Cilden-Guler , Simo Särkkä