English
Related papers

Related papers: Nonlinear Kalman Filtering with Divergence Minimiz…

200 papers

Controlled interacting particle systems such as the ensemble Kalman filter (EnKF) and the feedback particle filter (FPF) are numerical algorithms to approximate the solution of the nonlinear filtering problem in continuous time. The…

Systems and Control · Electrical Eng. & Systems 2019-10-08 Amirhossein Taghvaei , Prashant G. Mehta

This paper proposes two practical implementations of Four-Dimensional Variational (4D-Var) Ensemble Kalman Filter (4D-EnKF) methods for non-linear data assimilation. Our formulations' main idea is to avoid the intrinsic need for adjoint…

Applications · Statistics 2023-05-05 Elias Nin-Ruiz , Jairo Diaz-Rodriguez

The filtering distribution captures the statistics of the state of a dynamical system from partial and noisy observations. Classical particle filters provably approximate this distribution in quite general settings; however they behave…

Statistics Theory · Mathematics 2025-02-10 Edoardo Calvello , Pierre Monmarché , Andrew M. Stuart , Urbain Vaes

We present a new perspective on the celebrated Sinkhorn algorithm by showing that is a special case of incremental/stochastic mirror descent. In order to see this, one should simply plug Kullback-Leibler divergence in both mirror map and…

Machine Learning · Computer Science 2019-09-17 Konstantin Mishchenko

In this paper, we present a UKF-PF based hybrid nonlinear filter for space object tracking. Estimating the state and its associated uncertainty, also known as filtering is paramount to the tracking process. The periodicity of the Keplerian…

Dynamical Systems · Mathematics 2014-09-30 Dilshad Raihan A. V. , Suman Chakravorty

Water treatment and liquid storage are the two plants implementing the hydraulic three-tank system. Maintaining certain levels is the critical scenario so that the systems run as desired. To deal with, the optimal linear control and the…

Systems and Control · Electrical Eng. & Systems 2026-04-07 Bambang L. Widjiantoro , Katherin Indriawati , Moh Kamalul Wafi

This paper is concerned with optimal control problems for control systems in continuous time, and interacting particle system methods designed to construct approximate control solutions. Particular attention is given to the linear quadratic…

Systems and Control · Electrical Eng. & Systems 2022-07-11 Anant Joshi , Amirhossein Taghvaei , Prashant G. Mehta , Sean P. Meyn

The optimal predictor for a linear dynamical system (with hidden state and Gaussian noise) takes the form of an autoregressive linear filter, namely the Kalman filter. However, a fundamental problem in reinforcement learning and control…

Machine Learning · Computer Science 2019-05-27 Holden Lee , Cyril Zhang

We propose an efficient online approximate Bayesian inference algorithm for estimating the parameters of a nonlinear function from a potentially non-stationary data stream. The method is based on the extended Kalman filter (EKF), but uses a…

Machine Learning · Statistics 2023-06-29 Peter G. Chang , Gerardo Durán-Martín , Alexander Y Shestopaloff , Matt Jones , Kevin Murphy

In this work, a novel sequential Monte Carlo filter is introduced which aims at efficient sampling of high-dimensional state spaces with a limited number of particles. Particles are pushed forward from the prior to the posterior density…

Machine Learning · Statistics 2018-05-30 Manuel Pulido , Peter Jan vanLeeuwen

Tensor factorizations with nonnegative constraints have found application in analyzing data from cyber traffic, social networks, and other areas. We consider application data best described as being generated by a Poisson process (e.g.,…

Numerical Analysis · Mathematics 2018-08-23 Samantha Hansen , Todd Plantenga , Tamara G. Kolda

Expectation maximization (EM) is the default algorithm for fitting probabilistic models with missing or latent variables, yet we lack a full understanding of its non-asymptotic convergence properties. Previous works show results along the…

Machine Learning · Computer Science 2022-03-01 Frederik Kunstner , Raunak Kumar , Mark Schmidt

This paper investigates the state estimation problem for unknown linear systems subject to both process and measurement noise. Based on a prior input-output trajectory sampled at a higher frequency and a prior state trajectory sampled at a…

Systems and Control · Electrical Eng. & Systems 2025-01-23 Peihu Duan , Tao Liu , Yu Xing , Karl Henrik Johansson

Kalman filters provide a straightforward and interpretable means to estimate hidden or latent variables, and have found numerous applications in control, robotics, signal processing, and machine learning. One such application is neural…

Machine Learning · Computer Science 2024-01-29 Josue Casco-Rodriguez , Caleb Kemere , Richard G. Baraniuk

One-bit quantization has recently become an attractive option for data acquisition in cutting edge applications, due to the increasing demand for low power and higher sampling rates. Subsequently, the rejuvenated one-bit array processing…

Signal Processing · Electrical Eng. & Systems 2020-10-29 Amir Weiss , Arie Yeredor

In this study, we utilize the Kalman-Filter analysis to assess market efficiency in major stock markets. The Kalman-Filter operates in two stages, assuming that the data contains a consistent trendline representing the true market value…

Computational Finance · Quantitative Finance 2024-04-26 Beier Liu , Haiyun Zhu

A new formulation of the particle filter for nonlinear filtering is presented, based on concepts from optimal control, and from the mean-field game theory. The optimal control is chosen so that the posterior distribution of a particle…

Numerical Analysis · Mathematics 2013-02-27 Tao Yang , Prashant G. Mehta , Sean P. Meyn

Recent Reinforcement Learning (RL) algorithms making use of Kullback-Leibler (KL) regularization as a core component have shown outstanding performance. Yet, only little is understood theoretically about why KL regularization helps, so far.…

Machine Learning · Computer Science 2021-01-07 Nino Vieillard , Tadashi Kozuno , Bruno Scherrer , Olivier Pietquin , Rémi Munos , Matthieu Geist

We derive a deterministic, non-asymptotic upper bound on the Kullback-Leibler (KL) divergence of the flow-matching distribution approximation. In particular, if the $L_2$ flow-matching loss is bounded by $\epsilon^2 > 0$, then the KL…

Machine Learning · Computer Science 2025-11-10 Maojiang Su , Jerry Yao-Chieh Hu , Sophia Pi , Han Liu

We derive a novel, provably robust, and closed-form Bayesian update rule for online filtering in state-space models in the presence of outliers and misspecified measurement models. Our method combines generalised Bayesian inference with…