English
Related papers

Related papers: Learning stochastic filtering

200 papers

In this paper, we compare the performance of two methods for estimating Bayesian networks from data containing exogenous variables and random effects. The first method is fully Bayesian in which a prior distribution is placed on the…

Methodology · Statistics 2011-12-02 Jessica Kasza , Patty Solomon

In this work, we systematically benchmark two recently developed deep density methods for nonlinear filtering. We model the filtering density of a discretely observed stochastic differential equation through the associated Fokker--Planck…

Numerical Analysis · Mathematics 2026-04-21 Kasper Bågmark , Filip Rydin

The capability of a novel Kullback-Leibler divergence method is examined herein within the Kalman filter framework to select the input-parameter-state estimation execution with the most plausible results. This identification suffers from…

Signal Processing · Electrical Eng. & Systems 2025-11-05 Marios Impraimakis

Variational Bayesian inference is an important machine-learning tool that finds application from statistics to robotics. The goal is to find an approximate probability density function (PDF) from a chosen family that is in some sense…

Machine Learning · Computer Science 2022-09-27 Timothy D. Barfoot , Gabriele M. T. D'Eleuterio

There are numerous contexts where one wishes to describe the state of a randomly evolving system. Effective solutions combine models that quantify the underlying uncertainty with available observational data to form relatively optimal…

Probability · Mathematics 2013-11-27 Wonjung Lee , Terry Lyons

We show that the Kullback-Leibler distance is a good measure of the statistical uncertainty of correlation matrices estimated by using a finite set of data. For correlation matrices of multivariate Gaussian variables we analytically…

Data Analysis, Statistics and Probability · Physics 2008-12-02 Michele Tumminello , Fabrizio Lillo , Rosario Nunzio Mantegna

A novel approximate Bayesian filter based on backward stochastic differential equations is introduced. It uses a nonlinear Feynman--Kac representation of the filtering problem and the approximation of an unnormalized filtering density using…

Numerical Analysis · Mathematics 2026-04-21 Kasper Bågmark , Adam Andersson , Stig Larsson

We provide performance guarantees for a variant of simulation-based policy iteration for controlling Markov decision processes that involves the use of stochastic approximation algorithms along with state-of-the-art techniques that are…

Machine Learning · Computer Science 2022-10-17 Anna Winnicki , R. Srikant

Stochastic Gradient Descent with a constant learning rate (constant SGD) simulates a Markov chain with a stationary distribution. With this perspective, we derive several new results. (1) We show that constant SGD can be used as an…

Machine Learning · Statistics 2018-01-23 Stephan Mandt , Matthew D. Hoffman , David M. Blei

For modelling geophysical systems, large-scale processes are described through a set of coarse-grained dynamical equations while small-scale processes are represented via parameterizations. This work proposes a method for identifying the…

Atmospheric and Oceanic Physics · Physics 2018-08-01 Manuel Pulido , Pierre Tandeo , Marc Bocquet , Alberto Carrassi , Magdalena Lucini

We develop a stochastic approximation-type algorithm to solve finite state/action, infinite-horizon, risk-aware Markov decision processes. Our algorithm has two loops. The inner loop computes the risk by solving a stochastic saddle-point…

Optimization and Control · Mathematics 2019-12-05 Wenjie Huang , William B. Haskell

Many dynamical systems are subjected to stochastic influences, such as random excitations, noise, and unmodeled behavior. Tracking the system's state and parameters based on a physical model is a common task for which filtering algorithms,…

Signal Processing · Electrical Eng. & Systems 2024-07-03 Jan Grashorn , Matteo Broggi , Ludovic Chamoin , Michael Beer

The aim of this paper is to approximate a finite-state Markov process by another process with fewer states, called herein the approximating process. The approximation problem is formulated using two different methods. The first method,…

Recent advances in variational inference enable the modelling of highly structured joint distributions, but are limited in their capacity to scale to the high-dimensional setting of stochastic neural networks. This limitation motivates a…

Obtaining an accurate estimate of the underlying covariance matrix from finite sample size data is challenging due to sample size noise. In recent years, sophisticated covariance-cleaning techniques based on random matrix theory have been…

Computation · Statistics 2024-11-11 Christian Bongiorno , Lamia Lamrani

This paper studies the question of filtering and maximizing terminal wealth from expected utility in a partially information stochastic volatility models. The special features is that the only information available to the investor is the…

Portfolio Management · Quantitative Finance 2015-07-28 Dalia Ibrahim , Frédéric Abergel

Clustering analysis by nonnegative low-rank approximations has achieved remarkable progress in the past decade. However, most approximation approaches in this direction are still restricted to matrix factorization. We propose a new low-rank…

Machine Learning · Computer Science 2012-06-22 Zhirong Yang , Erkki Oja

Multi-object state estimation is a fundamental problem for robotic applications where a robot must interact with other moving objects. Typically, other objects' relevant state features are not directly observable, and must instead be…

Robotics · Computer Science 2022-12-15 Angad Singh , Omar Makhlouf , Maximilian Igl , Joao Messias , Arnaud Doucet , Shimon Whiteson

We introduce a probabilistic approach to the LMS filter. By means of an efficient approximation, this approach provides an adaptable step-size LMS algorithm together with a measure of uncertainty about the estimation. In addition, the…

Machine Learning · Statistics 2016-04-11 Jesus Fernandez-Bes , Víctor Elvira , Steven Van Vaerenbergh

We look at a stochastic time-varying optimization problem and we formulate online algorithms to find and track its optimizers in expectation. The algorithms are derived from the intuition that standard prediction and correction steps can be…

Optimization and Control · Mathematics 2024-04-11 Andrea Simonetto , Paolo Massioni