English
Related papers

Related papers: Learning stochastic filtering

200 papers

Reliable state estimation depends on accurately modeled noise covariances, which are difficult to determine in practice. This paper formulates the noise covariance estimation as a bilevel optimization problem that factorizes the joint…

Systems and Control · Electrical Eng. & Systems 2025-12-08 Haoying Li , Yifan Peng , Yuchi Wu , Junfeng Wu

This paper proposes an event-triggered variational Bayesian filter for remote state estimation with unknown and time-varying noise covariances. After presetting multiple nominal process noise covariances and an initial measurement noise…

Signal Processing · Electrical Eng. & Systems 2022-06-15 Xiaoxu Lv , Peihu Duan , Zhisheng Duan , Guanrong Chen , Ling Shi

The objective in stochastic filtering is to reconstruct information about an unobserved (random) process, called the signal process, given the current available observations of a certain noisy transformation of that process. Usually X and Y…

Probability · Mathematics 2017-01-31 B. P. W. Fernando , E. Hausenblas

We consider the problem of randomly choosing the sensors of a linear time-invariant dynamical system subject to process and measurement noise. We sample the sensors independently and from the same distribution. We measure the performance of…

Systems and Control · Electrical Eng. & Systems 2021-03-23 Christopher I. Calle , Shaunak D. Bopardikar

In estimation theory, the Kushner equation provides the evolution of the probability density of the state of a dynamical system given continuous-time observations. Building upon our recent work, we propose a new way to approximate the…

Machine Learning · Statistics 2023-10-04 Marc Lambert , Silvère Bonnabel , Francis Bach

The parameters of temporal models, such as dynamic Bayesian networks, may be modelled in a Bayesian context as static or atemporal variables that influence transition probabilities at every time step. Particle filters fail for models that…

Machine Learning · Statistics 2013-05-09 Yusuf Erol , Lei Li , Bharath Ramsundar , Stuart J. Russell

Stochastic variational Bayes algorithms have become very popular in the machine learning literature, particularly in the context of nonparametric Bayesian inference. These algorithms replace the true but intractable posterior distribution…

Methodology · Statistics 2024-10-04 Pedro Regueiro , Abel Rodríguez , Juan Sosa

Improving efficiency of importance sampler is at the center of research in Monte Carlo methods. While adaptive approach is usually difficult within the Markov Chain Monte Carlo framework, the counterpart in importance sampling can be…

Methodology · Statistics 2007-12-11 Heng Lian

In this paper, we present a unified optimal and exponentially stable filter for linear discrete-time stochastic systems that simultaneously estimates the states and unknown inputs in an unbiased minimum-variance sense, without making any…

Optimization and Control · Mathematics 2014-06-17 Sze Zheng Yong , Minghui Zhu , Emilio Frazzoli

Different change-point type models encountered in statistical inference for stochastic processes give rise to different limiting likelihood ratio processes. In this paper we consider two such likelihood ratios. The first one is an…

Statistics Theory · Mathematics 2010-04-05 Serguei Dachian

The aim of this paper is to provide a variational interpretation of the nonlinear filter in continuous time. A time-stepping procedure is introduced, consisting of successive minimization problems in the space of probability densities. The…

Optimization and Control · Mathematics 2014-12-19 Richard S. Laugesen , Prashant G. Mehta , Sean P. Meyn , Maxim Raginsky

In this paper, we present an optimal filter for linear time-varying continuous-time stochastic systems that simultaneously estimates the states and unknown inputs in an unbiased minimum-variance sense. We first show that the unknown inputs…

Optimization and Control · Mathematics 2016-11-17 Sze Zheng Yong , Minghui Zhu , Emilio Frazzoli

In this work, we consider a sensor selection drawn at random by a sampling with replacement policy for a linear time-invariant dynamical system subject to process and measurement noise. We employ the Kalman filter to estimate the state of…

Systems and Control · Electrical Eng. & Systems 2023-03-15 Christopher I. Calle , Shaunak D. Bopardikar

How can we perform efficient inference and learning in directed probabilistic models, in the presence of continuous latent variables with intractable posterior distributions, and large datasets? We introduce a stochastic variational…

Machine Learning · Statistics 2022-12-13 Diederik P Kingma , Max Welling

The state estimation problem for nonlinear systems with stochastic uncertainties can be formulated in the Bayesian framework, where the objective is to replace the state completely by its probability density function. Without the…

Optimization and Control · Mathematics 2024-04-04 Lukas Ecker , Kurt Schlacher

Practical Bayes filters often assume the state distribution of each time step to be Gaussian for computational tractability, resulting in the so-called Gaussian filters. When facing nonlinear systems, Gaussian filters such as extended…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Wenhan Cao , Tianyi Zhang , Zeju Sun , Chang Liu , Stephen S. -T. Yau , Shengbo Eben Li

Likelihood-based inference in stochastic non-linear dynamical systems, such as those found in chemical reaction networks and biological clock systems, is inherently complex and has largely been limited to small and unrealistically simple…

Computation · Statistics 2024-07-08 Ben Swallow , David A. Rand , Giorgos Minas

We consider nonlinear filters for diffusion processes when the observation and signal noises are small and of the same order. As the noise intensities approach zero, the nonlinear filter can be approximated by a certain variational problem…

Probability · Mathematics 2022-10-19 Anugu Sumith Reddy , Amarjit Budhiraja , Amit Apte

In this paper, we consider the problem of estimating the lead-lag parameter between two stochastic processes driven by fractional Brownian motions (fBMs) of the Hurst parameter greater than 1/2. First we propose a lead-lag model between two…

Statistics Theory · Mathematics 2018-03-13 Kohei Chiba

In this article, variational state estimation is examined from the dynamic programming perspective. This leads to two different value functional recursions depending on whether backward or forward dynamic programming is employed. The result…

Methodology · Statistics 2025-12-17 Filip Tronarp